2026-02-22T21:31:04.590 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-22T21:31:04.603 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-22T21:31:04.680 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64059 branch: wip-yuri6-testing-2026-02-22-1629-squid description: rados/singleton/{all/mon-config-key-caps mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} email: yweinste@redhat.com first_in_suite: false flavor: default job_id: '64059' kernel: branch: distro kdb: true sha1: distro ktype: distro last_in_suite: false machine_type: trial name: yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial no_nested_subset: false os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-yuri6-testing-2026-02-22-1629-squid ceph: conf: global: mon client directed command retry: 5 mon client hunt interval max multiple: 2 mon election default strategy: 3 mon mgr beacon grace: 90 ms bind msgr2: false ms inject socket failures: 1000 ms type: async mgr: debug mgr: 20 debug monc: 10 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon scrub interval: 300 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true bluestore zero block detection: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd mclock skip benchmark: true osd memory target: 1610612736 osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - \(MON_DOWN\) mon_bind_msgr2: false sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri6-testing-2026-02-22-1629-squid sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 owner: scheduled_yuriw@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 5907 sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-yuri6-testing-2026-02-22-1629-squid suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 targets: trial023.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF9cwIMBgGTVhTooil7mC1Wy/WWVRYhV2ULNhPlx/gEwv92qhh/vDeLWk0GK0Kwe86pP6+nb+O4xPSo7rseKW3I= tasks: - install: null - ceph: log-ignorelist: - overall HEALTH_ - \(AUTH_BAD_CAPS\) - \(POOL_APP_NOT_ENABLED\) pre-mgr-commands: - sudo ceph config set mgr mgr_pool false --force - workunit: clients: all: - mon/test_config_key_caps.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-22_19:35:40 tube: trial user: yuriw verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3318653 2026-02-22T21:31:04.680 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa; will attempt to use it 2026-02-22T21:31:04.680 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa/tasks 2026-02-22T21:31:04.681 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-22T21:31:04.682 INFO:teuthology.task.internal:Checking packages... 2026-02-22T21:31:04.682 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'f90f4eaebb28b619cf76e80cbbe997656da69579' 2026-02-22T21:31:04.682 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-22T21:31:04.682 INFO:teuthology.packaging:ref: None 2026-02-22T21:31:04.682 INFO:teuthology.packaging:tag: None 2026-02-22T21:31:04.682 INFO:teuthology.packaging:branch: wip-yuri6-testing-2026-02-22-1629-squid 2026-02-22T21:31:04.682 INFO:teuthology.packaging:sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-22T21:31:04.682 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-yuri6-testing-2026-02-22-1629-squid 2026-02-22T21:31:04.808 INFO:teuthology.task.internal:Found packages for ceph version 19.2.3-689-gf90f4eae-1jammy 2026-02-22T21:31:04.809 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-22T21:31:04.821 INFO:teuthology.task.internal:no buildpackages task found 2026-02-22T21:31:04.821 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-22T21:31:04.834 INFO:teuthology.task.internal:Saving configuration 2026-02-22T21:31:04.843 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-22T21:31:04.854 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-22T21:31:04.932 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial023.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64059', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-22 21:27:03.457482', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAAV2OTakJJ2Y7Qb7a9nM2850AUpSklpwG7tUKRWQ2qo'} 2026-02-22T21:31:04.932 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-22T21:31:04.944 INFO:teuthology.task.internal:roles: ubuntu@trial023.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2026-02-22T21:31:04.944 INFO:teuthology.run_tasks:Running task console_log... 2026-02-22T21:31:05.017 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x74b1417f76a0>, signals=[15]) 2026-02-22T21:31:05.017 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-22T21:31:05.028 INFO:teuthology.task.internal:Opening connections... 2026-02-22T21:31:05.028 DEBUG:teuthology.task.internal:connecting to ubuntu@trial023.front.sepia.ceph.com 2026-02-22T21:31:05.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-22T21:31:05.092 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-22T21:31:05.103 DEBUG:teuthology.orchestra.run.trial023:> uname -m 2026-02-22T21:31:05.168 INFO:teuthology.orchestra.run.trial023.stdout:x86_64 2026-02-22T21:31:05.168 DEBUG:teuthology.orchestra.run.trial023:> cat /etc/os-release 2026-02-22T21:31:05.215 INFO:teuthology.orchestra.run.trial023.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS" 2026-02-22T21:31:05.215 INFO:teuthology.orchestra.run.trial023.stdout:NAME="Ubuntu" 2026-02-22T21:31:05.215 INFO:teuthology.orchestra.run.trial023.stdout:VERSION_ID="22.04" 2026-02-22T21:31:05.215 INFO:teuthology.orchestra.run.trial023.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)" 2026-02-22T21:31:05.215 INFO:teuthology.orchestra.run.trial023.stdout:VERSION_CODENAME=jammy 2026-02-22T21:31:05.215 INFO:teuthology.orchestra.run.trial023.stdout:ID=ubuntu 2026-02-22T21:31:05.215 INFO:teuthology.orchestra.run.trial023.stdout:ID_LIKE=debian 2026-02-22T21:31:05.215 INFO:teuthology.orchestra.run.trial023.stdout:HOME_URL="https://www.ubuntu.com/" 2026-02-22T21:31:05.216 INFO:teuthology.orchestra.run.trial023.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2026-02-22T21:31:05.216 INFO:teuthology.orchestra.run.trial023.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2026-02-22T21:31:05.216 INFO:teuthology.orchestra.run.trial023.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2026-02-22T21:31:05.216 INFO:teuthology.orchestra.run.trial023.stdout:UBUNTU_CODENAME=jammy 2026-02-22T21:31:05.216 INFO:teuthology.lock.ops:Updating trial023.front.sepia.ceph.com on lock server 2026-02-22T21:31:05.307 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-22T21:31:05.321 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-22T21:31:05.332 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-22T21:31:05.332 DEBUG:teuthology.orchestra.run.trial023:> test '!' -e /home/ubuntu/cephtest 2026-02-22T21:31:05.335 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-22T21:31:05.347 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-22T21:31:05.347 DEBUG:teuthology.orchestra.run.trial023:> test -z $(ls -A /var/lib/ceph) 2026-02-22T21:31:05.383 INFO:teuthology.orchestra.run.trial023.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-22T21:31:05.384 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-22T21:31:05.511 INFO:teuthology.run_tasks:Running task kernel... 2026-02-22T21:31:05.538 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': True, 'sha1': 'distro'} 2026-02-22T21:31:05.539 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, timeout 300 2026-02-22T21:31:05.539 DEBUG:teuthology.orchestra.run.trial023:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-22T21:31:05.542 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T21:31:05.543 DEBUG:teuthology.orchestra.run.trial023:> uname -r 2026-02-22T21:31:05.587 INFO:teuthology.orchestra.run.trial023.stdout:5.15.0-170-generic 2026-02-22T21:31:05.587 INFO:teuthology.task.kernel:Running kernel on trial023: 5.15.0-170-generic 2026-02-22T21:31:05.587 DEBUG:teuthology.orchestra.run.trial023:> sudo apt-get clean 2026-02-22T21:31:05.647 DEBUG:teuthology.orchestra.run.trial023:> sudo apt-get update 2026-02-22T21:31:06.096 INFO:teuthology.orchestra.run.trial023.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-22T21:31:06.172 INFO:teuthology.orchestra.run.trial023.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2026-02-22T21:31:06.446 INFO:teuthology.orchestra.run.trial023.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2026-02-22T21:31:06.568 INFO:teuthology.orchestra.run.trial023.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2026-02-22T21:31:06.682 INFO:teuthology.orchestra.run.trial023.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [3245 kB] 2026-02-22T21:31:07.009 INFO:teuthology.orchestra.run.trial023.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [495 kB] 2026-02-22T21:31:07.018 INFO:teuthology.orchestra.run.trial023.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [19.1 kB] 2026-02-22T21:31:07.019 INFO:teuthology.orchestra.run.trial023.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1256 kB] 2026-02-22T21:31:07.048 INFO:teuthology.orchestra.run.trial023.stdout:Get:9 https://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [314 kB] 2026-02-22T21:31:07.053 INFO:teuthology.orchestra.run.trial023.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [30.3 kB] 2026-02-22T21:31:07.054 INFO:teuthology.orchestra.run.trial023.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [5310 kB] 2026-02-22T21:31:07.182 INFO:teuthology.orchestra.run.trial023.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [1005 kB] 2026-02-22T21:31:07.200 INFO:teuthology.orchestra.run.trial023.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 Packages [2983 kB] 2026-02-22T21:31:07.271 INFO:teuthology.orchestra.run.trial023.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy-security/main Translation-en [427 kB] 2026-02-22T21:31:07.278 INFO:teuthology.orchestra.run.trial023.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [14.1 kB] 2026-02-22T21:31:07.278 INFO:teuthology.orchestra.run.trial023.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [1018 kB] 2026-02-22T21:31:07.308 INFO:teuthology.orchestra.run.trial023.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [22.7 kB] 2026-02-22T21:31:07.309 INFO:teuthology.orchestra.run.trial023.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [5147 kB] 2026-02-22T21:31:07.422 INFO:teuthology.orchestra.run.trial023.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy-security/restricted Translation-en [979 kB] 2026-02-22T21:31:10.966 INFO:teuthology.orchestra.run.trial023.stdout:Fetched 22.6 MB in 3s (8537 kB/s) 2026-02-22T21:31:11.498 INFO:teuthology.orchestra.run.trial023.stdout:Reading package lists... 2026-02-22T21:31:11.511 DEBUG:teuthology.orchestra.run.trial023:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-22T21:31:11.544 INFO:teuthology.orchestra.run.trial023.stdout:Reading package lists... 2026-02-22T21:31:11.652 INFO:teuthology.orchestra.run.trial023.stdout:Building dependency tree... 2026-02-22T21:31:11.653 INFO:teuthology.orchestra.run.trial023.stdout:Reading state information... 2026-02-22T21:31:11.740 INFO:teuthology.orchestra.run.trial023.stdout:linux-image-generic is already the newest version (5.15.0.170.159). 2026-02-22T21:31:11.740 INFO:teuthology.orchestra.run.trial023.stdout:linux-image-generic set to manually installed. 2026-02-22T21:31:11.740 INFO:teuthology.orchestra.run.trial023.stdout:The following packages were automatically installed and are no longer required: 2026-02-22T21:31:11.740 INFO:teuthology.orchestra.run.trial023.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-22T21:31:11.741 INFO:teuthology.orchestra.run.trial023.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-22T21:31:11.741 INFO:teuthology.orchestra.run.trial023.stdout: sg3-utils-udev 2026-02-22T21:31:11.741 INFO:teuthology.orchestra.run.trial023.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-22T21:31:11.759 INFO:teuthology.orchestra.run.trial023.stdout:0 upgraded, 0 newly installed, 0 to remove and 13 not upgraded. 2026-02-22T21:31:11.761 DEBUG:teuthology.orchestra.run.trial023:> dpkg -s linux-image-generic 2026-02-22T21:31:11.813 INFO:teuthology.orchestra.run.trial023.stdout:Package: linux-image-generic 2026-02-22T21:31:11.814 INFO:teuthology.orchestra.run.trial023.stdout:Status: install ok installed 2026-02-22T21:31:11.814 INFO:teuthology.orchestra.run.trial023.stdout:Priority: optional 2026-02-22T21:31:11.814 INFO:teuthology.orchestra.run.trial023.stdout:Section: kernel 2026-02-22T21:31:11.814 INFO:teuthology.orchestra.run.trial023.stdout:Installed-Size: 21 2026-02-22T21:31:11.814 INFO:teuthology.orchestra.run.trial023.stdout:Maintainer: Ubuntu Kernel Team 2026-02-22T21:31:11.814 INFO:teuthology.orchestra.run.trial023.stdout:Architecture: amd64 2026-02-22T21:31:11.814 INFO:teuthology.orchestra.run.trial023.stdout:Source: linux-meta 2026-02-22T21:31:11.814 INFO:teuthology.orchestra.run.trial023.stdout:Version: 5.15.0.170.159 2026-02-22T21:31:11.814 INFO:teuthology.orchestra.run.trial023.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-170), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-22T21:31:11.814 INFO:teuthology.orchestra.run.trial023.stdout:Depends: linux-image-5.15.0-170-generic, linux-modules-extra-5.15.0-170-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-22T21:31:11.815 INFO:teuthology.orchestra.run.trial023.stdout:Recommends: thermald 2026-02-22T21:31:11.815 INFO:teuthology.orchestra.run.trial023.stdout:Description: Generic Linux kernel image 2026-02-22T21:31:11.815 INFO:teuthology.orchestra.run.trial023.stdout: This package will always depend on the latest generic kernel image 2026-02-22T21:31:11.815 INFO:teuthology.orchestra.run.trial023.stdout: available. 2026-02-22T21:31:11.815 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2026-02-22T21:31:11.815 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-22T21:31:11.816 DEBUG:teuthology.orchestra.run.trial023:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-22T21:31:11.863 INFO:teuthology.orchestra.run.trial023.stdout:ttyS1 2026-02-22T21:31:11.882 DEBUG:teuthology.parallel:result is None 2026-02-22T21:31:11.882 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-22T21:31:11.896 INFO:teuthology.task.internal:Creating test directory... 2026-02-22T21:31:11.897 DEBUG:teuthology.orchestra.run.trial023:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-22T21:31:11.927 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-22T21:31:11.938 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-22T21:31:11.952 INFO:teuthology.task.internal:Creating archive directory... 2026-02-22T21:31:11.952 DEBUG:teuthology.orchestra.run.trial023:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-22T21:31:11.973 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-22T21:31:11.984 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-22T21:31:11.984 DEBUG:teuthology.orchestra.run.trial023:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-22T21:31:12.020 INFO:teuthology.orchestra.run.trial023.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-22T21:31:12.026 INFO:teuthology.orchestra.run.trial023.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-22T21:31:12.027 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-22T21:31:12.040 INFO:teuthology.task.internal:Configuring sudo... 2026-02-22T21:31:12.041 DEBUG:teuthology.orchestra.run.trial023:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-22T21:31:12.079 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-22T21:31:12.091 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-22T21:31:12.092 DEBUG:teuthology.orchestra.run.trial023:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-22T21:31:12.127 DEBUG:teuthology.orchestra.run.trial023:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-22T21:31:12.171 DEBUG:teuthology.orchestra.run.trial023:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-22T21:31:12.214 DEBUG:teuthology.orchestra.run.trial023:> set -ex 2026-02-22T21:31:12.215 DEBUG:teuthology.orchestra.run.trial023:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-22T21:31:12.264 DEBUG:teuthology.orchestra.run.trial023:> sudo service rsyslog restart 2026-02-22T21:31:12.328 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-22T21:31:12.339 INFO:teuthology.task.internal:Starting timer... 2026-02-22T21:31:12.339 INFO:teuthology.run_tasks:Running task pcp... 2026-02-22T21:31:12.360 INFO:teuthology.run_tasks:Running task selinux... 2026-02-22T21:31:12.377 DEBUG:teuthology.task.selinux:Excluding trial023: OS 'ubuntu' does not support SELinux 2026-02-22T21:31:12.377 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-22T21:31:12.377 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2026-02-22T21:31:12.378 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-22T21:31:12.378 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-22T21:31:12.395 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-22T21:31:12.403 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-22T21:31:12.403 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial023.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-22T21:33:33.266 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial023.front.sepia.ceph.com')] 2026-02-22T21:33:33.268 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial023.front.sepia.ceph.com' 2026-02-22T21:33:33.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-22T21:33:33.335 DEBUG:teuthology.orchestra.run.trial023:> true 2026-02-22T21:33:33.587 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial023.front.sepia.ceph.com' 2026-02-22T21:33:33.587 INFO:teuthology.run_tasks:Running task clock... 2026-02-22T21:33:33.604 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-22T21:33:33.604 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-22T21:33:33.605 DEBUG:teuthology.orchestra.run.trial023:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-22T21:33:33.647 INFO:teuthology.orchestra.run.trial023.stdout:22 Feb 21:33:33 ntpd[9431]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2026-02-22T21:33:33.648 INFO:teuthology.orchestra.run.trial023.stdout:22 Feb 21:33:33 ntpd[9431]: Command line: ntpd -gq 2026-02-22T21:33:33.648 INFO:teuthology.orchestra.run.trial023.stdout:22 Feb 21:33:33 ntpd[9431]: ---------------------------------------------------- 2026-02-22T21:33:33.648 INFO:teuthology.orchestra.run.trial023.stdout:22 Feb 21:33:33 ntpd[9431]: ntp-4 is maintained by Network Time Foundation, 2026-02-22T21:33:33.648 INFO:teuthology.orchestra.run.trial023.stdout:22 Feb 21:33:33 ntpd[9431]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2026-02-22T21:33:33.648 INFO:teuthology.orchestra.run.trial023.stdout:22 Feb 21:33:33 ntpd[9431]: corporation. Support and training for ntp-4 are 2026-02-22T21:33:33.648 INFO:teuthology.orchestra.run.trial023.stdout:22 Feb 21:33:33 ntpd[9431]: available at https://www.nwtime.org/support 2026-02-22T21:33:33.648 INFO:teuthology.orchestra.run.trial023.stdout:22 Feb 21:33:33 ntpd[9431]: ---------------------------------------------------- 2026-02-22T21:33:33.648 INFO:teuthology.orchestra.run.trial023.stdout:22 Feb 21:33:33 ntpd[9431]: proto: precision = 0.020 usec (-25) 2026-02-22T21:33:33.648 INFO:teuthology.orchestra.run.trial023.stdout:22 Feb 21:33:33 ntpd[9431]: basedate set to 2022-02-04 2026-02-22T21:33:33.648 INFO:teuthology.orchestra.run.trial023.stdout:22 Feb 21:33:33 ntpd[9431]: gps base set to 2022-02-06 (week 2196) 2026-02-22T21:33:33.649 INFO:teuthology.orchestra.run.trial023.stdout:22 Feb 21:33:33 ntpd[9431]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-22T21:33:33.649 INFO:teuthology.orchestra.run.trial023.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-22T21:33:33.649 INFO:teuthology.orchestra.run.trial023.stderr:restrict ::: KOD does nothing without LIMITED. 2026-02-22T21:33:33.650 INFO:teuthology.orchestra.run.trial023.stdout:22 Feb 21:33:33 ntpd[9431]: restrict ::: KOD does nothing without LIMITED. 2026-02-22T21:33:33.650 INFO:teuthology.orchestra.run.trial023.stdout:22 Feb 21:33:33 ntpd[9431]: Listen and drop on 0 v6wildcard [::]:123 2026-02-22T21:33:33.650 INFO:teuthology.orchestra.run.trial023.stdout:22 Feb 21:33:33 ntpd[9431]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2026-02-22T21:33:33.650 INFO:teuthology.orchestra.run.trial023.stdout:22 Feb 21:33:33 ntpd[9431]: Listen normally on 2 lo 127.0.0.1:123 2026-02-22T21:33:33.650 INFO:teuthology.orchestra.run.trial023.stdout:22 Feb 21:33:33 ntpd[9431]: Listen normally on 3 enp1s0f0 10.20.193.23:123 2026-02-22T21:33:33.651 INFO:teuthology.orchestra.run.trial023.stdout:22 Feb 21:33:33 ntpd[9431]: Listen normally on 4 lo [::1]:123 2026-02-22T21:33:33.651 INFO:teuthology.orchestra.run.trial023.stdout:22 Feb 21:33:33 ntpd[9431]: Listen normally on 5 enp1s0f0 [fe80::925a:8ff:fe77:648e%2]:123 2026-02-22T21:33:33.651 INFO:teuthology.orchestra.run.trial023.stdout:22 Feb 21:33:33 ntpd[9431]: Listening on routing socket on fd #22 for interface updates 2026-02-22T21:33:34.647 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:34 ntpd[9431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T21:33:34.647 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:34 ntpd[9431]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T21:33:34.647 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:34 ntpd[9431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T21:33:34.647 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:34 ntpd[9431]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T21:33:34.650 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:34 ntpd[9431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T21:33:34.650 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:34 ntpd[9431]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T21:33:34.651 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:34 ntpd[9431]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T21:33:34.651 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:34 ntpd[9431]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T21:33:34.736 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:34 ntpd[9431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T21:33:34.736 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:34 ntpd[9431]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T21:33:34.736 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:34 ntpd[9431]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T21:33:34.736 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:34 ntpd[9431]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T21:33:36.647 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:36 ntpd[9431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T21:33:36.647 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:36 ntpd[9431]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T21:33:36.647 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:36 ntpd[9431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T21:33:36.647 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:36 ntpd[9431]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T21:33:36.653 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:36 ntpd[9431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T21:33:36.653 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:36 ntpd[9431]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T21:33:36.653 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:36 ntpd[9431]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T21:33:36.654 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:36 ntpd[9431]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T21:33:36.735 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:36 ntpd[9431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T21:33:36.735 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:36 ntpd[9431]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T21:33:36.735 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:36 ntpd[9431]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T21:33:36.735 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:36 ntpd[9431]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T21:33:37.647 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:37 ntpd[9431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T21:33:37.647 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:37 ntpd[9431]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T21:33:37.722 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:37 ntpd[9431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T21:33:37.722 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:37 ntpd[9431]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T21:33:37.722 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:37 ntpd[9431]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T21:33:37.722 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:37 ntpd[9431]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T21:33:38.648 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:38 ntpd[9431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T21:33:38.648 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:38 ntpd[9431]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T21:33:38.648 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:38 ntpd[9431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T21:33:38.648 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:38 ntpd[9431]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T21:33:38.649 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:38 ntpd[9431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T21:33:38.649 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:38 ntpd[9431]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T21:33:38.651 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:38 ntpd[9431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T21:33:38.651 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:38 ntpd[9431]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T21:33:38.652 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:38 ntpd[9431]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T21:33:38.652 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:38 ntpd[9431]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T21:33:38.652 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:38 ntpd[9431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T21:33:38.652 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:38 ntpd[9431]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T21:33:38.652 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:38 ntpd[9431]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T21:33:38.652 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:38 ntpd[9431]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T21:33:38.738 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:38 ntpd[9431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T21:33:38.738 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:38 ntpd[9431]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T21:33:38.738 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:38 ntpd[9431]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T21:33:38.738 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:38 ntpd[9431]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T21:33:39.647 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:39 ntpd[9431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T21:33:39.647 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:39 ntpd[9431]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T21:33:39.721 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:39 ntpd[9431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T21:33:39.721 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:39 ntpd[9431]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T21:33:39.721 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:39 ntpd[9431]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T21:33:39.722 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:39 ntpd[9431]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T21:33:40.647 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:40 ntpd[9431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T21:33:40.647 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:40 ntpd[9431]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T21:33:40.647 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:40 ntpd[9431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T21:33:40.647 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:40 ntpd[9431]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T21:33:40.647 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:40 ntpd[9431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T21:33:40.647 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:40 ntpd[9431]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T21:33:40.650 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:40 ntpd[9431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T21:33:40.650 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:40 ntpd[9431]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T21:33:40.650 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:40 ntpd[9431]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T21:33:40.650 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:40 ntpd[9431]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T21:33:40.650 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:40 ntpd[9431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T21:33:40.650 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:40 ntpd[9431]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T21:33:40.650 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:40 ntpd[9431]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T21:33:40.650 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:40 ntpd[9431]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T21:33:40.650 INFO:teuthology.orchestra.run.trial023.stdout:22 Feb 21:33:40 ntpd[9431]: ntpd: time set +0.145624 s 2026-02-22T21:33:40.650 INFO:teuthology.orchestra.run.trial023.stdout:ntpd: time set +0.145624s 2026-02-22T21:33:40.650 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:40 ntpd[9431]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2026-02-22T21:33:40.651 INFO:teuthology.orchestra.run.trial023.stderr:22 Feb 21:33:40 ntpd[9431]: can't open /var/log/ntpstats/loopstats.20260222: Permission denied 2026-02-22T21:33:40.704 INFO:teuthology.orchestra.run.trial023.stdout: remote refid st t when poll reach delay offset jitter 2026-02-22T21:33:40.704 INFO:teuthology.orchestra.run.trial023.stdout:============================================================================== 2026-02-22T21:33:40.704 INFO:teuthology.orchestra.run.trial023.stdout: 139-177-202-26. .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-22T21:33:40.704 INFO:teuthology.orchestra.run.trial023.stdout: 38.45.64.130 .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-22T21:33:40.704 INFO:teuthology.orchestra.run.trial023.stdout: 216.82.35.115 .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-22T21:33:40.704 INFO:teuthology.orchestra.run.trial023.stdout: host-131-239-5- .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-22T21:33:40.705 INFO:teuthology.run_tasks:Running task install... 2026-02-22T21:33:40.717 DEBUG:teuthology.task.install:project ceph 2026-02-22T21:33:40.717 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579'}} 2026-02-22T21:33:40.717 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579'} 2026-02-22T21:33:40.717 INFO:teuthology.task.install:Using flavor: default 2026-02-22T21:33:40.721 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-22T21:33:40.721 INFO:teuthology.task.install:extra packages: [] 2026-02-22T21:33:40.722 DEBUG:teuthology.orchestra.run.trial023:> sudo apt-key list | grep Ceph 2026-02-22T21:33:40.804 INFO:teuthology.orchestra.run.trial023.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2026-02-22T21:33:40.833 INFO:teuthology.orchestra.run.trial023.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2026-02-22T21:33:40.833 INFO:teuthology.orchestra.run.trial023.stdout:uid [ unknown] Ceph.com (release key) 2026-02-22T21:33:40.834 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2026-02-22T21:33:40.834 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-22T21:33:40.963 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default/ 2026-02-22T21:33:40.963 INFO:teuthology.task.install.deb:Package version is 19.2.3-689-gf90f4eae-1jammy 2026-02-22T21:33:41.226 DEBUG:teuthology.orchestra.run.trial023:> set -ex 2026-02-22T21:33:41.226 DEBUG:teuthology.orchestra.run.trial023:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2026-02-22T21:33:41.237 DEBUG:teuthology.orchestra.run.trial023:> sudo apt-get update 2026-02-22T21:33:41.524 INFO:teuthology.orchestra.run.trial023.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy InRelease 2026-02-22T21:33:41.569 INFO:teuthology.orchestra.run.trial023.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy Release [7662 B] 2026-02-22T21:33:41.604 INFO:teuthology.orchestra.run.trial023.stdout:Ign:3 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy Release.gpg 2026-02-22T21:33:41.617 INFO:teuthology.orchestra.run.trial023.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2026-02-22T21:33:41.671 INFO:teuthology.orchestra.run.trial023.stdout:Hit:5 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-22T21:33:41.738 INFO:teuthology.orchestra.run.trial023.stdout:Hit:6 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-22T21:33:41.810 INFO:teuthology.orchestra.run.trial023.stdout:Hit:7 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-22T21:33:41.883 INFO:teuthology.orchestra.run.trial023.stdout:Hit:8 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-22T21:33:42.028 INFO:teuthology.orchestra.run.trial023.stdout:Fetched 25.8 kB in 1s (40.9 kB/s) 2026-02-22T21:33:42.551 INFO:teuthology.orchestra.run.trial023.stdout:Reading package lists... 2026-02-22T21:33:42.564 DEBUG:teuthology.orchestra.run.trial023:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.2.3-689-gf90f4eae-1jammy cephadm=19.2.3-689-gf90f4eae-1jammy ceph-mds=19.2.3-689-gf90f4eae-1jammy ceph-mgr=19.2.3-689-gf90f4eae-1jammy ceph-common=19.2.3-689-gf90f4eae-1jammy ceph-fuse=19.2.3-689-gf90f4eae-1jammy ceph-test=19.2.3-689-gf90f4eae-1jammy ceph-volume=19.2.3-689-gf90f4eae-1jammy radosgw=19.2.3-689-gf90f4eae-1jammy python3-rados=19.2.3-689-gf90f4eae-1jammy python3-rgw=19.2.3-689-gf90f4eae-1jammy python3-cephfs=19.2.3-689-gf90f4eae-1jammy python3-rbd=19.2.3-689-gf90f4eae-1jammy libcephfs2=19.2.3-689-gf90f4eae-1jammy libcephfs-dev=19.2.3-689-gf90f4eae-1jammy librados2=19.2.3-689-gf90f4eae-1jammy librbd1=19.2.3-689-gf90f4eae-1jammy rbd-fuse=19.2.3-689-gf90f4eae-1jammy 2026-02-22T21:33:42.597 INFO:teuthology.orchestra.run.trial023.stdout:Reading package lists... 2026-02-22T21:33:42.707 INFO:teuthology.orchestra.run.trial023.stdout:Building dependency tree... 2026-02-22T21:33:42.707 INFO:teuthology.orchestra.run.trial023.stdout:Reading state information... 2026-02-22T21:33:42.796 INFO:teuthology.orchestra.run.trial023.stdout:The following packages were automatically installed and are no longer required: 2026-02-22T21:33:42.797 INFO:teuthology.orchestra.run.trial023.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-22T21:33:42.797 INFO:teuthology.orchestra.run.trial023.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-22T21:33:42.797 INFO:teuthology.orchestra.run.trial023.stdout: sg3-utils-udev 2026-02-22T21:33:42.797 INFO:teuthology.orchestra.run.trial023.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-22T21:33:42.797 INFO:teuthology.orchestra.run.trial023.stdout:The following additional packages will be installed: 2026-02-22T21:33:42.797 INFO:teuthology.orchestra.run.trial023.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2026-02-22T21:33:42.797 INFO:teuthology.orchestra.run.trial023.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2026-02-22T21:33:42.797 INFO:teuthology.orchestra.run.trial023.stdout: libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 2026-02-22T21:33:42.797 INFO:teuthology.orchestra.run.trial023.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2026-02-22T21:33:42.797 INFO:teuthology.orchestra.run.trial023.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2026-02-22T21:33:42.797 INFO:teuthology.orchestra.run.trial023.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2026-02-22T21:33:42.797 INFO:teuthology.orchestra.run.trial023.stdout: pkg-config python-asyncssh-doc python-pastedeploy-tpl python3-asyncssh 2026-02-22T21:33:42.797 INFO:teuthology.orchestra.run.trial023.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cheroot 2026-02-22T21:33:42.797 INFO:teuthology.orchestra.run.trial023.stdout: python3-cherrypy3 python3-google-auth python3-iniconfig 2026-02-22T21:33:42.797 INFO:teuthology.orchestra.run.trial023.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2026-02-22T21:33:42.797 INFO:teuthology.orchestra.run.trial023.stdout: python3-jaraco.text python3-joblib python3-kubernetes python3-logutils 2026-02-22T21:33:42.797 INFO:teuthology.orchestra.run.trial023.stdout: python3-mako python3-natsort python3-paste python3-pastedeploy 2026-02-22T21:33:42.797 INFO:teuthology.orchestra.run.trial023.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2026-02-22T21:33:42.797 INFO:teuthology.orchestra.run.trial023.stdout: python3-prettytable python3-psutil python3-py python3-pygments 2026-02-22T21:33:42.797 INFO:teuthology.orchestra.run.trial023.stdout: python3-pyinotify python3-pytest python3-repoze.lru 2026-02-22T21:33:42.797 INFO:teuthology.orchestra.run.trial023.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2026-02-22T21:33:42.797 INFO:teuthology.orchestra.run.trial023.stdout: python3-simplejson python3-singledispatch python3-sklearn 2026-02-22T21:33:42.797 INFO:teuthology.orchestra.run.trial023.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2026-02-22T21:33:42.797 INFO:teuthology.orchestra.run.trial023.stdout: python3-toml python3-waitress python3-wcwidth python3-webob 2026-02-22T21:33:42.797 INFO:teuthology.orchestra.run.trial023.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2026-02-22T21:33:42.798 INFO:teuthology.orchestra.run.trial023.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2026-02-22T21:33:42.798 INFO:teuthology.orchestra.run.trial023.stdout:Suggested packages: 2026-02-22T21:33:42.798 INFO:teuthology.orchestra.run.trial023.stdout: python3-influxdb readline-doc python3-beaker python-mako-doc 2026-02-22T21:33:42.798 INFO:teuthology.orchestra.run.trial023.stdout: python-natsort-doc httpd-wsgi libapache2-mod-python libapache2-mod-scgi 2026-02-22T21:33:42.798 INFO:teuthology.orchestra.run.trial023.stdout: libjs-mochikit python-pecan-doc python-psutil-doc subversion 2026-02-22T21:33:42.798 INFO:teuthology.orchestra.run.trial023.stdout: python-pygments-doc ttf-bitstream-vera python-pyinotify-doc python3-dap 2026-02-22T21:33:42.798 INFO:teuthology.orchestra.run.trial023.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2026-02-22T21:33:42.798 INFO:teuthology.orchestra.run.trial023.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2026-02-22T21:33:42.798 INFO:teuthology.orchestra.run.trial023.stdout:Recommended packages: 2026-02-22T21:33:42.798 INFO:teuthology.orchestra.run.trial023.stdout: btrfs-tools 2026-02-22T21:33:42.832 INFO:teuthology.orchestra.run.trial023.stdout:The following NEW packages will be installed: 2026-02-22T21:33:42.832 INFO:teuthology.orchestra.run.trial023.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2026-02-22T21:33:42.832 INFO:teuthology.orchestra.run.trial023.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2026-02-22T21:33:42.832 INFO:teuthology.orchestra.run.trial023.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2026-02-22T21:33:42.832 INFO:teuthology.orchestra.run.trial023.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 2026-02-22T21:33:42.832 INFO:teuthology.orchestra.run.trial023.stdout: liblua5.3-dev libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2026-02-22T21:33:42.832 INFO:teuthology.orchestra.run.trial023.stdout: libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2026-02-22T21:33:42.833 INFO:teuthology.orchestra.run.trial023.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2026-02-22T21:33:42.833 INFO:teuthology.orchestra.run.trial023.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2026-02-22T21:33:42.833 INFO:teuthology.orchestra.run.trial023.stdout: python-pastedeploy-tpl python3-asyncssh python3-cachetools 2026-02-22T21:33:42.833 INFO:teuthology.orchestra.run.trial023.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cheroot 2026-02-22T21:33:42.833 INFO:teuthology.orchestra.run.trial023.stdout: python3-cherrypy3 python3-google-auth python3-iniconfig 2026-02-22T21:33:42.833 INFO:teuthology.orchestra.run.trial023.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2026-02-22T21:33:42.833 INFO:teuthology.orchestra.run.trial023.stdout: python3-jaraco.text python3-joblib python3-kubernetes python3-logutils 2026-02-22T21:33:42.833 INFO:teuthology.orchestra.run.trial023.stdout: python3-mako python3-natsort python3-paste python3-pastedeploy 2026-02-22T21:33:42.833 INFO:teuthology.orchestra.run.trial023.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2026-02-22T21:33:42.833 INFO:teuthology.orchestra.run.trial023.stdout: python3-prettytable python3-psutil python3-py python3-pygments 2026-02-22T21:33:42.833 INFO:teuthology.orchestra.run.trial023.stdout: python3-pyinotify python3-pytest python3-rados python3-rbd 2026-02-22T21:33:42.833 INFO:teuthology.orchestra.run.trial023.stdout: python3-repoze.lru python3-requests-oauthlib python3-rgw python3-routes 2026-02-22T21:33:42.833 INFO:teuthology.orchestra.run.trial023.stdout: python3-rsa python3-simplegeneric python3-simplejson python3-singledispatch 2026-02-22T21:33:42.833 INFO:teuthology.orchestra.run.trial023.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2026-02-22T21:33:42.833 INFO:teuthology.orchestra.run.trial023.stdout: python3-threadpoolctl python3-toml python3-waitress python3-wcwidth 2026-02-22T21:33:42.833 INFO:teuthology.orchestra.run.trial023.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2026-02-22T21:33:42.833 INFO:teuthology.orchestra.run.trial023.stdout: python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse socat unzip 2026-02-22T21:33:42.833 INFO:teuthology.orchestra.run.trial023.stdout: xmlstarlet zip 2026-02-22T21:33:43.077 INFO:teuthology.orchestra.run.trial023.stdout:0 upgraded, 108 newly installed, 0 to remove and 13 not upgraded. 2026-02-22T21:33:43.077 INFO:teuthology.orchestra.run.trial023.stdout:Need to get 178 MB of archives. 2026-02-22T21:33:43.077 INFO:teuthology.orchestra.run.trial023.stdout:After this operation, 809 MB of additional disk space will be used. 2026-02-22T21:33:43.077 INFO:teuthology.orchestra.run.trial023.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.2.3-689-gf90f4eae-1jammy [3597 kB] 2026-02-22T21:33:43.190 INFO:teuthology.orchestra.run.trial023.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2026-02-22T21:33:43.505 INFO:teuthology.orchestra.run.trial023.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.2.3-689-gf90f4eae-1jammy [3256 kB] 2026-02-22T21:33:43.528 INFO:teuthology.orchestra.run.trial023.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2026-02-22T21:33:43.538 INFO:teuthology.orchestra.run.trial023.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2026-02-22T21:33:43.607 INFO:teuthology.orchestra.run.trial023.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2006 kB] 2026-02-22T21:33:43.624 INFO:teuthology.orchestra.run.trial023.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.2.3-689-gf90f4eae-1jammy [979 kB] 2026-02-22T21:33:43.663 INFO:teuthology.orchestra.run.trial023.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.2.3-689-gf90f4eae-1jammy [357 kB] 2026-02-22T21:33:43.675 INFO:teuthology.orchestra.run.trial023.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.2.3-689-gf90f4eae-1jammy [32.9 kB] 2026-02-22T21:33:43.676 INFO:teuthology.orchestra.run.trial023.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.2.3-689-gf90f4eae-1jammy [184 kB] 2026-02-22T21:33:43.679 INFO:teuthology.orchestra.run.trial023.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.2.3-689-gf90f4eae-1jammy [70.0 kB] 2026-02-22T21:33:43.680 INFO:teuthology.orchestra.run.trial023.stdout:Get:12 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.2.3-689-gf90f4eae-1jammy [335 kB] 2026-02-22T21:33:43.693 INFO:teuthology.orchestra.run.trial023.stdout:Get:13 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.2.3-689-gf90f4eae-1jammy [6935 kB] 2026-02-22T21:33:43.809 INFO:teuthology.orchestra.run.trial023.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2026-02-22T21:33:43.819 INFO:teuthology.orchestra.run.trial023.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2026-02-22T21:33:43.851 INFO:teuthology.orchestra.run.trial023.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2026-02-22T21:33:43.858 INFO:teuthology.orchestra.run.trial023.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2026-02-22T21:33:43.859 INFO:teuthology.orchestra.run.trial023.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2026-02-22T21:33:43.860 INFO:teuthology.orchestra.run.trial023.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2026-02-22T21:33:43.860 INFO:teuthology.orchestra.run.trial023.stdout:Get:20 https://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2026-02-22T21:33:43.876 INFO:teuthology.orchestra.run.trial023.stdout:Get:21 https://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2026-02-22T21:33:43.885 INFO:teuthology.orchestra.run.trial023.stdout:Get:22 https://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2026-02-22T21:33:43.886 INFO:teuthology.orchestra.run.trial023.stdout:Get:23 https://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2026-02-22T21:33:43.891 INFO:teuthology.orchestra.run.trial023.stdout:Get:24 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.2.3-689-gf90f4eae-1jammy [112 kB] 2026-02-22T21:33:43.892 INFO:teuthology.orchestra.run.trial023.stdout:Get:25 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.2.3-689-gf90f4eae-1jammy [470 kB] 2026-02-22T21:33:43.908 INFO:teuthology.orchestra.run.trial023.stdout:Get:26 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.2.3-689-gf90f4eae-1jammy [26.5 MB] 2026-02-22T21:33:43.957 INFO:teuthology.orchestra.run.trial023.stdout:Get:27 https://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5034 B] 2026-02-22T21:33:43.958 INFO:teuthology.orchestra.run.trial023.stdout:Get:28 https://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2026-02-22T21:33:43.959 INFO:teuthology.orchestra.run.trial023.stdout:Get:29 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2026-02-22T21:33:43.961 INFO:teuthology.orchestra.run.trial023.stdout:Get:30 https://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2026-02-22T21:33:43.963 INFO:teuthology.orchestra.run.trial023.stdout:Get:31 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 liboath0 amd64 2.6.7-3ubuntu0.1 [41.3 kB] 2026-02-22T21:33:43.963 INFO:teuthology.orchestra.run.trial023.stdout:Get:32 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9030 B] 2026-02-22T21:33:43.964 INFO:teuthology.orchestra.run.trial023.stdout:Get:33 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2026-02-22T21:33:44.030 INFO:teuthology.orchestra.run.trial023.stdout:Get:34 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6452 B] 2026-02-22T21:33:44.030 INFO:teuthology.orchestra.run.trial023.stdout:Get:35 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8716 B] 2026-02-22T21:33:44.030 INFO:teuthology.orchestra.run.trial023.stdout:Get:36 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2026-02-22T21:33:44.102 INFO:teuthology.orchestra.run.trial023.stdout:Get:37 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2026-02-22T21:33:44.102 INFO:teuthology.orchestra.run.trial023.stdout:Get:38 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7240 B] 2026-02-22T21:33:44.102 INFO:teuthology.orchestra.run.trial023.stdout:Get:39 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8980 B] 2026-02-22T21:33:44.107 INFO:teuthology.orchestra.run.trial023.stdout:Get:40 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2026-02-22T21:33:44.109 INFO:teuthology.orchestra.run.trial023.stdout:Get:41 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2026-02-22T21:33:44.109 INFO:teuthology.orchestra.run.trial023.stdout:Get:42 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2026-02-22T21:33:44.110 INFO:teuthology.orchestra.run.trial023.stdout:Get:43 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2026-02-22T21:33:44.176 INFO:teuthology.orchestra.run.trial023.stdout:Get:44 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2026-02-22T21:33:44.176 INFO:teuthology.orchestra.run.trial023.stdout:Get:45 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7320 B] 2026-02-22T21:33:44.176 INFO:teuthology.orchestra.run.trial023.stdout:Get:46 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2026-02-22T21:33:44.250 INFO:teuthology.orchestra.run.trial023.stdout:Get:47 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-waitress all 1.4.4-1.1ubuntu1.1 [47.0 kB] 2026-02-22T21:33:44.251 INFO:teuthology.orchestra.run.trial023.stdout:Get:48 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2026-02-22T21:33:44.251 INFO:teuthology.orchestra.run.trial023.stdout:Get:49 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2026-02-22T21:33:44.256 INFO:teuthology.orchestra.run.trial023.stdout:Get:50 https://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4892 B] 2026-02-22T21:33:44.258 INFO:teuthology.orchestra.run.trial023.stdout:Get:51 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2026-02-22T21:33:44.258 INFO:teuthology.orchestra.run.trial023.stdout:Get:52 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2026-02-22T21:33:44.260 INFO:teuthology.orchestra.run.trial023.stdout:Get:53 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2026-02-22T21:33:44.325 INFO:teuthology.orchestra.run.trial023.stdout:Get:54 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.3 [181 kB] 2026-02-22T21:33:44.326 INFO:teuthology.orchestra.run.trial023.stdout:Get:55 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libfuse2 amd64 2.9.9-5ubuntu3 [90.3 kB] 2026-02-22T21:33:44.327 INFO:teuthology.orchestra.run.trial023.stdout:Get:56 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python3-asyncssh all 2.5.0-1ubuntu0.1 [189 kB] 2026-02-22T21:33:44.397 INFO:teuthology.orchestra.run.trial023.stdout:Get:57 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2026-02-22T21:33:44.398 INFO:teuthology.orchestra.run.trial023.stdout:Get:58 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2026-02-22T21:33:44.398 INFO:teuthology.orchestra.run.trial023.stdout:Get:59 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2058 kB] 2026-02-22T21:33:44.423 INFO:teuthology.orchestra.run.trial023.stdout:Get:60 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2026-02-22T21:33:44.428 INFO:teuthology.orchestra.run.trial023.stdout:Get:61 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2026-02-22T21:33:44.428 INFO:teuthology.orchestra.run.trial023.stdout:Get:62 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1829 kB] 2026-02-22T21:33:44.486 INFO:teuthology.orchestra.run.trial023.stdout:Get:63 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9722 B] 2026-02-22T21:33:44.486 INFO:teuthology.orchestra.run.trial023.stdout:Get:64 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2026-02-22T21:33:44.486 INFO:teuthology.orchestra.run.trial023.stdout:Get:65 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2026-02-22T21:33:44.486 INFO:teuthology.orchestra.run.trial023.stdout:Get:66 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2026-02-22T21:33:44.496 INFO:teuthology.orchestra.run.trial023.stdout:Get:67 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.2.3-689-gf90f4eae-1jammy [5178 kB] 2026-02-22T21:33:44.545 INFO:teuthology.orchestra.run.trial023.stdout:Get:68 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2026-02-22T21:33:44.545 INFO:teuthology.orchestra.run.trial023.stdout:Get:69 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2026-02-22T21:33:44.548 INFO:teuthology.orchestra.run.trial023.stdout:Get:70 https://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2026-02-22T21:33:44.549 INFO:teuthology.orchestra.run.trial023.stdout:Get:71 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libjq1 amd64 1.6-2.1ubuntu3.1 [133 kB] 2026-02-22T21:33:44.550 INFO:teuthology.orchestra.run.trial023.stdout:Get:72 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 jq amd64 1.6-2.1ubuntu3.1 [52.5 kB] 2026-02-22T21:33:44.594 INFO:teuthology.orchestra.run.trial023.stdout:Get:73 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.2.3-689-gf90f4eae-1jammy [248 kB] 2026-02-22T21:33:44.598 INFO:teuthology.orchestra.run.trial023.stdout:Get:74 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.2.3-689-gf90f4eae-1jammy [125 kB] 2026-02-22T21:33:44.601 INFO:teuthology.orchestra.run.trial023.stdout:Get:75 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.2.3-689-gf90f4eae-1jammy [1081 kB] 2026-02-22T21:33:44.616 INFO:teuthology.orchestra.run.trial023.stdout:Get:76 https://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2026-02-22T21:33:44.619 INFO:teuthology.orchestra.run.trial023.stdout:Get:77 https://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2026-02-22T21:33:44.621 INFO:teuthology.orchestra.run.trial023.stdout:Get:78 https://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2026-02-22T21:33:44.622 INFO:teuthology.orchestra.run.trial023.stdout:Get:79 https://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2026-02-22T21:33:44.622 INFO:teuthology.orchestra.run.trial023.stdout:Get:80 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2026-02-22T21:33:44.625 INFO:teuthology.orchestra.run.trial023.stdout:Get:81 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.2.3-689-gf90f4eae-1jammy [6239 kB] 2026-02-22T21:33:44.692 INFO:teuthology.orchestra.run.trial023.stdout:Get:82 https://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2026-02-22T21:33:44.693 INFO:teuthology.orchestra.run.trial023.stdout:Get:83 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python-asyncssh-doc all 2.5.0-1ubuntu0.1 [309 kB] 2026-02-22T21:33:44.703 INFO:teuthology.orchestra.run.trial023.stdout:Get:84 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6024 B] 2026-02-22T21:33:44.704 INFO:teuthology.orchestra.run.trial023.stdout:Get:85 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2026-02-22T21:33:44.704 INFO:teuthology.orchestra.run.trial023.stdout:Get:86 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2026-02-22T21:33:44.744 INFO:teuthology.orchestra.run.trial023.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.2.3-689-gf90f4eae-1jammy [23.0 MB] 2026-02-22T21:33:44.766 INFO:teuthology.orchestra.run.trial023.stdout:Get:88 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2026-02-22T21:33:44.771 INFO:teuthology.orchestra.run.trial023.stdout:Get:89 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2026-02-22T21:33:44.772 INFO:teuthology.orchestra.run.trial023.stdout:Get:90 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-pygments all 2.11.2+dfsg-2ubuntu0.1 [750 kB] 2026-02-22T21:33:44.780 INFO:teuthology.orchestra.run.trial023.stdout:Get:91 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2026-02-22T21:33:44.780 INFO:teuthology.orchestra.run.trial023.stdout:Get:92 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2026-02-22T21:33:44.838 INFO:teuthology.orchestra.run.trial023.stdout:Get:93 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2026-02-22T21:33:44.839 INFO:teuthology.orchestra.run.trial023.stdout:Get:94 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2026-02-22T21:33:44.840 INFO:teuthology.orchestra.run.trial023.stdout:Get:95 https://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1983 kB] 2026-02-22T21:33:45.188 INFO:teuthology.orchestra.run.trial023.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.2.3-689-gf90f4eae-1jammy [14.2 kB] 2026-02-22T21:33:45.189 INFO:teuthology.orchestra.run.trial023.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.2.3-689-gf90f4eae-1jammy [1173 kB] 2026-02-22T21:33:45.204 INFO:teuthology.orchestra.run.trial023.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.2.3-689-gf90f4eae-1jammy [2503 kB] 2026-02-22T21:33:45.253 INFO:teuthology.orchestra.run.trial023.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.2.3-689-gf90f4eae-1jammy [798 kB] 2026-02-22T21:33:45.268 INFO:teuthology.orchestra.run.trial023.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.2.3-689-gf90f4eae-1jammy [157 kB] 2026-02-22T21:33:45.271 INFO:teuthology.orchestra.run.trial023.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.2.3-689-gf90f4eae-1jammy [2396 kB] 2026-02-22T21:33:45.316 INFO:teuthology.orchestra.run.trial023.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.2.3-689-gf90f4eae-1jammy [8625 kB] 2026-02-22T21:33:45.483 INFO:teuthology.orchestra.run.trial023.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.2.3-689-gf90f4eae-1jammy [14.3 kB] 2026-02-22T21:33:45.484 INFO:teuthology.orchestra.run.trial023.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.2.3-689-gf90f4eae-1jammy [52.1 MB] 2026-02-22T21:33:46.506 INFO:teuthology.orchestra.run.trial023.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.2.3-689-gf90f4eae-1jammy [135 kB] 2026-02-22T21:33:46.507 INFO:teuthology.orchestra.run.trial023.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.2.3-689-gf90f4eae-1jammy [41.0 kB] 2026-02-22T21:33:46.507 INFO:teuthology.orchestra.run.trial023.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.2.3-689-gf90f4eae-1jammy [13.7 MB] 2026-02-22T21:33:46.759 INFO:teuthology.orchestra.run.trial023.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.2.3-689-gf90f4eae-1jammy [92.3 kB] 2026-02-22T21:33:47.084 INFO:teuthology.orchestra.run.trial023.stdout:Fetched 178 MB in 4s (45.3 MB/s) 2026-02-22T21:33:47.101 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2026-02-22T21:33:47.261 INFO:teuthology.orchestra.run.trial023.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 167442 files and directories currently installed.) 2026-02-22T21:33:47.263 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2026-02-22T21:33:47.265 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-22T21:33:47.285 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2026-02-22T21:33:47.298 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2026-02-22T21:33:47.298 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-22T21:33:47.314 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2026-02-22T21:33:47.327 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2026-02-22T21:33:47.327 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-22T21:33:47.347 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package libqt5core5a:amd64. 2026-02-22T21:33:47.355 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-22T21:33:47.360 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-22T21:33:47.393 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2026-02-22T21:33:47.401 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-22T21:33:47.401 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-22T21:33:47.418 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package libqt5network5:amd64. 2026-02-22T21:33:47.426 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-22T21:33:47.426 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-22T21:33:47.446 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2026-02-22T21:33:47.454 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2026-02-22T21:33:47.454 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-22T21:33:47.472 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package librados2. 2026-02-22T21:33:47.480 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../007-librados2_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T21:33:47.481 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking librados2 (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:33:47.523 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package libnbd0. 2026-02-22T21:33:47.531 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../008-libnbd0_1.10.5-1_amd64.deb ... 2026-02-22T21:33:47.531 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking libnbd0 (1.10.5-1) ... 2026-02-22T21:33:47.546 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package librbd1. 2026-02-22T21:33:47.554 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../009-librbd1_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T21:33:47.554 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking librbd1 (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:33:47.607 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package libcephfs2. 2026-02-22T21:33:47.615 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../010-libcephfs2_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T21:33:47.615 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking libcephfs2 (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:33:47.635 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package python3-rados. 2026-02-22T21:33:47.644 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../011-python3-rados_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T21:33:47.644 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking python3-rados (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:33:47.662 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package python3-ceph-argparse. 2026-02-22T21:33:47.670 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../012-python3-ceph-argparse_19.2.3-689-gf90f4eae-1jammy_all.deb ... 2026-02-22T21:33:47.670 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking python3-ceph-argparse (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:33:47.684 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package python3-cephfs. 2026-02-22T21:33:47.692 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../013-python3-cephfs_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T21:33:47.693 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking python3-cephfs (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:33:47.708 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package python3-ceph-common. 2026-02-22T21:33:47.716 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../014-python3-ceph-common_19.2.3-689-gf90f4eae-1jammy_all.deb ... 2026-02-22T21:33:47.717 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking python3-ceph-common (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:33:47.734 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package python3-wcwidth. 2026-02-22T21:33:47.742 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2026-02-22T21:33:47.742 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-22T21:33:47.759 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package python3-prettytable. 2026-02-22T21:33:47.767 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2026-02-22T21:33:47.767 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2026-02-22T21:33:47.781 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package python3-rbd. 2026-02-22T21:33:47.789 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../017-python3-rbd_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T21:33:47.790 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking python3-rbd (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:33:47.807 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package librdkafka1:amd64. 2026-02-22T21:33:47.815 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2026-02-22T21:33:47.815 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-22T21:33:47.834 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package libreadline-dev:amd64. 2026-02-22T21:33:47.842 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../019-libreadline-dev_8.1.2-1_amd64.deb ... 2026-02-22T21:33:47.842 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2026-02-22T21:33:47.859 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2026-02-22T21:33:47.867 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../020-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2026-02-22T21:33:47.868 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2026-02-22T21:33:47.886 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package lua5.1. 2026-02-22T21:33:47.894 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../021-lua5.1_5.1.5-8.1build4_amd64.deb ... 2026-02-22T21:33:47.894 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2026-02-22T21:33:47.915 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package lua-any. 2026-02-22T21:33:47.923 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../022-lua-any_27ubuntu1_all.deb ... 2026-02-22T21:33:47.923 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking lua-any (27ubuntu1) ... 2026-02-22T21:33:47.937 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package zip. 2026-02-22T21:33:47.945 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../023-zip_3.0-12build2_amd64.deb ... 2026-02-22T21:33:47.945 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking zip (3.0-12build2) ... 2026-02-22T21:33:47.962 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package unzip. 2026-02-22T21:33:47.970 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../024-unzip_6.0-26ubuntu3.2_amd64.deb ... 2026-02-22T21:33:47.970 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2026-02-22T21:33:47.989 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package luarocks. 2026-02-22T21:33:47.997 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../025-luarocks_3.8.0+dfsg1-1_all.deb ... 2026-02-22T21:33:47.997 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2026-02-22T21:33:48.035 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package librgw2. 2026-02-22T21:33:48.043 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../026-librgw2_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T21:33:48.044 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking librgw2 (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:33:48.118 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package python3-rgw. 2026-02-22T21:33:48.126 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../027-python3-rgw_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T21:33:48.126 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking python3-rgw (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:33:48.142 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package liboath0:amd64. 2026-02-22T21:33:48.149 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../028-liboath0_2.6.7-3ubuntu0.1_amd64.deb ... 2026-02-22T21:33:48.150 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-22T21:33:48.165 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package libradosstriper1. 2026-02-22T21:33:48.173 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../029-libradosstriper1_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T21:33:48.173 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking libradosstriper1 (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:33:48.192 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package ceph-common. 2026-02-22T21:33:48.200 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../030-ceph-common_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T21:33:48.200 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking ceph-common (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:33:48.403 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package ceph-base. 2026-02-22T21:33:48.411 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../031-ceph-base_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T21:33:48.416 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking ceph-base (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:33:48.483 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package python3-jaraco.functools. 2026-02-22T21:33:48.491 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../032-python3-jaraco.functools_3.4.0-2_all.deb ... 2026-02-22T21:33:48.492 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2026-02-22T21:33:48.506 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package python3-cheroot. 2026-02-22T21:33:48.514 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../033-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2026-02-22T21:33:48.515 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-22T21:33:48.531 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package python3-jaraco.classes. 2026-02-22T21:33:48.540 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../034-python3-jaraco.classes_3.2.1-3_all.deb ... 2026-02-22T21:33:48.540 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2026-02-22T21:33:48.555 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package python3-jaraco.text. 2026-02-22T21:33:48.563 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../035-python3-jaraco.text_3.6.0-2_all.deb ... 2026-02-22T21:33:48.563 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2026-02-22T21:33:48.578 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package python3-jaraco.collections. 2026-02-22T21:33:48.586 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../036-python3-jaraco.collections_3.4.0-2_all.deb ... 2026-02-22T21:33:48.586 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2026-02-22T21:33:48.600 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package python3-tempora. 2026-02-22T21:33:48.608 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../037-python3-tempora_4.1.2-1_all.deb ... 2026-02-22T21:33:48.609 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking python3-tempora (4.1.2-1) ... 2026-02-22T21:33:48.625 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package python3-portend. 2026-02-22T21:33:48.633 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../038-python3-portend_3.0.0-1_all.deb ... 2026-02-22T21:33:48.633 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking python3-portend (3.0.0-1) ... 2026-02-22T21:33:48.647 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package python3-zc.lockfile. 2026-02-22T21:33:48.655 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../039-python3-zc.lockfile_2.0-1_all.deb ... 2026-02-22T21:33:48.656 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2026-02-22T21:33:48.671 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package python3-cherrypy3. 2026-02-22T21:33:48.679 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../040-python3-cherrypy3_18.6.1-4_all.deb ... 2026-02-22T21:33:48.679 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2026-02-22T21:33:48.702 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package python3-natsort. 2026-02-22T21:33:48.710 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../041-python3-natsort_8.0.2-1_all.deb ... 2026-02-22T21:33:48.710 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking python3-natsort (8.0.2-1) ... 2026-02-22T21:33:48.726 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package python3-logutils. 2026-02-22T21:33:48.734 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../042-python3-logutils_0.3.3-8_all.deb ... 2026-02-22T21:33:48.734 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking python3-logutils (0.3.3-8) ... 2026-02-22T21:33:48.750 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package python3-mako. 2026-02-22T21:33:48.758 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2026-02-22T21:33:48.758 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2026-02-22T21:33:48.775 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package python3-simplegeneric. 2026-02-22T21:33:48.783 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2026-02-22T21:33:48.783 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2026-02-22T21:33:48.798 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package python3-singledispatch. 2026-02-22T21:33:48.806 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2026-02-22T21:33:48.806 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2026-02-22T21:33:48.821 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package python3-webob. 2026-02-22T21:33:48.829 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2026-02-22T21:33:48.829 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-22T21:33:48.846 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package python3-waitress. 2026-02-22T21:33:48.854 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1.1_all.deb ... 2026-02-22T21:33:48.856 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1.1) ... 2026-02-22T21:33:48.873 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package python3-tempita. 2026-02-22T21:33:48.881 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2026-02-22T21:33:48.881 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2026-02-22T21:33:48.896 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package python3-paste. 2026-02-22T21:33:48.904 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2026-02-22T21:33:48.905 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2026-02-22T21:33:48.939 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2026-02-22T21:33:48.947 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2026-02-22T21:33:48.947 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2026-02-22T21:33:48.962 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package python3-pastedeploy. 2026-02-22T21:33:48.970 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2026-02-22T21:33:48.970 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2026-02-22T21:33:48.986 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package python3-webtest. 2026-02-22T21:33:48.994 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2026-02-22T21:33:48.994 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking python3-webtest (2.0.35-1) ... 2026-02-22T21:33:49.009 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package python3-pecan. 2026-02-22T21:33:49.017 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2026-02-22T21:33:49.017 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2026-02-22T21:33:49.042 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package python3-werkzeug. 2026-02-22T21:33:49.050 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.3_all.deb ... 2026-02-22T21:33:49.050 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.3) ... 2026-02-22T21:33:49.071 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2026-02-22T21:33:49.079 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_19.2.3-689-gf90f4eae-1jammy_all.deb ... 2026-02-22T21:33:49.079 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking ceph-mgr-modules-core (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:33:49.107 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2026-02-22T21:33:49.115 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T21:33:49.115 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking libsqlite3-mod-ceph (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:33:49.131 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package ceph-mgr. 2026-02-22T21:33:49.139 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../057-ceph-mgr_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T21:33:49.139 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking ceph-mgr (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:33:49.162 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package ceph-mon. 2026-02-22T21:33:49.170 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../058-ceph-mon_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T21:33:49.170 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking ceph-mon (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:33:49.228 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package libfuse2:amd64. 2026-02-22T21:33:49.236 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../059-libfuse2_2.9.9-5ubuntu3_amd64.deb ... 2026-02-22T21:33:49.237 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-22T21:33:49.253 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package ceph-osd. 2026-02-22T21:33:49.261 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../060-ceph-osd_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T21:33:49.261 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking ceph-osd (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:33:49.414 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package ceph. 2026-02-22T21:33:49.422 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../061-ceph_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T21:33:49.422 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking ceph (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:33:49.437 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package ceph-fuse. 2026-02-22T21:33:49.444 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../062-ceph-fuse_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T21:33:49.445 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking ceph-fuse (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:33:49.469 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package ceph-mds. 2026-02-22T21:33:49.477 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../063-ceph-mds_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T21:33:49.478 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking ceph-mds (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:33:49.511 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package cephadm. 2026-02-22T21:33:49.519 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../064-cephadm_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T21:33:49.519 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking cephadm (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:33:49.535 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package python3-asyncssh. 2026-02-22T21:33:49.543 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1ubuntu0.1_all.deb ... 2026-02-22T21:33:49.544 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-22T21:33:49.565 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2026-02-22T21:33:49.573 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../066-ceph-mgr-cephadm_19.2.3-689-gf90f4eae-1jammy_all.deb ... 2026-02-22T21:33:49.573 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking ceph-mgr-cephadm (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:33:49.593 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package python3-repoze.lru. 2026-02-22T21:33:49.601 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../067-python3-repoze.lru_0.7-2_all.deb ... 2026-02-22T21:33:49.602 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2026-02-22T21:33:49.617 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package python3-routes. 2026-02-22T21:33:49.625 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../068-python3-routes_2.5.1-1ubuntu1_all.deb ... 2026-02-22T21:33:49.625 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2026-02-22T21:33:49.645 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2026-02-22T21:33:49.653 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../069-ceph-mgr-dashboard_19.2.3-689-gf90f4eae-1jammy_all.deb ... 2026-02-22T21:33:49.653 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking ceph-mgr-dashboard (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:33:49.859 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2026-02-22T21:33:49.867 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../070-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2026-02-22T21:33:49.868 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-22T21:33:49.906 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package python3-joblib. 2026-02-22T21:33:49.914 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../071-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2026-02-22T21:33:49.914 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2026-02-22T21:33:49.942 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package python3-threadpoolctl. 2026-02-22T21:33:49.950 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../072-python3-threadpoolctl_3.1.0-1_all.deb ... 2026-02-22T21:33:49.950 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2026-02-22T21:33:49.965 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package python3-sklearn. 2026-02-22T21:33:49.974 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../073-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2026-02-22T21:33:49.974 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-22T21:33:50.057 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2026-02-22T21:33:50.066 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../074-ceph-mgr-diskprediction-local_19.2.3-689-gf90f4eae-1jammy_all.deb ... 2026-02-22T21:33:50.066 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking ceph-mgr-diskprediction-local (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:33:50.233 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package python3-cachetools. 2026-02-22T21:33:50.241 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../075-python3-cachetools_5.0.0-1_all.deb ... 2026-02-22T21:33:50.242 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2026-02-22T21:33:50.256 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package python3-rsa. 2026-02-22T21:33:50.264 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../076-python3-rsa_4.8-1_all.deb ... 2026-02-22T21:33:50.265 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking python3-rsa (4.8-1) ... 2026-02-22T21:33:50.282 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package python3-google-auth. 2026-02-22T21:33:50.291 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../077-python3-google-auth_1.5.1-3_all.deb ... 2026-02-22T21:33:50.291 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2026-02-22T21:33:50.307 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package python3-requests-oauthlib. 2026-02-22T21:33:50.316 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../078-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2026-02-22T21:33:50.316 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-22T21:33:50.332 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package python3-websocket. 2026-02-22T21:33:50.340 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../079-python3-websocket_1.2.3-1_all.deb ... 2026-02-22T21:33:50.340 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking python3-websocket (1.2.3-1) ... 2026-02-22T21:33:50.358 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package python3-kubernetes. 2026-02-22T21:33:50.366 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../080-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2026-02-22T21:33:50.367 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-22T21:33:50.461 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2026-02-22T21:33:50.469 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../081-ceph-mgr-k8sevents_19.2.3-689-gf90f4eae-1jammy_all.deb ... 2026-02-22T21:33:50.470 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking ceph-mgr-k8sevents (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:33:50.484 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package libonig5:amd64. 2026-02-22T21:33:50.492 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../082-libonig5_6.9.7.1-2build1_amd64.deb ... 2026-02-22T21:33:50.499 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-22T21:33:50.515 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package libjq1:amd64. 2026-02-22T21:33:50.524 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../083-libjq1_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-22T21:33:50.524 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-22T21:33:50.539 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package jq. 2026-02-22T21:33:50.547 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../084-jq_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-22T21:33:50.547 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking jq (1.6-2.1ubuntu3.1) ... 2026-02-22T21:33:50.562 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package socat. 2026-02-22T21:33:50.570 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../085-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2026-02-22T21:33:50.570 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2026-02-22T21:33:50.590 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package xmlstarlet. 2026-02-22T21:33:50.598 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../086-xmlstarlet_1.6.1-2.1_amd64.deb ... 2026-02-22T21:33:50.598 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2026-02-22T21:33:50.637 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package ceph-test. 2026-02-22T21:33:50.645 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../087-ceph-test_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T21:33:50.646 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking ceph-test (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:33:51.171 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package ceph-volume. 2026-02-22T21:33:51.179 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../088-ceph-volume_19.2.3-689-gf90f4eae-1jammy_all.deb ... 2026-02-22T21:33:51.179 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking ceph-volume (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:33:51.203 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package libcephfs-dev. 2026-02-22T21:33:51.211 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../089-libcephfs-dev_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T21:33:51.211 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking libcephfs-dev (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:33:51.226 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package lua-socket:amd64. 2026-02-22T21:33:51.234 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../090-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2026-02-22T21:33:51.235 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2026-02-22T21:33:51.256 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package lua-sec:amd64. 2026-02-22T21:33:51.264 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../091-lua-sec_1.0.2-1_amd64.deb ... 2026-02-22T21:33:51.265 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2026-02-22T21:33:51.282 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package nvme-cli. 2026-02-22T21:33:51.291 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../092-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2026-02-22T21:33:51.291 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2026-02-22T21:33:51.322 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package pkg-config. 2026-02-22T21:33:51.330 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../093-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2026-02-22T21:33:51.330 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2026-02-22T21:33:51.346 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package python-asyncssh-doc. 2026-02-22T21:33:51.354 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../094-python-asyncssh-doc_2.5.0-1ubuntu0.1_all.deb ... 2026-02-22T21:33:51.354 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-22T21:33:51.384 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package python3-iniconfig. 2026-02-22T21:33:51.392 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../095-python3-iniconfig_1.1.1-2_all.deb ... 2026-02-22T21:33:51.393 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2026-02-22T21:33:51.408 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package python3-pastescript. 2026-02-22T21:33:51.416 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../096-python3-pastescript_2.0.2-4_all.deb ... 2026-02-22T21:33:51.416 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2026-02-22T21:33:51.435 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package python3-pluggy. 2026-02-22T21:33:51.444 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../097-python3-pluggy_0.13.0-7.1_all.deb ... 2026-02-22T21:33:51.444 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2026-02-22T21:33:51.459 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package python3-psutil. 2026-02-22T21:33:51.467 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../098-python3-psutil_5.9.0-1build1_amd64.deb ... 2026-02-22T21:33:51.468 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2026-02-22T21:33:51.486 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package python3-py. 2026-02-22T21:33:51.495 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../099-python3-py_1.10.0-1_all.deb ... 2026-02-22T21:33:51.495 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking python3-py (1.10.0-1) ... 2026-02-22T21:33:51.516 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package python3-pygments. 2026-02-22T21:33:51.524 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../100-python3-pygments_2.11.2+dfsg-2ubuntu0.1_all.deb ... 2026-02-22T21:33:51.524 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-22T21:33:51.566 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package python3-pyinotify. 2026-02-22T21:33:51.574 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../101-python3-pyinotify_0.9.6-1.3_all.deb ... 2026-02-22T21:33:51.574 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2026-02-22T21:33:51.590 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package python3-toml. 2026-02-22T21:33:51.598 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../102-python3-toml_0.10.2-1_all.deb ... 2026-02-22T21:33:51.599 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking python3-toml (0.10.2-1) ... 2026-02-22T21:33:51.614 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package python3-pytest. 2026-02-22T21:33:51.622 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../103-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2026-02-22T21:33:51.623 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2026-02-22T21:33:51.644 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package python3-simplejson. 2026-02-22T21:33:51.653 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../104-python3-simplejson_3.17.6-1build1_amd64.deb ... 2026-02-22T21:33:51.653 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2026-02-22T21:33:51.671 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package qttranslations5-l10n. 2026-02-22T21:33:51.679 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../105-qttranslations5-l10n_5.15.3-1_all.deb ... 2026-02-22T21:33:51.680 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2026-02-22T21:33:51.747 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package radosgw. 2026-02-22T21:33:51.755 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../106-radosgw_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T21:33:51.756 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking radosgw (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:33:51.868 INFO:teuthology.orchestra.run.trial023.stdout:Selecting previously unselected package rbd-fuse. 2026-02-22T21:33:51.877 INFO:teuthology.orchestra.run.trial023.stdout:Preparing to unpack .../107-rbd-fuse_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T21:33:51.877 INFO:teuthology.orchestra.run.trial023.stdout:Unpacking rbd-fuse (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:33:51.906 INFO:teuthology.orchestra.run.trial023.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2026-02-22T21:33:51.973 INFO:teuthology.orchestra.run.trial023.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-22T21:33:51.974 INFO:teuthology.orchestra.run.trial023.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2026-02-22T21:33:52.046 INFO:teuthology.orchestra.run.trial023.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /lib/systemd/system/nvmefc-boot-connections.service. 2026-02-22T21:33:52.321 INFO:teuthology.orchestra.run.trial023.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service → /lib/systemd/system/nvmf-autoconnect.service. 2026-02-22T21:33:52.686 INFO:teuthology.orchestra.run.trial023.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2026-02-22T21:33:52.698 INFO:teuthology.orchestra.run.trial023.stdout:Setting up cephadm (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:33:52.741 INFO:teuthology.orchestra.run.trial023.stdout:Adding system user cephadm....done 2026-02-22T21:33:52.752 INFO:teuthology.orchestra.run.trial023.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1.1) ... 2026-02-22T21:33:52.824 INFO:teuthology.orchestra.run.trial023.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2026-02-22T21:33:52.898 INFO:teuthology.orchestra.run.trial023.stdout:Setting up python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-22T21:33:52.899 INFO:teuthology.orchestra.run.trial023.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2026-02-22T21:33:52.973 INFO:teuthology.orchestra.run.trial023.stdout:Setting up python3-repoze.lru (0.7-2) ... 2026-02-22T21:33:53.049 INFO:teuthology.orchestra.run.trial023.stdout:Setting up liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-22T21:33:53.050 INFO:teuthology.orchestra.run.trial023.stdout:Setting up python3-py (1.10.0-1) ... 2026-02-22T21:33:53.149 INFO:teuthology.orchestra.run.trial023.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2026-02-22T21:33:53.272 INFO:teuthology.orchestra.run.trial023.stdout:Setting up python3-cachetools (5.0.0-1) ... 2026-02-22T21:33:53.348 INFO:teuthology.orchestra.run.trial023.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2026-02-22T21:33:53.359 INFO:teuthology.orchestra.run.trial023.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2026-02-22T21:33:53.436 INFO:teuthology.orchestra.run.trial023.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2026-02-22T21:33:53.511 INFO:teuthology.orchestra.run.trial023.stdout:Setting up python3-ceph-argparse (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:33:53.579 INFO:teuthology.orchestra.run.trial023.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-22T21:33:53.580 INFO:teuthology.orchestra.run.trial023.stdout:Setting up libnbd0 (1.10.5-1) ... 2026-02-22T21:33:53.581 INFO:teuthology.orchestra.run.trial023.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2026-02-22T21:33:53.582 INFO:teuthology.orchestra.run.trial023.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2026-02-22T21:33:53.583 INFO:teuthology.orchestra.run.trial023.stdout:Setting up libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-22T21:33:53.583 INFO:teuthology.orchestra.run.trial023.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2026-02-22T21:33:53.600 INFO:teuthology.orchestra.run.trial023.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2026-02-22T21:33:53.602 INFO:teuthology.orchestra.run.trial023.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2026-02-22T21:33:53.603 INFO:teuthology.orchestra.run.trial023.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-22T21:33:53.604 INFO:teuthology.orchestra.run.trial023.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2026-02-22T21:33:53.727 INFO:teuthology.orchestra.run.trial023.stdout:Setting up python3-natsort (8.0.2-1) ... 2026-02-22T21:33:53.807 INFO:teuthology.orchestra.run.trial023.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2026-02-22T21:33:53.887 INFO:teuthology.orchestra.run.trial023.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2026-02-22T21:33:53.974 INFO:teuthology.orchestra.run.trial023.stdout:Setting up zip (3.0-12build2) ... 2026-02-22T21:33:53.975 INFO:teuthology.orchestra.run.trial023.stdout:Setting up python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-22T21:33:54.228 INFO:teuthology.orchestra.run.trial023.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2026-02-22T21:33:54.304 INFO:teuthology.orchestra.run.trial023.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2026-02-22T21:33:54.305 INFO:teuthology.orchestra.run.trial023.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2026-02-22T21:33:54.306 INFO:teuthology.orchestra.run.trial023.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-22T21:33:54.399 INFO:teuthology.orchestra.run.trial023.stdout:Setting up python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-22T21:33:54.520 INFO:teuthology.orchestra.run.trial023.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2026-02-22T21:33:54.649 INFO:teuthology.orchestra.run.trial023.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-22T21:33:54.731 INFO:teuthology.orchestra.run.trial023.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.3) ... 2026-02-22T21:33:54.839 INFO:teuthology.orchestra.run.trial023.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2026-02-22T21:33:54.911 INFO:teuthology.orchestra.run.trial023.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2026-02-22T21:33:54.912 INFO:teuthology.orchestra.run.trial023.stdout:Setting up python3-ceph-common (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:33:54.995 INFO:teuthology.orchestra.run.trial023.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-22T21:33:55.488 INFO:teuthology.orchestra.run.trial023.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2026-02-22T21:33:55.510 INFO:teuthology.orchestra.run.trial023.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-22T21:33:55.515 INFO:teuthology.orchestra.run.trial023.stdout:Setting up python3-toml (0.10.2-1) ... 2026-02-22T21:33:55.589 INFO:teuthology.orchestra.run.trial023.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-22T21:33:55.590 INFO:teuthology.orchestra.run.trial023.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2026-02-22T21:33:55.591 INFO:teuthology.orchestra.run.trial023.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2026-02-22T21:33:55.668 INFO:teuthology.orchestra.run.trial023.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2026-02-22T21:33:55.741 INFO:teuthology.orchestra.run.trial023.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-22T21:33:55.742 INFO:teuthology.orchestra.run.trial023.stdout:Setting up python3-rsa (4.8-1) ... 2026-02-22T21:33:55.820 INFO:teuthology.orchestra.run.trial023.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2026-02-22T21:33:55.894 INFO:teuthology.orchestra.run.trial023.stdout:Setting up python3-logutils (0.3.3-8) ... 2026-02-22T21:33:55.970 INFO:teuthology.orchestra.run.trial023.stdout:Setting up python3-tempora (4.1.2-1) ... 2026-02-22T21:33:56.044 INFO:teuthology.orchestra.run.trial023.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2026-02-22T21:33:56.117 INFO:teuthology.orchestra.run.trial023.stdout:Setting up python3-prettytable (2.5.0-2) ... 2026-02-22T21:33:56.195 INFO:teuthology.orchestra.run.trial023.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-22T21:33:56.196 INFO:teuthology.orchestra.run.trial023.stdout:Setting up python3-websocket (1.2.3-1) ... 2026-02-22T21:33:56.280 INFO:teuthology.orchestra.run.trial023.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-22T21:33:56.281 INFO:teuthology.orchestra.run.trial023.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-22T21:33:56.357 INFO:teuthology.orchestra.run.trial023.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2026-02-22T21:33:56.436 INFO:teuthology.orchestra.run.trial023.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-22T21:33:56.521 INFO:teuthology.orchestra.run.trial023.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2026-02-22T21:33:56.595 INFO:teuthology.orchestra.run.trial023.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2026-02-22T21:33:56.596 INFO:teuthology.orchestra.run.trial023.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2026-02-22T21:33:56.597 INFO:teuthology.orchestra.run.trial023.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-22T21:33:56.598 INFO:teuthology.orchestra.run.trial023.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2026-02-22T21:33:56.731 INFO:teuthology.orchestra.run.trial023.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2026-02-22T21:33:56.809 INFO:teuthology.orchestra.run.trial023.stdout:Setting up lua-any (27ubuntu1) ... 2026-02-22T21:33:56.810 INFO:teuthology.orchestra.run.trial023.stdout:Setting up python3-portend (3.0.0-1) ... 2026-02-22T21:33:56.886 INFO:teuthology.orchestra.run.trial023.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-22T21:33:56.887 INFO:teuthology.orchestra.run.trial023.stdout:Setting up python3-google-auth (1.5.1-3) ... 2026-02-22T21:33:56.970 INFO:teuthology.orchestra.run.trial023.stdout:Setting up jq (1.6-2.1ubuntu3.1) ... 2026-02-22T21:33:56.971 INFO:teuthology.orchestra.run.trial023.stdout:Setting up python3-webtest (2.0.35-1) ... 2026-02-22T21:33:57.052 INFO:teuthology.orchestra.run.trial023.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2026-02-22T21:33:57.190 INFO:teuthology.orchestra.run.trial023.stdout:Setting up python3-pastescript (2.0.2-4) ... 2026-02-22T21:33:57.280 INFO:teuthology.orchestra.run.trial023.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2026-02-22T21:33:57.395 INFO:teuthology.orchestra.run.trial023.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-22T21:33:57.396 INFO:teuthology.orchestra.run.trial023.stdout:Setting up librados2 (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:33:57.397 INFO:teuthology.orchestra.run.trial023.stdout:Setting up libsqlite3-mod-ceph (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:33:57.398 INFO:teuthology.orchestra.run.trial023.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-22T21:33:57.924 INFO:teuthology.orchestra.run.trial023.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2026-02-22T21:33:57.934 INFO:teuthology.orchestra.run.trial023.stdout:Setting up libcephfs2 (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:33:57.935 INFO:teuthology.orchestra.run.trial023.stdout:Setting up libradosstriper1 (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:33:57.936 INFO:teuthology.orchestra.run.trial023.stdout:Setting up librbd1 (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:33:57.937 INFO:teuthology.orchestra.run.trial023.stdout:Setting up ceph-mgr-modules-core (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:33:57.938 INFO:teuthology.orchestra.run.trial023.stdout:Setting up ceph-fuse (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:33:58.007 INFO:teuthology.orchestra.run.trial023.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-22T21:33:58.007 INFO:teuthology.orchestra.run.trial023.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-22T21:33:58.378 INFO:teuthology.orchestra.run.trial023.stdout:Setting up libcephfs-dev (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:33:58.379 INFO:teuthology.orchestra.run.trial023.stdout:Setting up python3-rados (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:33:58.380 INFO:teuthology.orchestra.run.trial023.stdout:Setting up librgw2 (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:33:58.381 INFO:teuthology.orchestra.run.trial023.stdout:Setting up python3-rbd (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:33:58.382 INFO:teuthology.orchestra.run.trial023.stdout:Setting up rbd-fuse (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:33:58.383 INFO:teuthology.orchestra.run.trial023.stdout:Setting up python3-rgw (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:33:58.383 INFO:teuthology.orchestra.run.trial023.stdout:Setting up python3-cephfs (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:33:58.384 INFO:teuthology.orchestra.run.trial023.stdout:Setting up ceph-common (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:33:58.413 INFO:teuthology.orchestra.run.trial023.stdout:Adding group ceph....done 2026-02-22T21:33:58.449 INFO:teuthology.orchestra.run.trial023.stdout:Adding system user ceph....done 2026-02-22T21:33:58.459 INFO:teuthology.orchestra.run.trial023.stdout:Setting system user ceph properties....done 2026-02-22T21:33:58.466 INFO:teuthology.orchestra.run.trial023.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2026-02-22T21:33:58.553 INFO:teuthology.orchestra.run.trial023.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /lib/systemd/system/ceph.target. 2026-02-22T21:33:58.825 INFO:teuthology.orchestra.run.trial023.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service → /lib/systemd/system/rbdmap.service. 2026-02-22T21:33:59.184 INFO:teuthology.orchestra.run.trial023.stdout:Setting up ceph-test (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:33:59.185 INFO:teuthology.orchestra.run.trial023.stdout:Setting up radosgw (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:33:59.433 INFO:teuthology.orchestra.run.trial023.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-22T21:33:59.433 INFO:teuthology.orchestra.run.trial023.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-22T21:33:59.776 INFO:teuthology.orchestra.run.trial023.stdout:Setting up ceph-base (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:33:59.897 INFO:teuthology.orchestra.run.trial023.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /lib/systemd/system/ceph-crash.service. 2026-02-22T21:34:00.249 INFO:teuthology.orchestra.run.trial023.stdout:Setting up ceph-mds (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:34:00.311 INFO:teuthology.orchestra.run.trial023.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-22T21:34:00.312 INFO:teuthology.orchestra.run.trial023.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-22T21:34:00.651 INFO:teuthology.orchestra.run.trial023.stdout:Setting up ceph-mgr (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:34:00.723 INFO:teuthology.orchestra.run.trial023.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-22T21:34:00.724 INFO:teuthology.orchestra.run.trial023.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-22T21:34:01.066 INFO:teuthology.orchestra.run.trial023.stdout:Setting up ceph-osd (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:34:01.150 INFO:teuthology.orchestra.run.trial023.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-22T21:34:01.150 INFO:teuthology.orchestra.run.trial023.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-22T21:34:01.514 INFO:teuthology.orchestra.run.trial023.stdout:Setting up ceph-mgr-k8sevents (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:34:01.514 INFO:teuthology.orchestra.run.trial023.stdout:Setting up ceph-mgr-diskprediction-local (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:34:01.525 INFO:teuthology.orchestra.run.trial023.stdout:Setting up ceph-mon (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:34:01.597 INFO:teuthology.orchestra.run.trial023.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-22T21:34:01.597 INFO:teuthology.orchestra.run.trial023.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-22T21:34:01.960 INFO:teuthology.orchestra.run.trial023.stdout:Setting up ceph-mgr-cephadm (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:34:01.971 INFO:teuthology.orchestra.run.trial023.stdout:Setting up ceph (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:34:01.972 INFO:teuthology.orchestra.run.trial023.stdout:Setting up ceph-mgr-dashboard (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:34:01.982 INFO:teuthology.orchestra.run.trial023.stdout:Setting up ceph-volume (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T21:34:02.093 INFO:teuthology.orchestra.run.trial023.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2026-02-22T21:34:02.100 INFO:teuthology.orchestra.run.trial023.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.13) ... 2026-02-22T21:34:02.343 INFO:teuthology.orchestra.run.trial023.stdout:Processing triggers for man-db (2.10.2-1) ... 2026-02-22T21:34:02.430 INFO:teuthology.orchestra.run.trial023.stdout:Processing triggers for install-info (6.8-4build1) ... 2026-02-22T21:34:02.915 INFO:teuthology.orchestra.run.trial023.stdout: 2026-02-22T21:34:02.915 INFO:teuthology.orchestra.run.trial023.stdout:Running kernel seems to be up-to-date. 2026-02-22T21:34:02.915 INFO:teuthology.orchestra.run.trial023.stdout: 2026-02-22T21:34:02.916 INFO:teuthology.orchestra.run.trial023.stdout:The processor microcode seems to be up-to-date. 2026-02-22T21:34:02.916 INFO:teuthology.orchestra.run.trial023.stdout: 2026-02-22T21:34:02.916 INFO:teuthology.orchestra.run.trial023.stdout:No services need to be restarted. 2026-02-22T21:34:02.916 INFO:teuthology.orchestra.run.trial023.stdout: 2026-02-22T21:34:02.916 INFO:teuthology.orchestra.run.trial023.stdout:No containers need to be restarted. 2026-02-22T21:34:02.916 INFO:teuthology.orchestra.run.trial023.stdout: 2026-02-22T21:34:02.916 INFO:teuthology.orchestra.run.trial023.stdout:No user sessions are running outdated binaries. 2026-02-22T21:34:02.916 INFO:teuthology.orchestra.run.trial023.stdout: 2026-02-22T21:34:02.916 INFO:teuthology.orchestra.run.trial023.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-22T21:34:03.729 INFO:teuthology.orchestra.run.trial023.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2026-02-22T21:34:03.734 DEBUG:teuthology.parallel:result is None 2026-02-22T21:34:03.734 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-22T21:34:03.860 DEBUG:teuthology.orchestra.run.trial023:> dpkg-query -W -f '${Version}' ceph 2026-02-22T21:34:03.870 INFO:teuthology.orchestra.run.trial023.stdout:19.2.3-689-gf90f4eae-1jammy 2026-02-22T21:34:03.871 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-689-gf90f4eae-1jammy 2026-02-22T21:34:03.871 INFO:teuthology.task.install:The correct ceph version 19.2.3-689-gf90f4eae-1jammy is installed. 2026-02-22T21:34:03.873 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-22T21:34:03.873 DEBUG:teuthology.orchestra.run.trial023:> set -ex 2026-02-22T21:34:03.873 DEBUG:teuthology.orchestra.run.trial023:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-22T21:34:03.920 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-22T21:34:03.920 DEBUG:teuthology.orchestra.run.trial023:> set -ex 2026-02-22T21:34:03.920 DEBUG:teuthology.orchestra.run.trial023:> sudo dd of=/usr/bin/daemon-helper 2026-02-22T21:34:03.972 DEBUG:teuthology.orchestra.run.trial023:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-22T21:34:04.023 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-22T21:34:04.023 DEBUG:teuthology.orchestra.run.trial023:> set -ex 2026-02-22T21:34:04.023 DEBUG:teuthology.orchestra.run.trial023:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-22T21:34:04.072 DEBUG:teuthology.orchestra.run.trial023:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-22T21:34:04.123 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-22T21:34:04.123 DEBUG:teuthology.orchestra.run.trial023:> set -ex 2026-02-22T21:34:04.123 DEBUG:teuthology.orchestra.run.trial023:> sudo dd of=/usr/bin/stdin-killer 2026-02-22T21:34:04.171 DEBUG:teuthology.orchestra.run.trial023:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-22T21:34:04.219 INFO:teuthology.run_tasks:Running task ceph... 2026-02-22T21:34:04.300 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-22T21:34:04.300 DEBUG:teuthology.orchestra.run.trial023:> sudo chmod 777 /var/log/ceph 2026-02-22T21:34:04.309 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-22T21:34:04.309 DEBUG:teuthology.orchestra.run.trial023:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-22T21:34:04.359 INFO:tasks.ceph:Creating extra log directories... 2026-02-22T21:34:04.359 DEBUG:teuthology.orchestra.run.trial023:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-22T21:34:04.415 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-22T21:34:04.415 INFO:tasks.ceph:config {'conf': {'global': {'mon client directed command retry': 5, 'mon client hunt interval max multiple': 2, 'mon election default strategy': 3, 'mon mgr beacon grace': 90, 'ms bind msgr2': False, 'ms inject socket failures': 1000, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug monc': 10, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['overall HEALTH_', '\\(AUTH_BAD_CAPS\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', '\\(MON_DOWN\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': False, 'mon_bind_addrvec': True} 2026-02-22T21:34:04.415 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64059', 'branch': 'wip-yuri6-testing-2026-02-22-1629-squid', 'description': 'rados/singleton/{all/mon-config-key-caps mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'flavor': 'default', 'job_id': '64059', 'kernel': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'trial', 'name': 'yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial', 'no_nested_subset': False, 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-yuri6-testing-2026-02-22-1629-squid'}, 'ceph': {'conf': {'global': {'mon client directed command retry': 5, 'mon client hunt interval max multiple': 2, 'mon election default strategy': 3, 'mon mgr beacon grace': 90, 'ms bind msgr2': False, 'ms inject socket failures': 1000, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug monc': 10, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', '\\(MON_DOWN\\)'], 'mon_bind_msgr2': False, 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri6-testing-2026-02-22-1629-squid', 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579'}}, 'owner': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'priority': 69, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0']], 'seed': 5907, 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-yuri6-testing-2026-02-22-1629-squid', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579', 'targets': {'trial023.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF9cwIMBgGTVhTooil7mC1Wy/WWVRYhV2ULNhPlx/gEwv92qhh/vDeLWk0GK0Kwe86pP6+nb+O4xPSo7rseKW3I='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'log-ignorelist': ['overall HEALTH_', '\\(AUTH_BAD_CAPS\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', '\\(MON_DOWN\\)'], 'pre-mgr-commands': ['sudo ceph config set mgr mgr_pool false --force'], 'conf': {'global': {'mon client directed command retry': 5, 'mon client hunt interval max multiple': 2, 'mon election default strategy': 3, 'mon mgr beacon grace': 90, 'ms bind msgr2': False, 'ms inject socket failures': 1000, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug monc': 10, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'flavor': 'default', 'fs': 'xfs', 'mon_bind_msgr2': False, 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579', 'cluster': 'ceph'}}, {'workunit': {'clients': {'all': ['mon/test_config_key_caps.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'fa17720d0088c3ac28e473468bfc79eeaff5cd38', 'timestamp': '2026-02-22_19:35:40', 'tube': 'trial', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3318653'} 2026-02-22T21:34:04.415 DEBUG:teuthology.orchestra.run.trial023:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-22T21:34:04.452 DEBUG:teuthology.orchestra.run.trial023:> sudo install -d -m0777 -- /var/run/ceph 2026-02-22T21:34:04.499 DEBUG:teuthology.orchestra.run.trial023:> set -ex 2026-02-22T21:34:04.500 DEBUG:teuthology.orchestra.run.trial023:> dd if=/scratch_devs of=/dev/stdout 2026-02-22T21:34:04.543 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-22T21:34:04.544 DEBUG:teuthology.orchestra.run.trial023:> stat /dev/vg_nvme/lv_1 2026-02-22T21:34:04.588 INFO:teuthology.orchestra.run.trial023.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-22T21:34:04.589 INFO:teuthology.orchestra.run.trial023.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T21:34:04.589 INFO:teuthology.orchestra.run.trial023.stdout:Device: 5h/5d Inode: 911 Links: 1 2026-02-22T21:34:04.589 INFO:teuthology.orchestra.run.trial023.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T21:34:04.589 INFO:teuthology.orchestra.run.trial023.stdout:Access: 2026-02-22 21:33:21.083125951 +0000 2026-02-22T21:34:04.589 INFO:teuthology.orchestra.run.trial023.stdout:Modify: 2026-02-22 21:33:20.923128677 +0000 2026-02-22T21:34:04.589 INFO:teuthology.orchestra.run.trial023.stdout:Change: 2026-02-22 21:33:20.923128677 +0000 2026-02-22T21:34:04.589 INFO:teuthology.orchestra.run.trial023.stdout: Birth: - 2026-02-22T21:34:04.589 DEBUG:teuthology.orchestra.run.trial023:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-22T21:34:04.639 INFO:teuthology.orchestra.run.trial023.stderr:1+0 records in 2026-02-22T21:34:04.640 INFO:teuthology.orchestra.run.trial023.stderr:1+0 records out 2026-02-22T21:34:04.640 INFO:teuthology.orchestra.run.trial023.stderr:512 bytes copied, 0.00018375 s, 2.8 MB/s 2026-02-22T21:34:04.641 DEBUG:teuthology.orchestra.run.trial023:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-22T21:34:04.689 DEBUG:teuthology.orchestra.run.trial023:> stat /dev/vg_nvme/lv_2 2026-02-22T21:34:04.735 INFO:teuthology.orchestra.run.trial023.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-22T21:34:04.735 INFO:teuthology.orchestra.run.trial023.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T21:34:04.735 INFO:teuthology.orchestra.run.trial023.stdout:Device: 5h/5d Inode: 925 Links: 1 2026-02-22T21:34:04.735 INFO:teuthology.orchestra.run.trial023.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T21:34:04.735 INFO:teuthology.orchestra.run.trial023.stdout:Access: 2026-02-22 21:33:21.439119885 +0000 2026-02-22T21:34:04.735 INFO:teuthology.orchestra.run.trial023.stdout:Modify: 2026-02-22 21:33:21.259122952 +0000 2026-02-22T21:34:04.735 INFO:teuthology.orchestra.run.trial023.stdout:Change: 2026-02-22 21:33:21.259122952 +0000 2026-02-22T21:34:04.735 INFO:teuthology.orchestra.run.trial023.stdout: Birth: - 2026-02-22T21:34:04.735 DEBUG:teuthology.orchestra.run.trial023:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-22T21:34:04.783 INFO:teuthology.orchestra.run.trial023.stderr:1+0 records in 2026-02-22T21:34:04.783 INFO:teuthology.orchestra.run.trial023.stderr:1+0 records out 2026-02-22T21:34:04.783 INFO:teuthology.orchestra.run.trial023.stderr:512 bytes copied, 0.000176097 s, 2.9 MB/s 2026-02-22T21:34:04.783 DEBUG:teuthology.orchestra.run.trial023:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-22T21:34:04.829 DEBUG:teuthology.orchestra.run.trial023:> stat /dev/vg_nvme/lv_3 2026-02-22T21:34:04.875 INFO:teuthology.orchestra.run.trial023.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-22T21:34:04.875 INFO:teuthology.orchestra.run.trial023.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T21:34:04.875 INFO:teuthology.orchestra.run.trial023.stdout:Device: 5h/5d Inode: 948 Links: 1 2026-02-22T21:34:04.875 INFO:teuthology.orchestra.run.trial023.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T21:34:04.875 INFO:teuthology.orchestra.run.trial023.stdout:Access: 2026-02-22 21:33:21.763114365 +0000 2026-02-22T21:34:04.875 INFO:teuthology.orchestra.run.trial023.stdout:Modify: 2026-02-22 21:33:21.603117091 +0000 2026-02-22T21:34:04.875 INFO:teuthology.orchestra.run.trial023.stdout:Change: 2026-02-22 21:33:21.603117091 +0000 2026-02-22T21:34:04.875 INFO:teuthology.orchestra.run.trial023.stdout: Birth: - 2026-02-22T21:34:04.876 DEBUG:teuthology.orchestra.run.trial023:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-22T21:34:04.923 INFO:teuthology.orchestra.run.trial023.stderr:1+0 records in 2026-02-22T21:34:04.924 INFO:teuthology.orchestra.run.trial023.stderr:1+0 records out 2026-02-22T21:34:04.924 INFO:teuthology.orchestra.run.trial023.stderr:512 bytes copied, 0.000172009 s, 3.0 MB/s 2026-02-22T21:34:04.925 DEBUG:teuthology.orchestra.run.trial023:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-22T21:34:04.973 DEBUG:teuthology.orchestra.run.trial023:> stat /dev/vg_nvme/lv_4 2026-02-22T21:34:05.019 INFO:teuthology.orchestra.run.trial023.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-22T21:34:05.019 INFO:teuthology.orchestra.run.trial023.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T21:34:05.019 INFO:teuthology.orchestra.run.trial023.stdout:Device: 5h/5d Inode: 973 Links: 1 2026-02-22T21:34:05.019 INFO:teuthology.orchestra.run.trial023.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T21:34:05.019 INFO:teuthology.orchestra.run.trial023.stdout:Access: 2026-02-22 21:33:22.095108706 +0000 2026-02-22T21:34:05.019 INFO:teuthology.orchestra.run.trial023.stdout:Modify: 2026-02-22 21:33:21.919111705 +0000 2026-02-22T21:34:05.019 INFO:teuthology.orchestra.run.trial023.stdout:Change: 2026-02-22 21:33:21.919111705 +0000 2026-02-22T21:34:05.019 INFO:teuthology.orchestra.run.trial023.stdout: Birth: - 2026-02-22T21:34:05.019 DEBUG:teuthology.orchestra.run.trial023:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-22T21:34:05.066 INFO:teuthology.orchestra.run.trial023.stderr:1+0 records in 2026-02-22T21:34:05.067 INFO:teuthology.orchestra.run.trial023.stderr:1+0 records out 2026-02-22T21:34:05.067 INFO:teuthology.orchestra.run.trial023.stderr:512 bytes copied, 0.000165898 s, 3.1 MB/s 2026-02-22T21:34:05.067 DEBUG:teuthology.orchestra.run.trial023:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-22T21:34:05.112 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-22T21:34:05.113 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial023.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2026-02-22T21:34:05.113 INFO:tasks.ceph:Generating config... 2026-02-22T21:34:05.113 INFO:tasks.ceph:[global] mon client directed command retry = 5 2026-02-22T21:34:05.113 INFO:tasks.ceph:[global] mon client hunt interval max multiple = 2 2026-02-22T21:34:05.114 INFO:tasks.ceph:[global] mon election default strategy = 3 2026-02-22T21:34:05.114 INFO:tasks.ceph:[global] mon mgr beacon grace = 90 2026-02-22T21:34:05.114 INFO:tasks.ceph:[global] ms bind msgr2 = False 2026-02-22T21:34:05.114 INFO:tasks.ceph:[global] ms inject socket failures = 1000 2026-02-22T21:34:05.114 INFO:tasks.ceph:[global] ms type = async 2026-02-22T21:34:05.114 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-22T21:34:05.114 INFO:tasks.ceph:[mgr] debug monc = 10 2026-02-22T21:34:05.114 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-22T21:34:05.114 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-22T21:34:05.114 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-22T21:34:05.114 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-22T21:34:05.114 INFO:tasks.ceph:[mon] mon scrub interval = 300 2026-02-22T21:34:05.114 INFO:tasks.ceph:[osd] bdev async discard = True 2026-02-22T21:34:05.114 INFO:tasks.ceph:[osd] bdev enable discard = True 2026-02-22T21:34:05.114 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2026-02-22T21:34:05.114 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2026-02-22T21:34:05.114 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2026-02-22T21:34:05.114 INFO:tasks.ceph:[osd] debug bluefs = 20 2026-02-22T21:34:05.114 INFO:tasks.ceph:[osd] debug bluestore = 20 2026-02-22T21:34:05.114 INFO:tasks.ceph:[osd] debug ms = 1 2026-02-22T21:34:05.114 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-22T21:34:05.114 INFO:tasks.ceph:[osd] debug rocksdb = 10 2026-02-22T21:34:05.114 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2026-02-22T21:34:05.114 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2026-02-22T21:34:05.114 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2026-02-22T21:34:05.114 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2026-02-22T21:34:05.114 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2026-02-22T21:34:05.114 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2026-02-22T21:34:05.114 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2026-02-22T21:34:05.114 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2026-02-22T21:34:05.114 INFO:tasks.ceph:[osd] osd mclock skip benchmark = True 2026-02-22T21:34:05.114 INFO:tasks.ceph:[osd] osd memory target = 1610612736 2026-02-22T21:34:05.114 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2026-02-22T21:34:05.114 INFO:tasks.ceph:[osd] osd op queue = debug_random 2026-02-22T21:34:05.114 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2026-02-22T21:34:05.114 INFO:tasks.ceph:Setting up mon.a... 2026-02-22T21:34:05.114 DEBUG:teuthology.orchestra.run.trial023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-22T21:34:05.172 INFO:teuthology.orchestra.run.trial023.stdout:creating /etc/ceph/ceph.keyring 2026-02-22T21:34:05.175 DEBUG:teuthology.orchestra.run.trial023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-22T21:34:05.234 DEBUG:teuthology.orchestra.run.trial023:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-22T21:34:05.284 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '[v1:10.20.193.23:6789]')] 2026-02-22T21:34:05.285 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '[v1:10.20.193.23:6789]', 'mon client directed command retry': 5, 'mon client hunt interval max multiple': 2, 'mon election default strategy': 3, 'mon mgr beacon grace': 90, 'ms bind msgr2': False, 'ms inject socket failures': 1000, 'ms type': 'async'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug monc': 10}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon scrub interval': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}} 2026-02-22T21:34:05.286 DEBUG:teuthology.orchestra.run.trial023:> set -ex 2026-02-22T21:34:05.286 DEBUG:teuthology.orchestra.run.trial023:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-22T21:34:05.332 DEBUG:teuthology.orchestra.run.trial023:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --addv a '[v1:10.20.193.23:6789]' --print /home/ubuntu/cephtest/ceph.monmap 2026-02-22T21:34:05.388 INFO:teuthology.orchestra.run.trial023.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-22T21:34:05.388 INFO:teuthology.orchestra.run.trial023.stdout:monmaptool: generated fsid e2dd7ed3-13e8-4519-aab8-5d5a54f80255 2026-02-22T21:34:05.388 INFO:teuthology.orchestra.run.trial023.stdout:setting min_mon_release = quincy 2026-02-22T21:34:05.389 INFO:teuthology.orchestra.run.trial023.stdout:epoch 0 2026-02-22T21:34:05.389 INFO:teuthology.orchestra.run.trial023.stdout:fsid e2dd7ed3-13e8-4519-aab8-5d5a54f80255 2026-02-22T21:34:05.389 INFO:teuthology.orchestra.run.trial023.stdout:last_changed 2026-02-22T21:34:05.388399+0000 2026-02-22T21:34:05.389 INFO:teuthology.orchestra.run.trial023.stdout:created 2026-02-22T21:34:05.388399+0000 2026-02-22T21:34:05.389 INFO:teuthology.orchestra.run.trial023.stdout:min_mon_release 17 (quincy) 2026-02-22T21:34:05.389 INFO:teuthology.orchestra.run.trial023.stdout:election_strategy: 3 2026-02-22T21:34:05.389 INFO:teuthology.orchestra.run.trial023.stdout:0: v1:10.20.193.23:6789/0 mon.a 2026-02-22T21:34:05.389 INFO:teuthology.orchestra.run.trial023.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2026-02-22T21:34:05.390 DEBUG:teuthology.orchestra.run.trial023:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-22T21:34:05.435 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID e2dd7ed3-13e8-4519-aab8-5d5a54f80255... 2026-02-22T21:34:05.436 DEBUG:teuthology.orchestra.run.trial023:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-22T21:34:05.495 INFO:teuthology.orchestra.run.trial023.stdout:[global] 2026-02-22T21:34:05.495 INFO:teuthology.orchestra.run.trial023.stdout: chdir = "" 2026-02-22T21:34:05.495 INFO:teuthology.orchestra.run.trial023.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-22T21:34:05.495 INFO:teuthology.orchestra.run.trial023.stdout: auth supported = cephx 2026-02-22T21:34:05.495 INFO:teuthology.orchestra.run.trial023.stdout: 2026-02-22T21:34:05.495 INFO:teuthology.orchestra.run.trial023.stdout: filestore xattr use omap = true 2026-02-22T21:34:05.495 INFO:teuthology.orchestra.run.trial023.stdout: 2026-02-22T21:34:05.495 INFO:teuthology.orchestra.run.trial023.stdout: mon clock drift allowed = 1.000 2026-02-22T21:34:05.495 INFO:teuthology.orchestra.run.trial023.stdout: 2026-02-22T21:34:05.496 INFO:teuthology.orchestra.run.trial023.stdout: osd crush chooseleaf type = 0 2026-02-22T21:34:05.496 INFO:teuthology.orchestra.run.trial023.stdout: auth debug = true 2026-02-22T21:34:05.496 INFO:teuthology.orchestra.run.trial023.stdout: 2026-02-22T21:34:05.496 INFO:teuthology.orchestra.run.trial023.stdout: ms die on old message = true 2026-02-22T21:34:05.496 INFO:teuthology.orchestra.run.trial023.stdout: ms die on bug = true 2026-02-22T21:34:05.496 INFO:teuthology.orchestra.run.trial023.stdout: 2026-02-22T21:34:05.496 INFO:teuthology.orchestra.run.trial023.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-22T21:34:05.496 INFO:teuthology.orchestra.run.trial023.stdout: mon pg warn max object skew = 0 2026-02-22T21:34:05.496 INFO:teuthology.orchestra.run.trial023.stdout: 2026-02-22T21:34:05.496 INFO:teuthology.orchestra.run.trial023.stdout: # disable pg_autoscaler by default for new pools 2026-02-22T21:34:05.496 INFO:teuthology.orchestra.run.trial023.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-22T21:34:05.496 INFO:teuthology.orchestra.run.trial023.stdout: 2026-02-22T21:34:05.496 INFO:teuthology.orchestra.run.trial023.stdout: osd pool default size = 2 2026-02-22T21:34:05.496 INFO:teuthology.orchestra.run.trial023.stdout: 2026-02-22T21:34:05.496 INFO:teuthology.orchestra.run.trial023.stdout: mon osd allow primary affinity = true 2026-02-22T21:34:05.496 INFO:teuthology.orchestra.run.trial023.stdout: mon osd allow pg remap = true 2026-02-22T21:34:05.496 INFO:teuthology.orchestra.run.trial023.stdout: mon warn on legacy crush tunables = false 2026-02-22T21:34:05.496 INFO:teuthology.orchestra.run.trial023.stdout: mon warn on crush straw calc version zero = false 2026-02-22T21:34:05.496 INFO:teuthology.orchestra.run.trial023.stdout: mon warn on no sortbitwise = false 2026-02-22T21:34:05.496 INFO:teuthology.orchestra.run.trial023.stdout: mon warn on osd down out interval zero = false 2026-02-22T21:34:05.496 INFO:teuthology.orchestra.run.trial023.stdout: mon warn on too few osds = false 2026-02-22T21:34:05.496 INFO:teuthology.orchestra.run.trial023.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-22T21:34:05.496 INFO:teuthology.orchestra.run.trial023.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-22T21:34:05.496 INFO:teuthology.orchestra.run.trial023.stdout: mon_allow_pool_size_one = true 2026-02-22T21:34:05.496 INFO:teuthology.orchestra.run.trial023.stdout: 2026-02-22T21:34:05.496 INFO:teuthology.orchestra.run.trial023.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-22T21:34:05.496 INFO:teuthology.orchestra.run.trial023.stdout: 2026-02-22T21:34:05.496 INFO:teuthology.orchestra.run.trial023.stdout: osd default data pool replay window = 5 2026-02-22T21:34:05.496 INFO:teuthology.orchestra.run.trial023.stdout: 2026-02-22T21:34:05.496 INFO:teuthology.orchestra.run.trial023.stdout: mon allow pool delete = true 2026-02-22T21:34:05.496 INFO:teuthology.orchestra.run.trial023.stdout: 2026-02-22T21:34:05.496 INFO:teuthology.orchestra.run.trial023.stdout: mon cluster log file level = debug 2026-02-22T21:34:05.496 INFO:teuthology.orchestra.run.trial023.stdout: debug asserts on shutdown = true 2026-02-22T21:34:05.496 INFO:teuthology.orchestra.run.trial023.stdout: mon health detail to clog = false 2026-02-22T21:34:05.496 INFO:teuthology.orchestra.run.trial023.stdout: mon host = [v1:10.20.193.23:6789] 2026-02-22T21:34:05.496 INFO:teuthology.orchestra.run.trial023.stdout: mon client directed command retry = 5 2026-02-22T21:34:05.496 INFO:teuthology.orchestra.run.trial023.stdout: mon client hunt interval max multiple = 2 2026-02-22T21:34:05.496 INFO:teuthology.orchestra.run.trial023.stdout: mon election default strategy = 3 2026-02-22T21:34:05.496 INFO:teuthology.orchestra.run.trial023.stdout: mon mgr beacon grace = 90 2026-02-22T21:34:05.496 INFO:teuthology.orchestra.run.trial023.stdout: ms bind msgr2 = False 2026-02-22T21:34:05.496 INFO:teuthology.orchestra.run.trial023.stdout: ms inject socket failures = 1000 2026-02-22T21:34:05.496 INFO:teuthology.orchestra.run.trial023.stdout: ms type = async 2026-02-22T21:34:05.496 INFO:teuthology.orchestra.run.trial023.stdout: fsid = e2dd7ed3-13e8-4519-aab8-5d5a54f80255 2026-02-22T21:34:05.497 INFO:teuthology.orchestra.run.trial023.stdout: 2026-02-22T21:34:05.497 INFO:teuthology.orchestra.run.trial023.stdout:[osd] 2026-02-22T21:34:05.497 INFO:teuthology.orchestra.run.trial023.stdout: osd journal size = 100 2026-02-22T21:34:05.497 INFO:teuthology.orchestra.run.trial023.stdout: 2026-02-22T21:34:05.497 INFO:teuthology.orchestra.run.trial023.stdout: osd scrub load threshold = 5.0 2026-02-22T21:34:05.497 INFO:teuthology.orchestra.run.trial023.stdout: osd scrub max interval = 600 2026-02-22T21:34:05.497 INFO:teuthology.orchestra.run.trial023.stdout: osd mclock profile = high_recovery_ops 2026-02-22T21:34:05.497 INFO:teuthology.orchestra.run.trial023.stdout: osd mclock skip benchmark = True 2026-02-22T21:34:05.497 INFO:teuthology.orchestra.run.trial023.stdout: 2026-02-22T21:34:05.497 INFO:teuthology.orchestra.run.trial023.stdout: osd recover clone overlap = true 2026-02-22T21:34:05.497 INFO:teuthology.orchestra.run.trial023.stdout: osd recovery max chunk = 1048576 2026-02-22T21:34:05.497 INFO:teuthology.orchestra.run.trial023.stdout: 2026-02-22T21:34:05.497 INFO:teuthology.orchestra.run.trial023.stdout: osd debug shutdown = true 2026-02-22T21:34:05.497 INFO:teuthology.orchestra.run.trial023.stdout: osd debug op order = true 2026-02-22T21:34:05.497 INFO:teuthology.orchestra.run.trial023.stdout: osd debug verify stray on activate = true 2026-02-22T21:34:05.497 INFO:teuthology.orchestra.run.trial023.stdout: osd debug trim objects = true 2026-02-22T21:34:05.497 INFO:teuthology.orchestra.run.trial023.stdout: 2026-02-22T21:34:05.497 INFO:teuthology.orchestra.run.trial023.stdout: osd open classes on start = true 2026-02-22T21:34:05.497 INFO:teuthology.orchestra.run.trial023.stdout: osd debug pg log writeout = true 2026-02-22T21:34:05.497 INFO:teuthology.orchestra.run.trial023.stdout: 2026-02-22T21:34:05.497 INFO:teuthology.orchestra.run.trial023.stdout: osd deep scrub update digest min age = 30 2026-02-22T21:34:05.497 INFO:teuthology.orchestra.run.trial023.stdout: 2026-02-22T21:34:05.497 INFO:teuthology.orchestra.run.trial023.stdout: osd map max advance = 10 2026-02-22T21:34:05.497 INFO:teuthology.orchestra.run.trial023.stdout: 2026-02-22T21:34:05.497 INFO:teuthology.orchestra.run.trial023.stdout: journal zero on create = true 2026-02-22T21:34:05.497 INFO:teuthology.orchestra.run.trial023.stdout: 2026-02-22T21:34:05.497 INFO:teuthology.orchestra.run.trial023.stdout: filestore ondisk finisher threads = 3 2026-02-22T21:34:05.497 INFO:teuthology.orchestra.run.trial023.stdout: filestore apply finisher threads = 3 2026-02-22T21:34:05.497 INFO:teuthology.orchestra.run.trial023.stdout: 2026-02-22T21:34:05.497 INFO:teuthology.orchestra.run.trial023.stdout: bdev debug aio = true 2026-02-22T21:34:05.497 INFO:teuthology.orchestra.run.trial023.stdout: osd debug misdirected ops = true 2026-02-22T21:34:05.497 INFO:teuthology.orchestra.run.trial023.stdout: bdev async discard = True 2026-02-22T21:34:05.497 INFO:teuthology.orchestra.run.trial023.stdout: bdev enable discard = True 2026-02-22T21:34:05.497 INFO:teuthology.orchestra.run.trial023.stdout: bluestore block size = 96636764160 2026-02-22T21:34:05.497 INFO:teuthology.orchestra.run.trial023.stdout: bluestore fsck on mount = True 2026-02-22T21:34:05.497 INFO:teuthology.orchestra.run.trial023.stdout: bluestore zero block detection = True 2026-02-22T21:34:05.497 INFO:teuthology.orchestra.run.trial023.stdout: debug bluefs = 20 2026-02-22T21:34:05.497 INFO:teuthology.orchestra.run.trial023.stdout: debug bluestore = 20 2026-02-22T21:34:05.497 INFO:teuthology.orchestra.run.trial023.stdout: debug ms = 1 2026-02-22T21:34:05.497 INFO:teuthology.orchestra.run.trial023.stdout: debug osd = 20 2026-02-22T21:34:05.497 INFO:teuthology.orchestra.run.trial023.stdout: debug rocksdb = 10 2026-02-22T21:34:05.497 INFO:teuthology.orchestra.run.trial023.stdout: mon osd backfillfull_ratio = 0.85 2026-02-22T21:34:05.497 INFO:teuthology.orchestra.run.trial023.stdout: mon osd full ratio = 0.9 2026-02-22T21:34:05.497 INFO:teuthology.orchestra.run.trial023.stdout: mon osd nearfull ratio = 0.8 2026-02-22T21:34:05.497 INFO:teuthology.orchestra.run.trial023.stdout: osd debug verify cached snaps = True 2026-02-22T21:34:05.498 INFO:teuthology.orchestra.run.trial023.stdout: osd debug verify missing on start = True 2026-02-22T21:34:05.498 INFO:teuthology.orchestra.run.trial023.stdout: osd failsafe full ratio = 0.95 2026-02-22T21:34:05.498 INFO:teuthology.orchestra.run.trial023.stdout: osd mclock override recovery settings = True 2026-02-22T21:34:05.498 INFO:teuthology.orchestra.run.trial023.stdout: osd memory target = 1610612736 2026-02-22T21:34:05.498 INFO:teuthology.orchestra.run.trial023.stdout: osd objectstore = bluestore 2026-02-22T21:34:05.498 INFO:teuthology.orchestra.run.trial023.stdout: osd op queue = debug_random 2026-02-22T21:34:05.498 INFO:teuthology.orchestra.run.trial023.stdout: osd op queue cut off = debug_random 2026-02-22T21:34:05.498 INFO:teuthology.orchestra.run.trial023.stdout: 2026-02-22T21:34:05.498 INFO:teuthology.orchestra.run.trial023.stdout:[mgr] 2026-02-22T21:34:05.498 INFO:teuthology.orchestra.run.trial023.stdout: debug ms = 1 2026-02-22T21:34:05.498 INFO:teuthology.orchestra.run.trial023.stdout: debug mgr = 20 2026-02-22T21:34:05.498 INFO:teuthology.orchestra.run.trial023.stdout: debug mon = 20 2026-02-22T21:34:05.498 INFO:teuthology.orchestra.run.trial023.stdout: debug auth = 20 2026-02-22T21:34:05.498 INFO:teuthology.orchestra.run.trial023.stdout: mon reweight min pgs per osd = 4 2026-02-22T21:34:05.498 INFO:teuthology.orchestra.run.trial023.stdout: mon reweight min bytes per osd = 10 2026-02-22T21:34:05.498 INFO:teuthology.orchestra.run.trial023.stdout: mgr/telemetry/nag = false 2026-02-22T21:34:05.498 INFO:teuthology.orchestra.run.trial023.stdout: debug monc = 10 2026-02-22T21:34:05.498 INFO:teuthology.orchestra.run.trial023.stdout: 2026-02-22T21:34:05.498 INFO:teuthology.orchestra.run.trial023.stdout:[mon] 2026-02-22T21:34:05.498 INFO:teuthology.orchestra.run.trial023.stdout: debug ms = 1 2026-02-22T21:34:05.498 INFO:teuthology.orchestra.run.trial023.stdout: debug mon = 20 2026-02-22T21:34:05.498 INFO:teuthology.orchestra.run.trial023.stdout: debug paxos = 20 2026-02-22T21:34:05.498 INFO:teuthology.orchestra.run.trial023.stdout: debug auth = 20 2026-02-22T21:34:05.498 INFO:teuthology.orchestra.run.trial023.stdout: mon data avail warn = 5 2026-02-22T21:34:05.498 INFO:teuthology.orchestra.run.trial023.stdout: mon mgr mkfs grace = 240 2026-02-22T21:34:05.498 INFO:teuthology.orchestra.run.trial023.stdout: mon reweight min pgs per osd = 4 2026-02-22T21:34:05.498 INFO:teuthology.orchestra.run.trial023.stdout: mon osd reporter subtree level = osd 2026-02-22T21:34:05.498 INFO:teuthology.orchestra.run.trial023.stdout: mon osd prime pg temp = true 2026-02-22T21:34:05.498 INFO:teuthology.orchestra.run.trial023.stdout: mon reweight min bytes per osd = 10 2026-02-22T21:34:05.498 INFO:teuthology.orchestra.run.trial023.stdout: 2026-02-22T21:34:05.498 INFO:teuthology.orchestra.run.trial023.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-22T21:34:05.498 INFO:teuthology.orchestra.run.trial023.stdout: auth mon ticket ttl = 660 # 11m 2026-02-22T21:34:05.498 INFO:teuthology.orchestra.run.trial023.stdout: auth service ticket ttl = 240 # 4m 2026-02-22T21:34:05.498 INFO:teuthology.orchestra.run.trial023.stdout: 2026-02-22T21:34:05.498 INFO:teuthology.orchestra.run.trial023.stdout: # don't complain about insecure global_id in the test suite 2026-02-22T21:34:05.498 INFO:teuthology.orchestra.run.trial023.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-22T21:34:05.498 INFO:teuthology.orchestra.run.trial023.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-22T21:34:05.498 INFO:teuthology.orchestra.run.trial023.stdout: 2026-02-22T21:34:05.498 INFO:teuthology.orchestra.run.trial023.stdout: # 1m isn't quite enough 2026-02-22T21:34:05.498 INFO:teuthology.orchestra.run.trial023.stdout: mon_down_mkfs_grace = 2m 2026-02-22T21:34:05.498 INFO:teuthology.orchestra.run.trial023.stdout: 2026-02-22T21:34:05.498 INFO:teuthology.orchestra.run.trial023.stdout: mon_warn_on_filestore_osds = false 2026-02-22T21:34:05.498 INFO:teuthology.orchestra.run.trial023.stdout: mon scrub interval = 300 2026-02-22T21:34:05.498 INFO:teuthology.orchestra.run.trial023.stdout: 2026-02-22T21:34:05.498 INFO:teuthology.orchestra.run.trial023.stdout:[client] 2026-02-22T21:34:05.498 INFO:teuthology.orchestra.run.trial023.stdout: rgw cache enabled = true 2026-02-22T21:34:05.499 INFO:teuthology.orchestra.run.trial023.stdout: rgw enable ops log = true 2026-02-22T21:34:05.499 INFO:teuthology.orchestra.run.trial023.stdout: rgw enable usage log = true 2026-02-22T21:34:05.499 INFO:teuthology.orchestra.run.trial023.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-22T21:34:05.499 INFO:teuthology.orchestra.run.trial023.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-22T21:34:05.499 INFO:teuthology.orchestra.run.trial023.stdout:[mon.a] 2026-02-22T21:34:05.503 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-22T21:34:05.503 DEBUG:teuthology.orchestra.run.trial023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-22T21:34:05.567 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-22T21:34:05.567 DEBUG:teuthology.orchestra.run.trial023:> set -ex 2026-02-22T21:34:05.567 DEBUG:teuthology.orchestra.run.trial023:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-22T21:34:05.612 DEBUG:teuthology.orchestra.run.trial023:> set -ex 2026-02-22T21:34:05.612 DEBUG:teuthology.orchestra.run.trial023:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-22T21:34:05.656 INFO:tasks.ceph:Sending monmap to node ubuntu@trial023.front.sepia.ceph.com 2026-02-22T21:34:05.656 DEBUG:teuthology.orchestra.run.trial023:> set -ex 2026-02-22T21:34:05.656 DEBUG:teuthology.orchestra.run.trial023:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-22T21:34:05.656 DEBUG:teuthology.orchestra.run.trial023:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-22T21:34:05.713 DEBUG:teuthology.orchestra.run.trial023:> set -ex 2026-02-22T21:34:05.713 DEBUG:teuthology.orchestra.run.trial023:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-22T21:34:05.765 INFO:tasks.ceph:Setting up mon nodes... 2026-02-22T21:34:05.766 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-22T21:34:05.766 DEBUG:teuthology.orchestra.run.trial023:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-22T21:34:05.830 INFO:teuthology.orchestra.run.trial023.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-22T21:34:05.832 INFO:tasks.ceph:Setting up mds nodes... 2026-02-22T21:34:05.833 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-22T21:34:05.833 DEBUG:teuthology.orchestra.run.trial023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-22T21:34:05.893 INFO:teuthology.orchestra.run.trial023.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-22T21:34:05.900 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-22T21:34:05.901 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial023.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2026-02-22T21:34:05.901 DEBUG:teuthology.orchestra.run.trial023:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-22T21:34:05.951 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-22T21:34:05.952 INFO:tasks.ceph:role: osd.0 2026-02-22T21:34:05.952 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial023.front.sepia.ceph.com 2026-02-22T21:34:05.952 DEBUG:teuthology.orchestra.run.trial023:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-22T21:34:06.001 INFO:teuthology.orchestra.run.trial023.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-22T21:34:06.001 INFO:teuthology.orchestra.run.trial023.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-22T21:34:06.001 INFO:teuthology.orchestra.run.trial023.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-22T21:34:06.001 INFO:teuthology.orchestra.run.trial023.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-22T21:34:06.001 INFO:teuthology.orchestra.run.trial023.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-22T21:34:06.001 INFO:teuthology.orchestra.run.trial023.stdout: = sunit=0 swidth=0 blks 2026-02-22T21:34:06.001 INFO:teuthology.orchestra.run.trial023.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-22T21:34:06.001 INFO:teuthology.orchestra.run.trial023.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-22T21:34:06.001 INFO:teuthology.orchestra.run.trial023.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-22T21:34:06.001 INFO:teuthology.orchestra.run.trial023.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-22T21:34:06.577 INFO:teuthology.orchestra.run.trial023.stdout:Discarding blocks...Done. 2026-02-22T21:34:06.578 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial023.front.sepia.ceph.com -o noatime 2026-02-22T21:34:06.579 DEBUG:teuthology.orchestra.run.trial023:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-22T21:34:06.632 DEBUG:teuthology.orchestra.run.trial023:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-22T21:34:06.678 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T21:34:06.679 INFO:teuthology.orchestra.run.trial023.stderr:sudo: /sbin/restorecon: command not found 2026-02-22T21:34:06.679 DEBUG:teuthology.orchestra.run.trial023:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-22T21:34:06.729 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-22T21:34:06.729 INFO:tasks.ceph:role: osd.1 2026-02-22T21:34:06.730 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial023.front.sepia.ceph.com 2026-02-22T21:34:06.730 DEBUG:teuthology.orchestra.run.trial023:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-22T21:34:06.782 INFO:teuthology.orchestra.run.trial023.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-22T21:34:06.782 INFO:teuthology.orchestra.run.trial023.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-22T21:34:06.782 INFO:teuthology.orchestra.run.trial023.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-22T21:34:06.782 INFO:teuthology.orchestra.run.trial023.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-22T21:34:06.782 INFO:teuthology.orchestra.run.trial023.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-22T21:34:06.782 INFO:teuthology.orchestra.run.trial023.stdout: = sunit=0 swidth=0 blks 2026-02-22T21:34:06.782 INFO:teuthology.orchestra.run.trial023.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-22T21:34:06.782 INFO:teuthology.orchestra.run.trial023.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-22T21:34:06.782 INFO:teuthology.orchestra.run.trial023.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-22T21:34:06.783 INFO:teuthology.orchestra.run.trial023.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-22T21:34:07.346 INFO:teuthology.orchestra.run.trial023.stdout:Discarding blocks...Done. 2026-02-22T21:34:07.347 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial023.front.sepia.ceph.com -o noatime 2026-02-22T21:34:07.347 DEBUG:teuthology.orchestra.run.trial023:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-22T21:34:07.405 DEBUG:teuthology.orchestra.run.trial023:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-22T21:34:07.454 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T21:34:07.454 INFO:teuthology.orchestra.run.trial023.stderr:sudo: /sbin/restorecon: command not found 2026-02-22T21:34:07.455 DEBUG:teuthology.orchestra.run.trial023:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-22T21:34:07.504 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-22T21:34:07.504 INFO:tasks.ceph:role: osd.2 2026-02-22T21:34:07.504 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial023.front.sepia.ceph.com 2026-02-22T21:34:07.504 DEBUG:teuthology.orchestra.run.trial023:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-22T21:34:07.558 INFO:teuthology.orchestra.run.trial023.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-22T21:34:07.558 INFO:teuthology.orchestra.run.trial023.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-22T21:34:07.558 INFO:teuthology.orchestra.run.trial023.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-22T21:34:07.558 INFO:teuthology.orchestra.run.trial023.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-22T21:34:07.558 INFO:teuthology.orchestra.run.trial023.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-22T21:34:07.559 INFO:teuthology.orchestra.run.trial023.stdout: = sunit=0 swidth=0 blks 2026-02-22T21:34:07.559 INFO:teuthology.orchestra.run.trial023.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-22T21:34:07.559 INFO:teuthology.orchestra.run.trial023.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-22T21:34:07.559 INFO:teuthology.orchestra.run.trial023.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-22T21:34:07.559 INFO:teuthology.orchestra.run.trial023.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-22T21:34:08.123 INFO:teuthology.orchestra.run.trial023.stdout:Discarding blocks...Done. 2026-02-22T21:34:08.125 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial023.front.sepia.ceph.com -o noatime 2026-02-22T21:34:08.125 DEBUG:teuthology.orchestra.run.trial023:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2026-02-22T21:34:08.180 DEBUG:teuthology.orchestra.run.trial023:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-22T21:34:08.229 INFO:teuthology.orchestra.run.trial023.stderr:sudo: /sbin/restorecon: command not found 2026-02-22T21:34:08.229 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T21:34:08.230 DEBUG:teuthology.orchestra.run.trial023:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-22T21:34:08.294 INFO:teuthology.orchestra.run.trial023.stderr:2026-02-22T21:34:08.289+0000 7fd731fe08c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2026-02-22T21:34:08.294 INFO:teuthology.orchestra.run.trial023.stderr:2026-02-22T21:34:08.289+0000 7fd731fe08c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2026-02-22T21:34:08.294 INFO:teuthology.orchestra.run.trial023.stderr:2026-02-22T21:34:08.289+0000 7fd731fe08c0 -1 bdev(0x560b6aadb800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2026-02-22T21:34:08.294 INFO:teuthology.orchestra.run.trial023.stderr:2026-02-22T21:34:08.289+0000 7fd731fe08c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2026-02-22T21:34:12.375 DEBUG:teuthology.orchestra.run.trial023:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-22T21:34:12.425 DEBUG:teuthology.orchestra.run.trial023:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-22T21:34:12.489 INFO:teuthology.orchestra.run.trial023.stderr:2026-02-22T21:34:12.485+0000 7fba1b5078c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2026-02-22T21:34:12.490 INFO:teuthology.orchestra.run.trial023.stderr:2026-02-22T21:34:12.485+0000 7fba1b5078c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2026-02-22T21:34:12.490 INFO:teuthology.orchestra.run.trial023.stderr:2026-02-22T21:34:12.485+0000 7fba1b5078c0 -1 bdev(0x55ca534a5800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2026-02-22T21:34:12.490 INFO:teuthology.orchestra.run.trial023.stderr:2026-02-22T21:34:12.485+0000 7fba1b5078c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2026-02-22T21:34:16.572 DEBUG:teuthology.orchestra.run.trial023:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-22T21:34:16.620 DEBUG:teuthology.orchestra.run.trial023:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-22T21:34:16.685 INFO:teuthology.orchestra.run.trial023.stderr:2026-02-22T21:34:16.681+0000 7f5b32b4c8c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2026-02-22T21:34:16.686 INFO:teuthology.orchestra.run.trial023.stderr:2026-02-22T21:34:16.681+0000 7f5b32b4c8c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2026-02-22T21:34:16.686 INFO:teuthology.orchestra.run.trial023.stderr:2026-02-22T21:34:16.681+0000 7f5b32b4c8c0 -1 bdev(0x55eb67b75800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2026-02-22T21:34:16.686 INFO:teuthology.orchestra.run.trial023.stderr:2026-02-22T21:34:16.681+0000 7f5b32b4c8c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2026-02-22T21:34:20.763 DEBUG:teuthology.orchestra.run.trial023:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-22T21:34:20.812 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-22T21:34:20.813 DEBUG:teuthology.orchestra.run.trial023:> set -ex 2026-02-22T21:34:20.813 DEBUG:teuthology.orchestra.run.trial023:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-22T21:34:20.865 DEBUG:teuthology.orchestra.run.trial023:> set -ex 2026-02-22T21:34:20.865 DEBUG:teuthology.orchestra.run.trial023:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-22T21:34:20.917 DEBUG:teuthology.orchestra.run.trial023:> set -ex 2026-02-22T21:34:20.917 DEBUG:teuthology.orchestra.run.trial023:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-22T21:34:20.968 DEBUG:teuthology.orchestra.run.trial023:> set -ex 2026-02-22T21:34:20.969 DEBUG:teuthology.orchestra.run.trial023:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-22T21:34:21.021 DEBUG:teuthology.orchestra.run.trial023:> set -ex 2026-02-22T21:34:21.021 DEBUG:teuthology.orchestra.run.trial023:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-22T21:34:21.068 INFO:tasks.ceph:Adding keys to all mons... 2026-02-22T21:34:21.068 DEBUG:teuthology.orchestra.run.trial023:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-22T21:34:21.119 INFO:teuthology.orchestra.run.trial023.stdout:[mgr.x] 2026-02-22T21:34:21.119 INFO:teuthology.orchestra.run.trial023.stdout: key = AQBNdptpkpx8MRAAcFq4YnpklY77s9kI5CAhBg== 2026-02-22T21:34:21.119 INFO:teuthology.orchestra.run.trial023.stdout:[osd.0] 2026-02-22T21:34:21.119 INFO:teuthology.orchestra.run.trial023.stdout: key = AQBQdptpBsKEERAAJtnJ2m0oco39vOXSaFA0hQ== 2026-02-22T21:34:21.119 INFO:teuthology.orchestra.run.trial023.stdout:[osd.1] 2026-02-22T21:34:21.119 INFO:teuthology.orchestra.run.trial023.stdout: key = AQBUdptpNpkrHRAAjdq3q5Af4pl+cufkRrMWMg== 2026-02-22T21:34:21.119 INFO:teuthology.orchestra.run.trial023.stdout:[osd.2] 2026-02-22T21:34:21.119 INFO:teuthology.orchestra.run.trial023.stdout: key = AQBYdptpWCTUKBAATfJEndq1xukdWBiCEYUwfg== 2026-02-22T21:34:21.119 INFO:teuthology.orchestra.run.trial023.stdout:[client.0] 2026-02-22T21:34:21.119 INFO:teuthology.orchestra.run.trial023.stdout: key = AQBNdptpXro6NRAA45MNjC91Zu0dX2maYRrMeQ== 2026-02-22T21:34:21.120 DEBUG:teuthology.orchestra.run.trial023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-22T21:34:21.181 DEBUG:teuthology.orchestra.run.trial023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T21:34:21.244 DEBUG:teuthology.orchestra.run.trial023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T21:34:21.309 DEBUG:teuthology.orchestra.run.trial023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T21:34:21.379 DEBUG:teuthology.orchestra.run.trial023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-22T21:34:21.448 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-22T21:34:21.448 DEBUG:teuthology.orchestra.run.trial023:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-22T21:34:21.500 DEBUG:teuthology.orchestra.run.trial023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-22T21:34:21.569 DEBUG:teuthology.orchestra.run.trial023:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-22T21:34:21.624 DEBUG:teuthology.orchestra.run.trial023:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-22T21:34:21.667 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-22T21:34:21.668 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-22T21:34:21.668 DEBUG:teuthology.orchestra.run.trial023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-22T21:34:21.709 INFO:tasks.ceph.mon.a:Started 2026-02-22T21:34:21.709 DEBUG:teuthology.orchestra.run.trial023:> sudo ceph config set mgr mgr_pool false --force 2026-02-22T21:34:21.832 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-22T21:34:21.832 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-22T21:34:21.832 DEBUG:teuthology.orchestra.run.trial023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-22T21:34:21.833 INFO:tasks.ceph.mgr.x:Started 2026-02-22T21:34:21.834 INFO:tasks.ceph:Setting crush tunables to default 2026-02-22T21:34:21.834 DEBUG:teuthology.orchestra.run.trial023:> sudo ceph --cluster ceph osd crush tunables default 2026-02-22T21:34:21.935 INFO:teuthology.orchestra.run.trial023.stderr:adjusted tunables profile to default 2026-02-22T21:34:21.939 INFO:tasks.ceph.mgr.x.trial023.stderr:2026-02-22T21:34:21.933+0000 7f5f8ec6d280 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-22T21:34:21.944 INFO:tasks.ceph:check_enable_crimson: False 2026-02-22T21:34:21.944 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-22T21:34:21.944 DEBUG:teuthology.orchestra.run.trial023:> set -ex 2026-02-22T21:34:21.944 DEBUG:teuthology.orchestra.run.trial023:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-22T21:34:21.952 DEBUG:teuthology.orchestra.run.trial023:> set -ex 2026-02-22T21:34:21.952 DEBUG:teuthology.orchestra.run.trial023:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-22T21:34:21.965 INFO:tasks.ceph.mgr.x.trial023.stderr:2026-02-22T21:34:21.961+0000 7f5f8ec6d280 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-22T21:34:21.972 DEBUG:teuthology.orchestra.run.trial023:> set -ex 2026-02-22T21:34:21.972 DEBUG:teuthology.orchestra.run.trial023:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-22T21:34:22.003 INFO:tasks.ceph.mgr.x.trial023.stderr:2026-02-22T21:34:21.997+0000 7f5f8ec6d280 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-22T21:34:22.010 DEBUG:teuthology.orchestra.run.trial023:> sudo ceph --cluster ceph osd new 870c022b-b636-466f-8421-e3830c92377c 0 2026-02-22T21:34:22.089 INFO:tasks.ceph.mgr.x.trial023.stderr:2026-02-22T21:34:22.085+0000 7f5f8ec6d280 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-22T21:34:22.147 INFO:teuthology.orchestra.run.trial023.stdout:0 2026-02-22T21:34:22.156 DEBUG:teuthology.orchestra.run.trial023:> sudo ceph --cluster ceph osd new 6e16d5b5-ec7e-4144-8d71-68175ef54eae 1 2026-02-22T21:34:22.168 INFO:tasks.ceph.mgr.x.trial023.stderr:2026-02-22T21:34:22.165+0000 7f5f8ec6d280 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-22T21:34:22.206 INFO:tasks.ceph.mgr.x.trial023.stderr:2026-02-22T21:34:22.201+0000 7f5f8ec6d280 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-22T21:34:22.262 INFO:teuthology.orchestra.run.trial023.stdout:1 2026-02-22T21:34:22.271 DEBUG:teuthology.orchestra.run.trial023:> sudo ceph --cluster ceph osd new 46858b82-1822-4a04-a25d-97c7e96f97e1 2 2026-02-22T21:34:22.280 INFO:tasks.ceph.mgr.x.trial023.stderr:2026-02-22T21:34:22.273+0000 7f5f8ec6d280 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-22T21:34:22.374 INFO:teuthology.orchestra.run.trial023.stdout:2 2026-02-22T21:34:22.382 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-22T21:34:22.383 DEBUG:teuthology.orchestra.run.trial023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2026-02-22T21:34:22.384 INFO:tasks.ceph.osd.0:Started 2026-02-22T21:34:22.384 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-22T21:34:22.384 DEBUG:teuthology.orchestra.run.trial023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2026-02-22T21:34:22.385 INFO:tasks.ceph.osd.1:Started 2026-02-22T21:34:22.385 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-22T21:34:22.385 DEBUG:teuthology.orchestra.run.trial023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2026-02-22T21:34:22.386 INFO:tasks.ceph.osd.2:Started 2026-02-22T21:34:22.387 DEBUG:teuthology.orchestra.run.trial023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-22T21:34:22.454 INFO:tasks.ceph.mgr.x.trial023.stderr:2026-02-22T21:34:22.449+0000 7f5f8ec6d280 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-22T21:34:22.476 INFO:teuthology.orchestra.run.trial023.stdout: 2026-02-22T21:34:22.476 INFO:teuthology.orchestra.run.trial023.stdout:{"epoch":5,"fsid":"e2dd7ed3-13e8-4519-aab8-5d5a54f80255","created":"2026-02-22T21:34:21.785434+0000","modified":"2026-02-22T21:34:22.372890+0000","last_up_change":"0.000000","last_in_change":"2026-02-22T21:34:22.372890+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"870c022b-b636-466f-8421-e3830c92377c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6e16d5b5-ec7e-4144-8d71-68175ef54eae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"46858b82-1822-4a04-a25d-97c7e96f97e1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T21:34:22.486 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-22T21:34:22.486 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-22T21:34:22.762 INFO:tasks.ceph.mgr.x.trial023.stderr:2026-02-22T21:34:22.757+0000 7f5f8ec6d280 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-22T21:34:22.787 DEBUG:teuthology.orchestra.run.trial023:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-22T21:34:22.856 INFO:tasks.ceph.mgr.x.trial023.stderr:2026-02-22T21:34:22.849+0000 7f5f8ec6d280 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-22T21:34:22.873 INFO:teuthology.misc.health.trial023.stdout: 2026-02-22T21:34:22.873 INFO:teuthology.misc.health.trial023.stdout:{"epoch":5,"fsid":"e2dd7ed3-13e8-4519-aab8-5d5a54f80255","created":"2026-02-22T21:34:21.785434+0000","modified":"2026-02-22T21:34:22.372890+0000","last_up_change":"0.000000","last_in_change":"2026-02-22T21:34:22.372890+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"870c022b-b636-466f-8421-e3830c92377c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6e16d5b5-ec7e-4144-8d71-68175ef54eae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"46858b82-1822-4a04-a25d-97c7e96f97e1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T21:34:22.881 DEBUG:teuthology.misc:0 of 3 OSDs are up 2026-02-22T21:34:22.884 INFO:tasks.ceph.mgr.x.trial023.stderr:2026-02-22T21:34:22.877+0000 7f5f8ec6d280 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-22T21:34:22.916 INFO:tasks.ceph.mgr.x.trial023.stderr:2026-02-22T21:34:22.909+0000 7f5f8ec6d280 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-22T21:34:22.960 INFO:tasks.ceph.mgr.x.trial023.stderr:2026-02-22T21:34:22.953+0000 7f5f8ec6d280 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-22T21:34:23.062 INFO:tasks.ceph.mgr.x.trial023.stderr:2026-02-22T21:34:23.057+0000 7f5f8ec6d280 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-22T21:34:23.258 INFO:tasks.ceph.mgr.x.trial023.stderr:ERROR:root:Module 'xmltodict' is not installed. 2026-02-22T21:34:23.434 INFO:tasks.ceph.mgr.x.trial023.stderr:2026-02-22T21:34:23.429+0000 7f5f8ec6d280 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-22T21:34:23.466 INFO:tasks.ceph.mgr.x.trial023.stderr:2026-02-22T21:34:23.461+0000 7f5f8ec6d280 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-22T21:34:23.560 INFO:tasks.ceph.mgr.x.trial023.stderr:2026-02-22T21:34:23.557+0000 7f5f8ec6d280 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-22T21:34:23.585 INFO:tasks.ceph.mgr.x.trial023.stderr:2026-02-22T21:34:23.581+0000 7f5f8ec6d280 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-22T21:34:23.612 INFO:tasks.ceph.mgr.x.trial023.stderr:2026-02-22T21:34:23.609+0000 7f5f8ec6d280 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-22T21:34:23.640 INFO:tasks.ceph.mgr.x.trial023.stderr:2026-02-22T21:34:23.633+0000 7f5f8ec6d280 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-22T21:34:23.761 INFO:tasks.ceph.mgr.x.trial023.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-22T21:34:23.761 INFO:tasks.ceph.mgr.x.trial023.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-22T21:34:23.761 INFO:tasks.ceph.mgr.x.trial023.stderr: from numpy import show_config as show_numpy_config 2026-02-22T21:34:23.768 INFO:tasks.ceph.mgr.x.trial023.stderr:2026-02-22T21:34:23.761+0000 7f5f8ec6d280 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-22T21:34:23.795 INFO:tasks.ceph.mgr.x.trial023.stderr:2026-02-22T21:34:23.789+0000 7f5f8ec6d280 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-22T21:34:23.834 INFO:tasks.ceph.mgr.x.trial023.stderr:2026-02-22T21:34:23.829+0000 7f5f8ec6d280 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-22T21:34:24.413 INFO:tasks.ceph.osd.2.trial023.stderr:2026-02-22T21:34:24.409+0000 7f9efffd58c0 -1 Falling back to public interface 2026-02-22T21:34:24.469 INFO:tasks.ceph.osd.0.trial023.stderr:2026-02-22T21:34:24.465+0000 7f592c0aa8c0 -1 Falling back to public interface 2026-02-22T21:34:24.470 INFO:tasks.ceph.osd.1.trial023.stderr:2026-02-22T21:34:24.465+0000 7f86e00c18c0 -1 Falling back to public interface 2026-02-22T21:34:27.940 INFO:tasks.ceph.mgr.x.trial023.stderr:2026-02-22T21:34:27.933+0000 7f5ead3b9640 -1 mgr.server handle_report got status from non-daemon mon.a 2026-02-22T21:34:29.183 DEBUG:teuthology.orchestra.run.trial023:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-22T21:34:29.200 INFO:tasks.ceph.osd.2.trial023.stderr:2026-02-22T21:34:29.193+0000 7f9efffd58c0 -1 osd.2 0 log_to_monitors true 2026-02-22T21:34:29.327 INFO:teuthology.misc.health.trial023.stdout: 2026-02-22T21:34:29.327 INFO:teuthology.misc.health.trial023.stdout:{"epoch":5,"fsid":"e2dd7ed3-13e8-4519-aab8-5d5a54f80255","created":"2026-02-22T21:34:21.785434+0000","modified":"2026-02-22T21:34:22.372890+0000","last_up_change":"0.000000","last_in_change":"2026-02-22T21:34:22.372890+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"870c022b-b636-466f-8421-e3830c92377c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6e16d5b5-ec7e-4144-8d71-68175ef54eae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"46858b82-1822-4a04-a25d-97c7e96f97e1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T21:34:29.330 INFO:tasks.ceph.osd.1.trial023.stderr:2026-02-22T21:34:29.325+0000 7f86e00c18c0 -1 osd.1 0 log_to_monitors true 2026-02-22T21:34:29.336 DEBUG:teuthology.misc:0 of 3 OSDs are up 2026-02-22T21:34:29.421 INFO:tasks.ceph.osd.0.trial023.stderr:2026-02-22T21:34:29.417+0000 7f592c0aa8c0 -1 osd.0 0 log_to_monitors true 2026-02-22T21:34:30.951 INFO:tasks.ceph.osd.1.trial023.stderr:2026-02-22T21:34:30.945+0000 7f86dc048640 -1 osd.1 0 waiting for initial osdmap 2026-02-22T21:34:30.952 INFO:tasks.ceph.osd.0.trial023.stderr:2026-02-22T21:34:30.945+0000 7f5928031640 -1 osd.0 0 waiting for initial osdmap 2026-02-22T21:34:30.953 INFO:tasks.ceph.osd.2.trial023.stderr:2026-02-22T21:34:30.949+0000 7f9efbf5c640 -1 osd.2 0 waiting for initial osdmap 2026-02-22T21:34:30.954 INFO:tasks.ceph.osd.0.trial023.stderr:2026-02-22T21:34:30.949+0000 7f591fe75640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T21:34:30.955 INFO:tasks.ceph.osd.1.trial023.stderr:2026-02-22T21:34:30.949+0000 7f86d3e8c640 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T21:34:30.956 INFO:tasks.ceph.osd.2.trial023.stderr:2026-02-22T21:34:30.949+0000 7f9ef7da8640 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T21:34:31.951 INFO:tasks.ceph.osd.2.trial023.stderr:2026-02-22T21:34:31.945+0000 7f9ef26ec640 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T21:34:35.638 DEBUG:teuthology.orchestra.run.trial023:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-22T21:34:35.787 INFO:teuthology.misc.health.trial023.stdout: 2026-02-22T21:34:35.787 INFO:teuthology.misc.health.trial023.stdout:{"epoch":9,"fsid":"e2dd7ed3-13e8-4519-aab8-5d5a54f80255","created":"2026-02-22T21:34:21.785434+0000","modified":"2026-02-22T21:34:32.951878+0000","last_up_change":"2026-02-22T21:34:31.949151+0000","last_in_change":"2026-02-22T21:34:22.372890+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"870c022b-b636-466f-8421-e3830c92377c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.23:6806","nonce":623336197}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.23:6809","nonce":623336197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.23:6812","nonce":623336197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.23:6811","nonce":623336197}]},"public_addr":"10.20.193.23:6806/623336197","cluster_addr":"10.20.193.23:6809/623336197","heartbeat_back_addr":"10.20.193.23:6812/623336197","heartbeat_front_addr":"10.20.193.23:6811/623336197","state":["exists","up"]},{"osd":1,"uuid":"6e16d5b5-ec7e-4144-8d71-68175ef54eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.23:6805","nonce":42095765}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.23:6807","nonce":42095765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.23:6810","nonce":42095765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.23:6808","nonce":42095765}]},"public_addr":"10.20.193.23:6805/42095765","cluster_addr":"10.20.193.23:6807/42095765","heartbeat_back_addr":"10.20.193.23:6810/42095765","heartbeat_front_addr":"10.20.193.23:6808/42095765","state":["exists","up"]},{"osd":2,"uuid":"46858b82-1822-4a04-a25d-97c7e96f97e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.23:6801","nonce":2701368670}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.23:6802","nonce":2701368670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.23:6804","nonce":2701368670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.23:6803","nonce":2701368670}]},"public_addr":"10.20.193.23:6801/2701368670","cluster_addr":"10.20.193.23:6802/2701368670","heartbeat_back_addr":"10.20.193.23:6804/2701368670","heartbeat_front_addr":"10.20.193.23:6803/2701368670","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T21:34:30.199802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T21:34:35.796 DEBUG:teuthology.misc:3 of 3 OSDs are up 2026-02-22T21:34:35.796 INFO:tasks.ceph:Creating RBD pool 2026-02-22T21:34:35.796 DEBUG:teuthology.orchestra.run.trial023:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-22T21:34:35.958 INFO:teuthology.orchestra.run.trial023.stderr:pool 'rbd' created 2026-02-22T21:34:35.970 DEBUG:teuthology.orchestra.run.trial023:> rbd --cluster ceph pool init rbd 2026-02-22T21:34:38.970 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-22T21:34:38.971 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-22T21:34:38.971 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-22T21:34:38.971 DEBUG:teuthology.orchestra.run.trial023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-22T21:34:38.972 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-22T21:34:39.129 INFO:teuthology.orchestra.run.trial023.stdout: 2026-02-22T21:34:39.138 INFO:teuthology.orchestra.run.trial023.stdout:{"epoch":4,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.23:6800","nonce":2834055528}]},"active_addr":"10.20.193.23:6800/2834055528","active_change":"2026-02-22T21:34:23.852703+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.23:0","nonce":294854423}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.23:0","nonce":1234128564}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.23:0","nonce":2164884089}]}]} 2026-02-22T21:34:39.140 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-22T21:34:39.141 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-22T21:34:39.141 DEBUG:teuthology.orchestra.run.trial023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-22T21:34:39.280 INFO:teuthology.orchestra.run.trial023.stdout: 2026-02-22T21:34:39.280 INFO:teuthology.orchestra.run.trial023.stdout:{"epoch":13,"fsid":"e2dd7ed3-13e8-4519-aab8-5d5a54f80255","created":"2026-02-22T21:34:21.785434+0000","modified":"2026-02-22T21:34:38.961507+0000","last_up_change":"2026-02-22T21:34:31.949151+0000","last_in_change":"2026-02-22T21:34:22.372890+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-22T21:34:35.945401+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":13,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"870c022b-b636-466f-8421-e3830c92377c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.23:6806","nonce":623336197}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.23:6809","nonce":623336197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.23:6812","nonce":623336197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.23:6811","nonce":623336197}]},"public_addr":"10.20.193.23:6806/623336197","cluster_addr":"10.20.193.23:6809/623336197","heartbeat_back_addr":"10.20.193.23:6812/623336197","heartbeat_front_addr":"10.20.193.23:6811/623336197","state":["exists","up"]},{"osd":1,"uuid":"6e16d5b5-ec7e-4144-8d71-68175ef54eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.23:6805","nonce":42095765}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.23:6807","nonce":42095765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.23:6810","nonce":42095765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.23:6808","nonce":42095765}]},"public_addr":"10.20.193.23:6805/42095765","cluster_addr":"10.20.193.23:6807/42095765","heartbeat_back_addr":"10.20.193.23:6810/42095765","heartbeat_front_addr":"10.20.193.23:6808/42095765","state":["exists","up"]},{"osd":2,"uuid":"46858b82-1822-4a04-a25d-97c7e96f97e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.23:6801","nonce":2701368670}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.23:6802","nonce":2701368670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.23:6804","nonce":2701368670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.23:6803","nonce":2701368670}]},"public_addr":"10.20.193.23:6801/2701368670","cluster_addr":"10.20.193.23:6802/2701368670","heartbeat_back_addr":"10.20.193.23:6804/2701368670","heartbeat_front_addr":"10.20.193.23:6803/2701368670","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T21:34:30.199802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T21:34:39.290 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-22T21:34:39.290 DEBUG:teuthology.orchestra.run.trial023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-22T21:34:39.438 INFO:teuthology.orchestra.run.trial023.stdout: 2026-02-22T21:34:39.438 INFO:teuthology.orchestra.run.trial023.stdout:{"epoch":13,"fsid":"e2dd7ed3-13e8-4519-aab8-5d5a54f80255","created":"2026-02-22T21:34:21.785434+0000","modified":"2026-02-22T21:34:38.961507+0000","last_up_change":"2026-02-22T21:34:31.949151+0000","last_in_change":"2026-02-22T21:34:22.372890+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-22T21:34:35.945401+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":13,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"870c022b-b636-466f-8421-e3830c92377c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.23:6806","nonce":623336197}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.23:6809","nonce":623336197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.23:6812","nonce":623336197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.23:6811","nonce":623336197}]},"public_addr":"10.20.193.23:6806/623336197","cluster_addr":"10.20.193.23:6809/623336197","heartbeat_back_addr":"10.20.193.23:6812/623336197","heartbeat_front_addr":"10.20.193.23:6811/623336197","state":["exists","up"]},{"osd":1,"uuid":"6e16d5b5-ec7e-4144-8d71-68175ef54eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.23:6805","nonce":42095765}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.23:6807","nonce":42095765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.23:6810","nonce":42095765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.23:6808","nonce":42095765}]},"public_addr":"10.20.193.23:6805/42095765","cluster_addr":"10.20.193.23:6807/42095765","heartbeat_back_addr":"10.20.193.23:6810/42095765","heartbeat_front_addr":"10.20.193.23:6808/42095765","state":["exists","up"]},{"osd":2,"uuid":"46858b82-1822-4a04-a25d-97c7e96f97e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.23:6801","nonce":2701368670}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.23:6802","nonce":2701368670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.23:6804","nonce":2701368670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.23:6803","nonce":2701368670}]},"public_addr":"10.20.193.23:6801/2701368670","cluster_addr":"10.20.193.23:6802/2701368670","heartbeat_back_addr":"10.20.193.23:6804/2701368670","heartbeat_front_addr":"10.20.193.23:6803/2701368670","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T21:34:30.199802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T21:34:39.448 DEBUG:teuthology.orchestra.run.trial023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-22T21:34:39.448 DEBUG:teuthology.orchestra.run.trial023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-22T21:34:39.449 DEBUG:teuthology.orchestra.run.trial023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-22T21:34:39.529 INFO:teuthology.orchestra.run.trial023.stdout:34359738371 2026-02-22T21:34:39.530 DEBUG:teuthology.orchestra.run.trial023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-22T21:34:39.533 INFO:teuthology.orchestra.run.trial023.stdout:34359738371 2026-02-22T21:34:39.534 DEBUG:teuthology.orchestra.run.trial023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-22T21:34:39.535 INFO:teuthology.orchestra.run.trial023.stdout:34359738371 2026-02-22T21:34:39.536 DEBUG:teuthology.orchestra.run.trial023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-22T21:34:39.683 INFO:teuthology.orchestra.run.trial023.stdout:34359738369 2026-02-22T21:34:39.693 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738371 got 34359738369 for osd.2 2026-02-22T21:34:39.718 INFO:teuthology.orchestra.run.trial023.stdout:34359738369 2026-02-22T21:34:39.724 INFO:teuthology.orchestra.run.trial023.stdout:34359738369 2026-02-22T21:34:39.729 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738371 got 34359738369 for osd.1 2026-02-22T21:34:39.734 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738371 got 34359738369 for osd.0 2026-02-22T21:34:40.695 DEBUG:teuthology.orchestra.run.trial023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-22T21:34:40.730 DEBUG:teuthology.orchestra.run.trial023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-22T21:34:40.735 DEBUG:teuthology.orchestra.run.trial023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-22T21:34:40.849 INFO:teuthology.orchestra.run.trial023.stdout:34359738371 2026-02-22T21:34:40.861 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738371 got 34359738371 for osd.2 2026-02-22T21:34:40.861 DEBUG:teuthology.parallel:result is None 2026-02-22T21:34:40.882 INFO:teuthology.orchestra.run.trial023.stdout:34359738371 2026-02-22T21:34:40.892 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738371 got 34359738371 for osd.1 2026-02-22T21:34:40.892 DEBUG:teuthology.parallel:result is None 2026-02-22T21:34:40.893 INFO:teuthology.orchestra.run.trial023.stdout:34359738371 2026-02-22T21:34:40.904 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738371 got 34359738371 for osd.0 2026-02-22T21:34:40.904 DEBUG:teuthology.parallel:result is None 2026-02-22T21:34:40.905 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-22T21:34:40.905 DEBUG:teuthology.orchestra.run.trial023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T21:34:41.090 INFO:teuthology.orchestra.run.trial023.stdout: 2026-02-22T21:34:41.091 INFO:teuthology.orchestra.run.trial023.stderr:dumped all 2026-02-22T21:34:41.100 INFO:teuthology.orchestra.run.trial023.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2026-02-22T21:34:39.857006+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":10,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81228,"kb_used_data":336,"kb_used_omap":4,"kb_used_meta":80827,"kb_avail":283034292,"statfs":{"total":289910292480,"available":289827115008,"internally_reserved":0,"allocated":344064,"data_stored":77393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":82767186},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.895268"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-22T21:34:38.965236+0000","last_change":"2026-02-22T21:34:38.965382+0000","last_active":"2026-02-22T21:34:38.965236+0000","last_peered":"2026-02-22T21:34:38.965236+0000","last_clean":"2026-02-22T21:34:38.965236+0000","last_became_active":"2026-02-22T21:34:36.963312+0000","last_became_peered":"2026-02-22T21:34:36.963312+0000","last_unstale":"2026-02-22T21:34:38.965236+0000","last_undegraded":"2026-02-22T21:34:38.965236+0000","last_fullsized":"2026-02-22T21:34:38.965236+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_clean_scrub_stamp":"2026-02-22T21:34:35.955313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:37:28.247229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049982599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-22T21:34:38.965420+0000","last_change":"2026-02-22T21:34:38.965537+0000","last_active":"2026-02-22T21:34:38.965420+0000","last_peered":"2026-02-22T21:34:38.965420+0000","last_clean":"2026-02-22T21:34:38.965420+0000","last_became_active":"2026-02-22T21:34:36.963610+0000","last_became_peered":"2026-02-22T21:34:36.963610+0000","last_unstale":"2026-02-22T21:34:38.965420+0000","last_undegraded":"2026-02-22T21:34:38.965420+0000","last_fullsized":"2026-02-22T21:34:38.965420+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_clean_scrub_stamp":"2026-02-22T21:34:35.955313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:16:04.530029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064584699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-22T21:34:39.232358+0000","last_change":"2026-02-22T21:34:39.232521+0000","last_active":"2026-02-22T21:34:39.232358+0000","last_peered":"2026-02-22T21:34:39.232358+0000","last_clean":"2026-02-22T21:34:39.232358+0000","last_became_active":"2026-02-22T21:34:36.963683+0000","last_became_peered":"2026-02-22T21:34:36.963683+0000","last_unstale":"2026-02-22T21:34:39.232358+0000","last_undegraded":"2026-02-22T21:34:39.232358+0000","last_fullsized":"2026-02-22T21:34:39.232358+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_clean_scrub_stamp":"2026-02-22T21:34:35.955313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:47:07.759565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035308399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-22T21:34:38.965002+0000","last_change":"2026-02-22T21:34:38.965157+0000","last_active":"2026-02-22T21:34:38.965002+0000","last_peered":"2026-02-22T21:34:38.965002+0000","last_clean":"2026-02-22T21:34:38.965002+0000","last_became_active":"2026-02-22T21:34:36.963644+0000","last_became_peered":"2026-02-22T21:34:36.963644+0000","last_unstale":"2026-02-22T21:34:38.965002+0000","last_undegraded":"2026-02-22T21:34:38.965002+0000","last_fullsized":"2026-02-22T21:34:38.965002+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_clean_scrub_stamp":"2026-02-22T21:34:35.955313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T05:03:08.985147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031839999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.3","version":"11'1","reported_seq":20,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-22T21:34:38.965200+0000","last_change":"2026-02-22T21:34:38.965365+0000","last_active":"2026-02-22T21:34:38.965200+0000","last_peered":"2026-02-22T21:34:38.965200+0000","last_clean":"2026-02-22T21:34:38.965200+0000","last_became_active":"2026-02-22T21:34:36.963701+0000","last_became_peered":"2026-02-22T21:34:36.963701+0000","last_unstale":"2026-02-22T21:34:38.965200+0000","last_undegraded":"2026-02-22T21:34:38.965200+0000","last_fullsized":"2026-02-22T21:34:38.965200+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_clean_scrub_stamp":"2026-02-22T21:34:35.955313+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:46:14.398511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049378499999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.2","version":"13'2","reported_seq":21,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-22T21:34:38.963841+0000","last_change":"2026-02-22T21:34:38.963841+0000","last_active":"2026-02-22T21:34:38.963841+0000","last_peered":"2026-02-22T21:34:38.963841+0000","last_clean":"2026-02-22T21:34:38.963841+0000","last_became_active":"2026-02-22T21:34:36.962995+0000","last_became_peered":"2026-02-22T21:34:36.962995+0000","last_unstale":"2026-02-22T21:34:38.963841+0000","last_undegraded":"2026-02-22T21:34:38.963841+0000","last_fullsized":"2026-02-22T21:34:38.963841+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_clean_scrub_stamp":"2026-02-22T21:34:35.955313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:58:59.891021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059288799999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.1","version":"0'0","reported_seq":19,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-22T21:34:39.232316+0000","last_change":"2026-02-22T21:34:39.232477+0000","last_active":"2026-02-22T21:34:39.232316+0000","last_peered":"2026-02-22T21:34:39.232316+0000","last_clean":"2026-02-22T21:34:39.232316+0000","last_became_active":"2026-02-22T21:34:36.963686+0000","last_became_peered":"2026-02-22T21:34:36.963686+0000","last_unstale":"2026-02-22T21:34:39.232316+0000","last_undegraded":"2026-02-22T21:34:39.232316+0000","last_fullsized":"2026-02-22T21:34:39.232316+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_clean_scrub_stamp":"2026-02-22T21:34:35.955313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:14:55.770097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031342099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-22T21:34:38.965053+0000","last_change":"2026-02-22T21:34:38.965195+0000","last_active":"2026-02-22T21:34:38.965053+0000","last_peered":"2026-02-22T21:34:38.965053+0000","last_clean":"2026-02-22T21:34:38.965053+0000","last_became_active":"2026-02-22T21:34:36.963656+0000","last_became_peered":"2026-02-22T21:34:36.963656+0000","last_unstale":"2026-02-22T21:34:38.965053+0000","last_undegraded":"2026-02-22T21:34:38.965053+0000","last_fullsized":"2026-02-22T21:34:38.965053+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_clean_scrub_stamp":"2026-02-22T21:34:35.955313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:46:09.679467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036378400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":0,"up_from":8,"seq":34359738371,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27080,"kb_used_data":116,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344760,"statfs":{"total":96636764160,"available":96609034240,"internally_reserved":0,"allocated":118784,"data_stored":26722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738371,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27068,"kb_used_data":104,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344772,"statfs":{"total":96636764160,"available":96609046528,"internally_reserved":0,"allocated":106496,"data_stored":23949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738371,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27080,"kb_used_data":116,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344760,"statfs":{"total":96636764160,"available":96609034240,"internally_reserved":0,"allocated":118784,"data_stored":26722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T21:34:41.100 DEBUG:teuthology.orchestra.run.trial023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T21:34:41.241 INFO:teuthology.orchestra.run.trial023.stdout: 2026-02-22T21:34:41.241 INFO:teuthology.orchestra.run.trial023.stderr:dumped all 2026-02-22T21:34:41.250 INFO:teuthology.orchestra.run.trial023.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2026-02-22T21:34:39.857006+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":10,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81228,"kb_used_data":336,"kb_used_omap":4,"kb_used_meta":80827,"kb_avail":283034292,"statfs":{"total":289910292480,"available":289827115008,"internally_reserved":0,"allocated":344064,"data_stored":77393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":82767186},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.895268"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-22T21:34:38.965236+0000","last_change":"2026-02-22T21:34:38.965382+0000","last_active":"2026-02-22T21:34:38.965236+0000","last_peered":"2026-02-22T21:34:38.965236+0000","last_clean":"2026-02-22T21:34:38.965236+0000","last_became_active":"2026-02-22T21:34:36.963312+0000","last_became_peered":"2026-02-22T21:34:36.963312+0000","last_unstale":"2026-02-22T21:34:38.965236+0000","last_undegraded":"2026-02-22T21:34:38.965236+0000","last_fullsized":"2026-02-22T21:34:38.965236+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_clean_scrub_stamp":"2026-02-22T21:34:35.955313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:37:28.247229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049982599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-22T21:34:38.965420+0000","last_change":"2026-02-22T21:34:38.965537+0000","last_active":"2026-02-22T21:34:38.965420+0000","last_peered":"2026-02-22T21:34:38.965420+0000","last_clean":"2026-02-22T21:34:38.965420+0000","last_became_active":"2026-02-22T21:34:36.963610+0000","last_became_peered":"2026-02-22T21:34:36.963610+0000","last_unstale":"2026-02-22T21:34:38.965420+0000","last_undegraded":"2026-02-22T21:34:38.965420+0000","last_fullsized":"2026-02-22T21:34:38.965420+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_clean_scrub_stamp":"2026-02-22T21:34:35.955313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:16:04.530029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064584699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-22T21:34:39.232358+0000","last_change":"2026-02-22T21:34:39.232521+0000","last_active":"2026-02-22T21:34:39.232358+0000","last_peered":"2026-02-22T21:34:39.232358+0000","last_clean":"2026-02-22T21:34:39.232358+0000","last_became_active":"2026-02-22T21:34:36.963683+0000","last_became_peered":"2026-02-22T21:34:36.963683+0000","last_unstale":"2026-02-22T21:34:39.232358+0000","last_undegraded":"2026-02-22T21:34:39.232358+0000","last_fullsized":"2026-02-22T21:34:39.232358+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_clean_scrub_stamp":"2026-02-22T21:34:35.955313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:47:07.759565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035308399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-22T21:34:38.965002+0000","last_change":"2026-02-22T21:34:38.965157+0000","last_active":"2026-02-22T21:34:38.965002+0000","last_peered":"2026-02-22T21:34:38.965002+0000","last_clean":"2026-02-22T21:34:38.965002+0000","last_became_active":"2026-02-22T21:34:36.963644+0000","last_became_peered":"2026-02-22T21:34:36.963644+0000","last_unstale":"2026-02-22T21:34:38.965002+0000","last_undegraded":"2026-02-22T21:34:38.965002+0000","last_fullsized":"2026-02-22T21:34:38.965002+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_clean_scrub_stamp":"2026-02-22T21:34:35.955313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T05:03:08.985147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031839999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.3","version":"11'1","reported_seq":20,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-22T21:34:38.965200+0000","last_change":"2026-02-22T21:34:38.965365+0000","last_active":"2026-02-22T21:34:38.965200+0000","last_peered":"2026-02-22T21:34:38.965200+0000","last_clean":"2026-02-22T21:34:38.965200+0000","last_became_active":"2026-02-22T21:34:36.963701+0000","last_became_peered":"2026-02-22T21:34:36.963701+0000","last_unstale":"2026-02-22T21:34:38.965200+0000","last_undegraded":"2026-02-22T21:34:38.965200+0000","last_fullsized":"2026-02-22T21:34:38.965200+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_clean_scrub_stamp":"2026-02-22T21:34:35.955313+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:46:14.398511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049378499999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.2","version":"13'2","reported_seq":21,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-22T21:34:38.963841+0000","last_change":"2026-02-22T21:34:38.963841+0000","last_active":"2026-02-22T21:34:38.963841+0000","last_peered":"2026-02-22T21:34:38.963841+0000","last_clean":"2026-02-22T21:34:38.963841+0000","last_became_active":"2026-02-22T21:34:36.962995+0000","last_became_peered":"2026-02-22T21:34:36.962995+0000","last_unstale":"2026-02-22T21:34:38.963841+0000","last_undegraded":"2026-02-22T21:34:38.963841+0000","last_fullsized":"2026-02-22T21:34:38.963841+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_clean_scrub_stamp":"2026-02-22T21:34:35.955313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:58:59.891021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059288799999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.1","version":"0'0","reported_seq":19,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-22T21:34:39.232316+0000","last_change":"2026-02-22T21:34:39.232477+0000","last_active":"2026-02-22T21:34:39.232316+0000","last_peered":"2026-02-22T21:34:39.232316+0000","last_clean":"2026-02-22T21:34:39.232316+0000","last_became_active":"2026-02-22T21:34:36.963686+0000","last_became_peered":"2026-02-22T21:34:36.963686+0000","last_unstale":"2026-02-22T21:34:39.232316+0000","last_undegraded":"2026-02-22T21:34:39.232316+0000","last_fullsized":"2026-02-22T21:34:39.232316+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_clean_scrub_stamp":"2026-02-22T21:34:35.955313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:14:55.770097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031342099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-22T21:34:38.965053+0000","last_change":"2026-02-22T21:34:38.965195+0000","last_active":"2026-02-22T21:34:38.965053+0000","last_peered":"2026-02-22T21:34:38.965053+0000","last_clean":"2026-02-22T21:34:38.965053+0000","last_became_active":"2026-02-22T21:34:36.963656+0000","last_became_peered":"2026-02-22T21:34:36.963656+0000","last_unstale":"2026-02-22T21:34:38.965053+0000","last_undegraded":"2026-02-22T21:34:38.965053+0000","last_fullsized":"2026-02-22T21:34:38.965053+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_clean_scrub_stamp":"2026-02-22T21:34:35.955313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:46:09.679467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036378400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":0,"up_from":8,"seq":34359738371,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27080,"kb_used_data":116,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344760,"statfs":{"total":96636764160,"available":96609034240,"internally_reserved":0,"allocated":118784,"data_stored":26722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738371,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27068,"kb_used_data":104,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344772,"statfs":{"total":96636764160,"available":96609046528,"internally_reserved":0,"allocated":106496,"data_stored":23949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738371,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27080,"kb_used_data":116,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344760,"statfs":{"total":96636764160,"available":96609034240,"internally_reserved":0,"allocated":118784,"data_stored":26722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T21:34:41.250 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-22T21:34:41.251 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-22T21:34:41.251 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-22T21:34:41.251 DEBUG:teuthology.orchestra.run.trial023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-22T21:34:41.415 INFO:teuthology.orchestra.run.trial023.stdout: 2026-02-22T21:34:41.415 INFO:teuthology.orchestra.run.trial023.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-22T21:34:41.425 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-22T21:34:41.425 INFO:teuthology.run_tasks:Running task workunit... 2026-02-22T21:34:41.436 INFO:tasks.workunit:Pulling workunits from ref f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-22T21:34:41.436 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-22T21:34:41.436 INFO:tasks.workunit:timeout=3h 2026-02-22T21:34:41.436 INFO:tasks.workunit:cleanup=True 2026-02-22T21:34:41.437 DEBUG:teuthology.orchestra.run.trial023:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-22T21:34:41.440 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T21:34:41.440 INFO:teuthology.orchestra.run.trial023.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2026-02-22T21:34:41.441 DEBUG:teuthology.orchestra.run.trial023:> mkdir -- /home/ubuntu/cephtest/mnt.0 2026-02-22T21:34:41.487 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2026-02-22T21:34:41.488 DEBUG:teuthology.orchestra.run.trial023:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2026-02-22T21:34:41.531 DEBUG:teuthology.orchestra.run.trial023:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-22T21:34:41.582 INFO:tasks.workunit.client.0.trial023.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-22T21:35:04.061 INFO:tasks.workunit.client.0.trial023.stderr:Note: switching to 'f90f4eaebb28b619cf76e80cbbe997656da69579'. 2026-02-22T21:35:04.061 INFO:tasks.workunit.client.0.trial023.stderr: 2026-02-22T21:35:04.061 INFO:tasks.workunit.client.0.trial023.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-22T21:35:04.061 INFO:tasks.workunit.client.0.trial023.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-22T21:35:04.061 INFO:tasks.workunit.client.0.trial023.stderr:state without impacting any branches by switching back to a branch. 2026-02-22T21:35:04.061 INFO:tasks.workunit.client.0.trial023.stderr: 2026-02-22T21:35:04.061 INFO:tasks.workunit.client.0.trial023.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-22T21:35:04.061 INFO:tasks.workunit.client.0.trial023.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-22T21:35:04.061 INFO:tasks.workunit.client.0.trial023.stderr: 2026-02-22T21:35:04.061 INFO:tasks.workunit.client.0.trial023.stderr: git switch -c 2026-02-22T21:35:04.061 INFO:tasks.workunit.client.0.trial023.stderr: 2026-02-22T21:35:04.061 INFO:tasks.workunit.client.0.trial023.stderr:Or undo this operation with: 2026-02-22T21:35:04.061 INFO:tasks.workunit.client.0.trial023.stderr: 2026-02-22T21:35:04.061 INFO:tasks.workunit.client.0.trial023.stderr: git switch - 2026-02-22T21:35:04.061 INFO:tasks.workunit.client.0.trial023.stderr: 2026-02-22T21:35:04.061 INFO:tasks.workunit.client.0.trial023.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-22T21:35:04.061 INFO:tasks.workunit.client.0.trial023.stderr: 2026-02-22T21:35:04.061 INFO:tasks.workunit.client.0.trial023.stderr:HEAD is now at f90f4eaebb2 Merge branch 'wip-74712-squid' of https://github.com/idryomov/ceph into wip-yuri6-testing-2026-02-22-1629-squid 2026-02-22T21:35:04.070 DEBUG:teuthology.orchestra.run.trial023:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-22T21:35:04.117 INFO:tasks.workunit.client.0.trial023.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2026-02-22T21:35:04.118 INFO:tasks.workunit.client.0.trial023.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-22T21:35:04.118 INFO:tasks.workunit.client.0.trial023.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2026-02-22T21:35:04.214 INFO:tasks.workunit.client.0.trial023.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2026-02-22T21:35:04.247 INFO:tasks.workunit.client.0.trial023.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2026-02-22T21:35:04.271 INFO:tasks.workunit.client.0.trial023.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-22T21:35:04.273 INFO:tasks.workunit.client.0.trial023.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-22T21:35:04.273 INFO:tasks.workunit.client.0.trial023.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2026-02-22T21:35:04.298 INFO:tasks.workunit.client.0.trial023.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-22T21:35:04.302 DEBUG:teuthology.orchestra.run.trial023:> set -ex 2026-02-22T21:35:04.302 DEBUG:teuthology.orchestra.run.trial023:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-22T21:35:04.349 INFO:tasks.workunit:Running workunits matching mon/test_config_key_caps.sh on client.0... 2026-02-22T21:35:04.352 INFO:tasks.workunit:Running workunit mon/test_config_key_caps.sh... 2026-02-22T21:35:04.353 DEBUG:teuthology.orchestra.run.trial023:workunit test mon/test_config_key_caps.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f90f4eaebb28b619cf76e80cbbe997656da69579 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/test_config_key_caps.sh 2026-02-22T21:35:04.400 INFO:tasks.workunit.client.0.trial023.stderr:+ set -e 2026-02-22T21:35:04.400 INFO:tasks.workunit.client.0.trial023.stderr:++ mktemp -d -p /tmp test_mon_config_key_caps.XXXXX 2026-02-22T21:35:04.401 INFO:tasks.workunit.client.0.trial023.stderr:+ tmp=/tmp/test_mon_config_key_caps.oiHJL 2026-02-22T21:35:04.401 INFO:tasks.workunit.client.0.trial023.stderr:+ entities=() 2026-02-22T21:35:04.401 INFO:tasks.workunit.client.0.trial023.stderr:+ trap cleanup 0 2026-02-22T21:35:04.401 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph auth export -o /tmp/test_mon_config_key_caps.oiHJL/keyring.orig 2026-02-22T21:35:04.638 INFO:tasks.workunit.client.0.trial023.stderr:+ k=/tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:04.638 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph config-key ls 2026-02-22T21:35:04.902 INFO:tasks.workunit.client.0.trial023.stdout:[ 2026-02-22T21:35:04.903 INFO:tasks.workunit.client.0.trial023.stdout: "config-history/2/", 2026-02-22T21:35:04.903 INFO:tasks.workunit.client.0.trial023.stdout: "config-history/2/+mgr/mgr_pool", 2026-02-22T21:35:04.903 INFO:tasks.workunit.client.0.trial023.stdout: "config/mgr/mgr_pool", 2026-02-22T21:35:04.903 INFO:tasks.workunit.client.0.trial023.stdout: "mgr/telemetry/collection", 2026-02-22T21:35:04.903 INFO:tasks.workunit.client.0.trial023.stdout: "mgr/telemetry/report_id", 2026-02-22T21:35:04.903 INFO:tasks.workunit.client.0.trial023.stdout: "mgr/telemetry/salt" 2026-02-22T21:35:04.903 INFO:tasks.workunit.client.0.trial023.stdout:] 2026-02-22T21:35:04.911 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph config-key set daemon-private/osd.123/test-foo 2026-02-22T21:35:05.183 INFO:tasks.workunit.client.0.trial023.stderr:set daemon-private/osd.123/test-foo 2026-02-22T21:35:05.192 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph config-key set mgr/test-foo 2026-02-22T21:35:05.460 INFO:tasks.workunit.client.0.trial023.stderr:set mgr/test-foo 2026-02-22T21:35:05.469 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph config-key set device/test-foo 2026-02-22T21:35:05.729 INFO:tasks.workunit.client.0.trial023.stderr:set device/test-foo 2026-02-22T21:35:05.739 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph config-key set test/foo 2026-02-22T21:35:06.005 INFO:tasks.workunit.client.0.trial023.stderr:set test/foo 2026-02-22T21:35:06.015 INFO:tasks.workunit.client.0.trial023.stderr:+ allow_aa=client.allow_aa 2026-02-22T21:35:06.015 INFO:tasks.workunit.client.0.trial023.stderr:+ allow_bb=client.allow_bb 2026-02-22T21:35:06.015 INFO:tasks.workunit.client.0.trial023.stderr:+ allow_cc=client.allow_cc 2026-02-22T21:35:06.015 INFO:tasks.workunit.client.0.trial023.stderr:+ mgr_a=mgr.a 2026-02-22T21:35:06.015 INFO:tasks.workunit.client.0.trial023.stderr:+ mgr_b=mgr.b 2026-02-22T21:35:06.015 INFO:tasks.workunit.client.0.trial023.stderr:+ osd_a=osd.100 2026-02-22T21:35:06.015 INFO:tasks.workunit.client.0.trial023.stderr:+ osd_b=osd.200 2026-02-22T21:35:06.015 INFO:tasks.workunit.client.0.trial023.stderr:+ prefix_aa=client.prefix_aa 2026-02-22T21:35:06.015 INFO:tasks.workunit.client.0.trial023.stderr:+ prefix_bb=client.prefix_bb 2026-02-22T21:35:06.015 INFO:tasks.workunit.client.0.trial023.stderr:+ prefix_cc=client.prefix_cc 2026-02-22T21:35:06.015 INFO:tasks.workunit.client.0.trial023.stderr:+ match_aa=client.match_aa 2026-02-22T21:35:06.015 INFO:tasks.workunit.client.0.trial023.stderr:+ match_bb=client.match_bb 2026-02-22T21:35:06.015 INFO:tasks.workunit.client.0.trial023.stderr:+ fail_aa=client.fail_aa 2026-02-22T21:35:06.015 INFO:tasks.workunit.client.0.trial023.stderr:+ fail_bb=client.fail_bb 2026-02-22T21:35:06.015 INFO:tasks.workunit.client.0.trial023.stderr:+ fail_cc=client.fail_cc 2026-02-22T21:35:06.015 INFO:tasks.workunit.client.0.trial023.stderr:+ fail_dd=client.fail_dd 2026-02-22T21:35:06.015 INFO:tasks.workunit.client.0.trial023.stderr:+ fail_ee=client.fail_ee 2026-02-22T21:35:06.015 INFO:tasks.workunit.client.0.trial023.stderr:+ fail_ff=client.fail_ff 2026-02-22T21:35:06.015 INFO:tasks.workunit.client.0.trial023.stderr:+ fail_gg=client.fail_gg 2026-02-22T21:35:06.015 INFO:tasks.workunit.client.0.trial023.stderr:+ fail_writes=client.fail_writes 2026-02-22T21:35:06.015 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph auth get-or-create client.allow_aa mon 'allow *' 2026-02-22T21:35:06.257 INFO:tasks.workunit.client.0.trial023.stdout:[client.allow_aa] 2026-02-22T21:35:06.258 INFO:tasks.workunit.client.0.trial023.stdout: key = AQCKdptpUpU7CxAAYaSbdSEYjRi988yGQYAm5A== 2026-02-22T21:35:06.267 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph auth get-or-create client.allow_bb mon 'allow service config-key rwx' 2026-02-22T21:35:06.513 INFO:tasks.workunit.client.0.trial023.stdout:[client.allow_bb] 2026-02-22T21:35:06.514 INFO:tasks.workunit.client.0.trial023.stdout: key = AQCKdptp5pRdGhAAGghHs36cql3O/WEo6m2sIQ== 2026-02-22T21:35:06.522 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph auth get-or-create client.allow_cc mon 'allow command "config-key get"' 2026-02-22T21:35:06.770 INFO:tasks.workunit.client.0.trial023.stdout:[client.allow_cc] 2026-02-22T21:35:06.770 INFO:tasks.workunit.client.0.trial023.stdout: key = AQCKdptpxgimKRAAFYVdVMxApiF1z4X63HIUbA== 2026-02-22T21:35:06.779 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph auth get-or-create mgr.a mon 'allow profile mgr' 2026-02-22T21:35:07.015 INFO:tasks.workunit.client.0.trial023.stdout:[mgr.a] 2026-02-22T21:35:07.015 INFO:tasks.workunit.client.0.trial023.stdout: key = AQCKdptpossnOBAAwmUPeG2Q5/ss19XrkU6Fiw== 2026-02-22T21:35:07.023 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph auth get-or-create mgr.b mon 'allow profile mgr' 2026-02-22T21:35:07.274 INFO:tasks.workunit.client.0.trial023.stdout:[mgr.b] 2026-02-22T21:35:07.274 INFO:tasks.workunit.client.0.trial023.stdout: key = AQCLdptp46kcDBAArYveArUrpsiKMKLP0w6giA== 2026-02-22T21:35:07.283 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph auth get-or-create osd.100 mon 'allow profile osd' 2026-02-22T21:35:07.529 INFO:tasks.workunit.client.0.trial023.stdout:[osd.100] 2026-02-22T21:35:07.529 INFO:tasks.workunit.client.0.trial023.stdout: key = AQCLdptpUrNSGxAAETOBL/QEMfBZM1KNfXD06w== 2026-02-22T21:35:07.537 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph auth get-or-create osd.200 mon 'allow profile osd' 2026-02-22T21:35:07.784 INFO:tasks.workunit.client.0.trial023.stdout:[osd.200] 2026-02-22T21:35:07.784 INFO:tasks.workunit.client.0.trial023.stdout: key = AQCLdptpPmqJKhAAOV440o12xRc6gRITYSewCg== 2026-02-22T21:35:07.793 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph auth get-or-create client.prefix_aa mon 'allow command "config-key get" with key prefix client/client.prefix_aa' 2026-02-22T21:35:08.028 INFO:tasks.workunit.client.0.trial023.stdout:[client.prefix_aa] 2026-02-22T21:35:08.029 INFO:tasks.workunit.client.0.trial023.stdout: key = AQCLdptpKmkbORAA4Fyi7abjEMESfVn9rEaczA== 2026-02-22T21:35:08.039 INFO:tasks.workunit.client.0.trial023.stderr:+ cap='allow command "config-key set" with key prefix client/' 2026-02-22T21:35:08.040 INFO:tasks.workunit.client.0.trial023.stderr:+ cap='allow command "config-key set" with key prefix client/,allow command "config-key get" with key prefix client/client.prefix_bb' 2026-02-22T21:35:08.040 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph auth get-or-create client.prefix_bb mon 'allow command "config-key set" with key prefix client/,allow command "config-key get" with key prefix client/client.prefix_bb' 2026-02-22T21:35:08.290 INFO:tasks.workunit.client.0.trial023.stdout:[client.prefix_bb] 2026-02-22T21:35:08.290 INFO:tasks.workunit.client.0.trial023.stdout: key = AQCMdptp7ogQDRAA0D5UJWLt1dx1QV/YrPXnKA== 2026-02-22T21:35:08.300 INFO:tasks.workunit.client.0.trial023.stderr:+ cap='allow command "config-key get" with key prefix client/' 2026-02-22T21:35:08.300 INFO:tasks.workunit.client.0.trial023.stderr:+ cap='allow command "config-key get" with key prefix client/, allow command "config-key set" with key prefix client/' 2026-02-22T21:35:08.300 INFO:tasks.workunit.client.0.trial023.stderr:+ cap='allow command "config-key get" with key prefix client/, allow command "config-key set" with key prefix client/, allow command "config-key ls"' 2026-02-22T21:35:08.300 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph auth get-or-create client.prefix_cc mon 'allow command "config-key get" with key prefix client/, allow command "config-key set" with key prefix client/, allow command "config-key ls"' 2026-02-22T21:35:08.549 INFO:tasks.workunit.client.0.trial023.stdout:[client.prefix_cc] 2026-02-22T21:35:08.549 INFO:tasks.workunit.client.0.trial023.stdout: key = AQCMdptpf4x2HBAAwC94wrFQG8guNFAo962Vaw== 2026-02-22T21:35:08.558 INFO:tasks.workunit.client.0.trial023.stderr:+ cap='allow command "config-key get" with key=client/client.match_aa/foo' 2026-02-22T21:35:08.558 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph auth get-or-create client.match_aa mon 'allow command "config-key get" with key=client/client.match_aa/foo' 2026-02-22T21:35:08.801 INFO:tasks.workunit.client.0.trial023.stdout:[client.match_aa] 2026-02-22T21:35:08.801 INFO:tasks.workunit.client.0.trial023.stdout: key = AQCMdptpxSagKxAAgH4XA2dnghu85/Le/3eDHg== 2026-02-22T21:35:08.810 INFO:tasks.workunit.client.0.trial023.stderr:+ cap='allow command "config-key get" with key=client/client.match_bb/foo' 2026-02-22T21:35:08.810 INFO:tasks.workunit.client.0.trial023.stderr:+ cap='allow command "config-key get" with key=client/client.match_bb/foo,allow command "config-key set" with key=client/client.match_bb/foo' 2026-02-22T21:35:08.810 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph auth get-or-create client.match_bb mon 'allow command "config-key get" with key=client/client.match_bb/foo,allow command "config-key set" with key=client/client.match_bb/foo' 2026-02-22T21:35:09.054 INFO:tasks.workunit.client.0.trial023.stdout:[client.match_bb] 2026-02-22T21:35:09.054 INFO:tasks.workunit.client.0.trial023.stdout: key = AQCMdptpVOyxOhAAuLjBd8a1RPYRKO0BymrVAQ== 2026-02-22T21:35:09.063 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph auth get-or-create client.fail_aa mon 'allow rx' 2026-02-22T21:35:09.306 INFO:tasks.workunit.client.0.trial023.stdout:[client.fail_aa] 2026-02-22T21:35:09.306 INFO:tasks.workunit.client.0.trial023.stdout: key = AQCNdptp0WEWDhAARmbFjYrER9bPNbpsGMV2sg== 2026-02-22T21:35:09.315 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph auth get-or-create client.fail_bb mon 'allow r,allow w' 2026-02-22T21:35:09.560 INFO:tasks.workunit.client.0.trial023.stdout:[client.fail_bb] 2026-02-22T21:35:09.560 INFO:tasks.workunit.client.0.trial023.stdout: key = AQCNdptpWHE1HRAAEbXxhR+qFV+lHhRQwrr18w== 2026-02-22T21:35:09.569 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph auth get-or-create client.fail_cc mon 'allow rw' 2026-02-22T21:35:09.819 INFO:tasks.workunit.client.0.trial023.stdout:[client.fail_cc] 2026-02-22T21:35:09.820 INFO:tasks.workunit.client.0.trial023.stdout: key = AQCNdptpVQqILBAAESNh4/vHI9lV8ZN+tqYAXQ== 2026-02-22T21:35:09.828 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph auth get-or-create client.fail_dd mon 'allow rwx' 2026-02-22T21:35:10.072 INFO:tasks.workunit.client.0.trial023.stdout:[client.fail_dd] 2026-02-22T21:35:10.072 INFO:tasks.workunit.client.0.trial023.stdout: key = AQCOdptpjvkoABAAQpe6NNh+ZCPH/dSaIho6ZA== 2026-02-22T21:35:10.081 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph auth get-or-create client.fail_ee mon 'allow profile bootstrap-rgw' 2026-02-22T21:35:10.332 INFO:tasks.workunit.client.0.trial023.stdout:[client.fail_ee] 2026-02-22T21:35:10.332 INFO:tasks.workunit.client.0.trial023.stdout: key = AQCOdptp6uCJDxAA2OtjC+jUyiD30kGQ4bi7Ew== 2026-02-22T21:35:10.341 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph auth get-or-create client.fail_ff mon 'allow profile bootstrap-rbd' 2026-02-22T21:35:10.588 INFO:tasks.workunit.client.0.trial023.stdout:[client.fail_ff] 2026-02-22T21:35:10.588 INFO:tasks.workunit.client.0.trial023.stdout: key = AQCOdptpzL7MHhAAkAOoRyM8FYi8XtVud/Z4Ew== 2026-02-22T21:35:10.597 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph auth get-or-create client.fail_gg mon 'allow service config-key wx' 2026-02-22T21:35:10.847 INFO:tasks.workunit.client.0.trial023.stdout:[client.fail_gg] 2026-02-22T21:35:10.847 INFO:tasks.workunit.client.0.trial023.stdout: key = AQCOdptpLLc2LhAAYaNDcoIvnvj8Y7gs+/rt1g== 2026-02-22T21:35:10.858 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph auth get-or-create client.fail_writes mon 'allow service config-key rx' 2026-02-22T21:35:11.097 INFO:tasks.workunit.client.0.trial023.stdout:[client.fail_writes] 2026-02-22T21:35:11.097 INFO:tasks.workunit.client.0.trial023.stdout: key = AQCPdptpxSJ6ARAAF9WlVVrDrVRbAc87CKOAGw== 2026-02-22T21:35:11.107 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph auth export -o /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:11.358 INFO:tasks.workunit.client.0.trial023.stderr:+ for c in $allow_aa $allow_bb $allow_cc $mgr_a $mgr_b 2026-02-22T21:35:11.358 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.allow_aa config-key get daemon-private/osd.123/test-foo 2026-02-22T21:35:11.629 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.allow_aa config-key get mgr/test-foo 2026-02-22T21:35:11.905 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.allow_aa config-key get device/test-foo 2026-02-22T21:35:12.163 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.allow_aa config-key get test/foo 2026-02-22T21:35:18.459 INFO:tasks.workunit.client.0.trial023.stderr:+ for c in $allow_aa $allow_bb $allow_cc $mgr_a $mgr_b 2026-02-22T21:35:18.460 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.allow_bb config-key get daemon-private/osd.123/test-foo 2026-02-22T21:35:18.748 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.allow_bb config-key get mgr/test-foo 2026-02-22T21:35:19.004 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.allow_bb config-key get device/test-foo 2026-02-22T21:35:19.258 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.allow_bb config-key get test/foo 2026-02-22T21:35:19.531 INFO:tasks.workunit.client.0.trial023.stderr:+ for c in $allow_aa $allow_bb $allow_cc $mgr_a $mgr_b 2026-02-22T21:35:19.531 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.allow_cc config-key get daemon-private/osd.123/test-foo 2026-02-22T21:35:19.803 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.allow_cc config-key get mgr/test-foo 2026-02-22T21:35:23.081 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.allow_cc config-key get device/test-foo 2026-02-22T21:35:23.357 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.allow_cc config-key get test/foo 2026-02-22T21:35:23.621 INFO:tasks.workunit.client.0.trial023.stderr:+ for c in $allow_aa $allow_bb $allow_cc $mgr_a $mgr_b 2026-02-22T21:35:23.621 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name mgr.a config-key get daemon-private/osd.123/test-foo 2026-02-22T21:35:23.676 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding auth protocol: cephx 2026-02-22T21:35:23.676 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 20 AuthRegistry(0x7f7e3c067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:23.676 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding auth protocol: cephx 2026-02-22T21:35:23.676 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 20 AuthRegistry(0x7f7e3c067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:23.676 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding auth protocol: cephx 2026-02-22T21:35:23.676 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 20 AuthRegistry(0x7f7e3c067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:23.676 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding con mode: secure 2026-02-22T21:35:23.676 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding con mode: crc 2026-02-22T21:35:23.676 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 20 AuthRegistry(0x7f7e3c067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:23.677 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding con mode: secure 2026-02-22T21:35:23.677 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding con mode: crc 2026-02-22T21:35:23.677 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 20 AuthRegistry(0x7f7e3c067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:23.677 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding con mode: secure 2026-02-22T21:35:23.677 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding con mode: crc 2026-02-22T21:35:23.677 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 20 AuthRegistry(0x7f7e3c067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:23.677 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding con mode: crc 2026-02-22T21:35:23.677 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding con mode: secure 2026-02-22T21:35:23.677 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 20 AuthRegistry(0x7f7e3c067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:23.677 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding con mode: crc 2026-02-22T21:35:23.677 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding con mode: secure 2026-02-22T21:35:23.677 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 20 AuthRegistry(0x7f7e3c067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:23.677 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding con mode: crc 2026-02-22T21:35:23.677 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding con mode: secure 2026-02-22T21:35:23.677 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 20 AuthRegistry(0x7f7e3c067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:23.677 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 10 AuthRegistry(0x7f7e3c067010) _refresh_config cluster_methods [2] service_methods [2] client_methods [2] 2026-02-22T21:35:23.677 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 10 AuthRegistry(0x7f7e3c067010) _refresh_config mon_cluster_modes [2,1] mon_service_modes [2,1] mon_client_modes [2,1]; cluster_modes [1,2] service_modes [1,2] client_modes [1,2] 2026-02-22T21:35:23.677 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2026-02-22T21:35:23.677 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding auth protocol: cephx 2026-02-22T21:35:23.677 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 20 AuthRegistry(0x7f7e3c067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:23.677 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding auth protocol: cephx 2026-02-22T21:35:23.677 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 20 AuthRegistry(0x7f7e3c067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:23.677 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding auth protocol: cephx 2026-02-22T21:35:23.677 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 20 AuthRegistry(0x7f7e3c067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:23.677 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding con mode: secure 2026-02-22T21:35:23.677 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding con mode: crc 2026-02-22T21:35:23.677 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 20 AuthRegistry(0x7f7e3c067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:23.677 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding con mode: secure 2026-02-22T21:35:23.677 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding con mode: crc 2026-02-22T21:35:23.677 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 20 AuthRegistry(0x7f7e3c067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:23.677 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding con mode: secure 2026-02-22T21:35:23.677 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding con mode: crc 2026-02-22T21:35:23.677 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 20 AuthRegistry(0x7f7e3c067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:23.677 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding con mode: crc 2026-02-22T21:35:23.677 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding con mode: secure 2026-02-22T21:35:23.677 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 20 AuthRegistry(0x7f7e3c067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:23.677 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding con mode: crc 2026-02-22T21:35:23.677 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding con mode: secure 2026-02-22T21:35:23.678 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 20 AuthRegistry(0x7f7e3c067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:23.678 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding con mode: crc 2026-02-22T21:35:23.678 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding con mode: secure 2026-02-22T21:35:23.678 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 20 AuthRegistry(0x7f7e3c067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:23.678 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 10 AuthRegistry(0x7f7e3c067010) _refresh_config cluster_methods [2] service_methods [2] client_methods [2] 2026-02-22T21:35:23.678 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 10 AuthRegistry(0x7f7e3c067010) _refresh_config mon_cluster_modes [2,1] mon_service_modes [2,1] mon_client_modes [2,1]; cluster_modes [1,2] service_modes [1,2] client_modes [1,2] 2026-02-22T21:35:23.678 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:23.678 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 10 monclient: get_monmap_and_config 2026-02-22T21:35:23.678 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 10 monclient: build_initial_monmap 2026-02-22T21:35:23.678 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 10 monclient: monmap: 2026-02-22T21:35:23.678 INFO:tasks.workunit.client.0.trial023.stderr:epoch 0 2026-02-22T21:35:23.678 INFO:tasks.workunit.client.0.trial023.stderr:fsid e2dd7ed3-13e8-4519-aab8-5d5a54f80255 2026-02-22T21:35:23.678 INFO:tasks.workunit.client.0.trial023.stderr:last_changed 2026-02-22T21:35:23.675398+0000 2026-02-22T21:35:23.678 INFO:tasks.workunit.client.0.trial023.stderr:created 2026-02-22T21:35:23.675398+0000 2026-02-22T21:35:23.678 INFO:tasks.workunit.client.0.trial023.stderr:min_mon_release 0 (unknown) 2026-02-22T21:35:23.678 INFO:tasks.workunit.client.0.trial023.stderr:election_strategy: 3 2026-02-22T21:35:23.678 INFO:tasks.workunit.client.0.trial023.stderr:0: v1:10.20.193.23:6789/0 mon.noname-a 2026-02-22T21:35:23.678 INFO:tasks.workunit.client.0.trial023.stderr: 2026-02-22T21:35:23.678 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c068a80) adding auth protocol: cephx 2026-02-22T21:35:23.678 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 20 AuthRegistry(0x7f7e3c068a80) _parse_method_list cephx -> [2] 2026-02-22T21:35:23.678 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c068a80) adding auth protocol: cephx 2026-02-22T21:35:23.678 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 20 AuthRegistry(0x7f7e3c068a80) _parse_method_list cephx -> [2] 2026-02-22T21:35:23.678 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c068a80) adding auth protocol: cephx 2026-02-22T21:35:23.678 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 20 AuthRegistry(0x7f7e3c068a80) _parse_method_list cephx -> [2] 2026-02-22T21:35:23.678 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c068a80) adding con mode: secure 2026-02-22T21:35:23.678 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c068a80) adding con mode: crc 2026-02-22T21:35:23.678 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 20 AuthRegistry(0x7f7e3c068a80) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:23.678 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c068a80) adding con mode: secure 2026-02-22T21:35:23.678 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c068a80) adding con mode: crc 2026-02-22T21:35:23.678 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 20 AuthRegistry(0x7f7e3c068a80) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:23.678 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c068a80) adding con mode: secure 2026-02-22T21:35:23.678 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c068a80) adding con mode: crc 2026-02-22T21:35:23.678 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 20 AuthRegistry(0x7f7e3c068a80) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:23.678 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c068a80) adding con mode: crc 2026-02-22T21:35:23.678 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c068a80) adding con mode: secure 2026-02-22T21:35:23.678 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 20 AuthRegistry(0x7f7e3c068a80) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:23.678 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c068a80) adding con mode: crc 2026-02-22T21:35:23.678 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c068a80) adding con mode: secure 2026-02-22T21:35:23.678 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 20 AuthRegistry(0x7f7e3c068a80) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:23.679 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c068a80) adding con mode: crc 2026-02-22T21:35:23.679 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c068a80) adding con mode: secure 2026-02-22T21:35:23.679 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 20 AuthRegistry(0x7f7e3c068a80) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:23.679 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 10 AuthRegistry(0x7f7e3c068a80) _refresh_config cluster_methods [2] service_methods [2] client_methods [2] 2026-02-22T21:35:23.679 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 10 AuthRegistry(0x7f7e3c068a80) _refresh_config mon_cluster_modes [2,1] mon_service_modes [2,1] mon_client_modes [2,1]; cluster_modes [1,2] service_modes [1,2] client_modes [1,2] 2026-02-22T21:35:23.679 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.668+0000 7f7e42914640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:23.681 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 1 Processor -- start 2026-02-22T21:35:23.681 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 1 -- start start 2026-02-22T21:35:23.681 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 10 monclient: init 2026-02-22T21:35:23.681 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e42912f50) adding auth protocol: cephx 2026-02-22T21:35:23.682 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 20 AuthRegistry(0x7f7e42912f50) _parse_method_list cephx -> [2] 2026-02-22T21:35:23.682 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e42912f50) adding auth protocol: cephx 2026-02-22T21:35:23.682 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 20 AuthRegistry(0x7f7e42912f50) _parse_method_list cephx -> [2] 2026-02-22T21:35:23.682 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e42912f50) adding auth protocol: cephx 2026-02-22T21:35:23.682 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 20 AuthRegistry(0x7f7e42912f50) _parse_method_list cephx -> [2] 2026-02-22T21:35:23.682 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e42912f50) adding con mode: secure 2026-02-22T21:35:23.682 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e42912f50) adding con mode: crc 2026-02-22T21:35:23.682 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 20 AuthRegistry(0x7f7e42912f50) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:23.682 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e42912f50) adding con mode: secure 2026-02-22T21:35:23.682 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e42912f50) adding con mode: crc 2026-02-22T21:35:23.682 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 20 AuthRegistry(0x7f7e42912f50) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:23.682 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e42912f50) adding con mode: secure 2026-02-22T21:35:23.682 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e42912f50) adding con mode: crc 2026-02-22T21:35:23.682 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 20 AuthRegistry(0x7f7e42912f50) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:23.682 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e42912f50) adding con mode: crc 2026-02-22T21:35:23.682 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e42912f50) adding con mode: secure 2026-02-22T21:35:23.682 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 20 AuthRegistry(0x7f7e42912f50) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:23.682 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e42912f50) adding con mode: crc 2026-02-22T21:35:23.682 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e42912f50) adding con mode: secure 2026-02-22T21:35:23.682 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 20 AuthRegistry(0x7f7e42912f50) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:23.682 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e42912f50) adding con mode: crc 2026-02-22T21:35:23.682 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e42912f50) adding con mode: secure 2026-02-22T21:35:23.682 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 20 AuthRegistry(0x7f7e42912f50) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:23.682 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 10 AuthRegistry(0x7f7e42912f50) _refresh_config cluster_methods [2] service_methods [2] client_methods [2] 2026-02-22T21:35:23.682 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 10 AuthRegistry(0x7f7e42912f50) _refresh_config mon_cluster_modes [2,1] mon_service_modes [2,1] mon_client_modes [2,1]; cluster_modes [1,2] service_modes [1,2] client_modes [1,2] 2026-02-22T21:35:23.682 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:23.682 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:23.682 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 10 monclient: _reopen_session rank -1 2026-02-22T21:35:23.682 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 10 monclient: _add_conns ranks=[0] 2026-02-22T21:35:23.682 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 10 monclient(hunting): picked mon.noname-a con 0x7f7e3c06e5f0 addr v1:10.20.193.23:6789/0 2026-02-22T21:35:23.682 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 1 -- --> v1:10.20.193.23:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x7f7e3c1653e0 con 0x7f7e3c06e5f0 2026-02-22T21:35:23.682 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 10 monclient(hunting): _renew_subs 2026-02-22T21:35:23.682 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 10 monclient(hunting): authenticate will time out at 595.893048s 2026-02-22T21:35:23.682 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3bfff640 1 --1- >> v1:10.20.193.23:6789/0 conn(0x7f7e3c06e5f0 0x7f7e3c06e9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.23:6789/0 says I am v1:10.20.193.23:43268/0 (socket says 10.20.193.23:43268) 2026-02-22T21:35:23.682 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3bfff640 1 -- 10.20.193.23:0/725861579 learned_addr learned my addr 10.20.193.23:0/725861579 (peer_addr_for_me v1:10.20.193.23:0/0) 2026-02-22T21:35:23.682 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 1 -- 10.20.193.23:0/725861579 <== mon.0 v1:10.20.193.23:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 591613901 0 0) 0x7f7e3c1653e0 con 0x7f7e3c06e5f0 2026-02-22T21:35:23.682 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 10 monclient(hunting): _negotiate 2026-02-22T21:35:23.682 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:35:23.682 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:35:23.682 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 10 cephx client: reset 2026-02-22T21:35:23.682 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 10 cephx: set_have_need_key no handler for service auth 2026-02-22T21:35:23.682 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 10 cephx: validate_tickets want 32 have 0 need 32 2026-02-22T21:35:23.682 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 10 cephx client: reset 2026-02-22T21:35:23.683 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 10 monclient(hunting): my global_id is 4244 2026-02-22T21:35:23.683 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 10 cephx client: 0x7f7e20003550 handle_response ret = 0 2026-02-22T21:35:23.683 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 10 cephx client: got initial server challenge 28b21aea67427454 2026-02-22T21:35:23.683 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 10 cephx client: validate_tickets: want=32 need=32 have=0 2026-02-22T21:35:23.683 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 10 cephx: set_have_need_key no handler for service auth 2026-02-22T21:35:23.683 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 10 cephx: validate_tickets want 32 have 0 need 32 2026-02-22T21:35:23.683 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 10 cephx client: want=32 need=32 have=0 2026-02-22T21:35:23.683 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 10 cephx client: build_request 2026-02-22T21:35:23.683 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 10 cephx client: get auth session key: client_challenge 57a82aeae4940970 2026-02-22T21:35:23.683 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 1 -- 10.20.193.23:0/725861579 --> v1:10.20.193.23:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e20003630 con 0x7f7e3c06e5f0 2026-02-22T21:35:23.683 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 1 -- 10.20.193.23:0/725861579 <== mon.0 v1:10.20.193.23:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1099399965 0 0) 0x7f7e20003630 con 0x7f7e3c06e5f0 2026-02-22T21:35:23.683 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 10 cephx client: 0x7f7e20003550 handle_response ret = 0 2026-02-22T21:35:23.683 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 10 cephx client: get_auth_session_key 2026-02-22T21:35:23.683 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 10 cephx: verify_service_ticket_reply got 1 keys 2026-02-22T21:35:23.683 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 10 cephx: got key for service_id auth 2026-02-22T21:35:23.683 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 10 cephx: verify_service_ticket_reply ticket.secret_id=2 2026-02-22T21:35:23.683 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 10 cephx: verify_service_ticket_reply service auth secret_id 2 session_key AQCbdptpkGphKBAAoQ3pLa0DMA5hnVDJMKveaw== validity=660.000000 2026-02-22T21:35:23.683 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 10 cephx: verify_service_ticket_reply ticket expires=2026-02-22T21:46:23.677548+0000 renew_after=2026-02-22T21:43:38.677548+0000 2026-02-22T21:35:23.683 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 10 cephx client: want=32 need=32 have=0 2026-02-22T21:35:23.683 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 10 cephx client: got connection bl 0 and extra tickets 0 2026-02-22T21:35:23.683 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 10 cephx: validate_tickets want 32 have 32 need 0 2026-02-22T21:35:23.683 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 10 monclient: _finish_hunting 0 2026-02-22T21:35:23.683 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 1 monclient: found mon.noname-a 2026-02-22T21:35:23.683 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.23:6789/0 2026-02-22T21:35:23.683 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 1 -- 10.20.193.23:0/725861579 --> v1:10.20.193.23:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e3c0cdfc0 con 0x7f7e3c06e5f0 2026-02-22T21:35:23.683 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 10 monclient: _finish_auth 0 2026-02-22T21:35:23.683 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 10 monclient: _check_auth_tickets 2026-02-22T21:35:23.683 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 10 cephx: validate_tickets want 32 have 32 need 0 2026-02-22T21:35:23.683 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 20 cephx client: need_tickets: want=32 have=32 need=0 2026-02-22T21:35:23.683 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 10 monclient: _check_auth_rotating renewing rotating keys (they expired before 2026-02-22T21:34:53.677562+0000) 2026-02-22T21:35:23.683 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 10 cephx client: build_rotating_request 2026-02-22T21:35:23.683 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.23:6789/0 2026-02-22T21:35:23.683 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 1 -- 10.20.193.23:0/725861579 --> v1:10.20.193.23:6789/0 -- auth(proto 2 2 bytes epoch 0) -- 0x7f7e3c1653e0 con 0x7f7e3c06e5f0 2026-02-22T21:35:23.683 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 1 -- 10.20.193.23:0/725861579 <== mon.0 v1:10.20.193.23:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7f7e28002e20 con 0x7f7e3c06e5f0 2026-02-22T21:35:23.683 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:35:23.683 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T21:35:23.683 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 10 monclient: dump: 2026-02-22T21:35:23.683 INFO:tasks.workunit.client.0.trial023.stderr:epoch 1 2026-02-22T21:35:23.683 INFO:tasks.workunit.client.0.trial023.stderr:fsid e2dd7ed3-13e8-4519-aab8-5d5a54f80255 2026-02-22T21:35:23.683 INFO:tasks.workunit.client.0.trial023.stderr:last_changed 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:23.683 INFO:tasks.workunit.client.0.trial023.stderr:created 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:23.683 INFO:tasks.workunit.client.0.trial023.stderr:min_mon_release 19 (squid) 2026-02-22T21:35:23.683 INFO:tasks.workunit.client.0.trial023.stderr:election_strategy: 3 2026-02-22T21:35:23.684 INFO:tasks.workunit.client.0.trial023.stderr:0: v1:10.20.193.23:6789/0 mon.a 2026-02-22T21:35:23.684 INFO:tasks.workunit.client.0.trial023.stderr: 2026-02-22T21:35:23.684 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 monclient: authenticate success, global_id 4244 2026-02-22T21:35:23.684 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 1 -- 10.20.193.23:0/725861579 <== mon.0 v1:10.20.193.23:6789/0 4 ==== config(1 keys) ==== 25+0+0 (unknown 1514702568 0 0) 0x7f7e280030a0 con 0x7f7e3c06e5f0 2026-02-22T21:35:23.684 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 10 monclient: handle_config config(1 keys) 2026-02-22T21:35:23.684 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 1 -- 10.20.193.23:0/725861579 <== mon.0 v1:10.20.193.23:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7f7e28003510 con 0x7f7e3c06e5f0 2026-02-22T21:35:23.684 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:35:23.684 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T21:35:23.684 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 10 monclient: dump: 2026-02-22T21:35:23.684 INFO:tasks.workunit.client.0.trial023.stderr:epoch 1 2026-02-22T21:35:23.684 INFO:tasks.workunit.client.0.trial023.stderr:fsid e2dd7ed3-13e8-4519-aab8-5d5a54f80255 2026-02-22T21:35:23.684 INFO:tasks.workunit.client.0.trial023.stderr:last_changed 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:23.684 INFO:tasks.workunit.client.0.trial023.stderr:created 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:23.684 INFO:tasks.workunit.client.0.trial023.stderr:min_mon_release 19 (squid) 2026-02-22T21:35:23.684 INFO:tasks.workunit.client.0.trial023.stderr:election_strategy: 3 2026-02-22T21:35:23.684 INFO:tasks.workunit.client.0.trial023.stderr:0: v1:10.20.193.23:6789/0 mon.a 2026-02-22T21:35:23.684 INFO:tasks.workunit.client.0.trial023.stderr: 2026-02-22T21:35:23.684 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 10 monclient: get_monmap_and_config success 2026-02-22T21:35:23.684 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 4 set_mon_vals no callback set 2026-02-22T21:35:23.684 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 10 set_mon_vals mgr_pool = false 2026-02-22T21:35:23.684 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 1 -- 10.20.193.23:0/725861579 <== mon.0 v1:10.20.193.23:6789/0 6 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (unknown 600101383 0 0) 0x7f7e3c1653e0 con 0x7f7e3c06e5f0 2026-02-22T21:35:23.684 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 10 cephx client: 0x7f7e20003550 handle_response ret = 0 2026-02-22T21:35:23.684 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 10 cephx client: get_rotating_key 2026-02-22T21:35:23.684 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 10 auth: dump_rotating: 2026-02-22T21:35:23.684 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 10 auth: id 1 AQBddptpfYjTLhAAXh1N3uFywlax+2y6vwZmsw== expires 2026-02-22T21:38:21.785614+0000 2026-02-22T21:35:23.684 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 10 auth: id 2 AQBddptpiI/TLhAAdz7mEzTpWi2a8fttyDShuw== expires 2026-02-22T21:42:21.785614+0000 2026-02-22T21:35:23.684 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 10 auth: id 3 AQBddptpNJfTLhAA8yUoZRot9tLYY9D+lZZAdA== expires 2026-02-22T21:46:21.785614+0000 2026-02-22T21:35:23.684 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 10 monclient: _finish_auth 0 2026-02-22T21:35:23.684 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 10 monclient: _check_auth_tickets 2026-02-22T21:35:23.684 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 10 cephx: validate_tickets want 32 have 32 need 0 2026-02-22T21:35:23.684 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 20 cephx client: need_tickets: want=32 have=32 need=0 2026-02-22T21:35:23.684 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2026-02-22T21:34:53.677673+0000) 2026-02-22T21:35:23.684 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 10 auth: dump_rotating: 2026-02-22T21:35:23.684 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 10 auth: id 1 AQBddptpfYjTLhAAXh1N3uFywlax+2y6vwZmsw== expires 2026-02-22T21:38:21.785614+0000 2026-02-22T21:35:23.684 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 10 auth: id 2 AQBddptpiI/TLhAAdz7mEzTpWi2a8fttyDShuw== expires 2026-02-22T21:42:21.785614+0000 2026-02-22T21:35:23.684 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3affd640 10 auth: id 3 AQBddptpNJfTLhAA8yUoZRot9tLYY9D+lZZAdA== expires 2026-02-22T21:46:21.785614+0000 2026-02-22T21:35:23.684 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 10 monclient: shutdown 2026-02-22T21:35:23.684 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 1 -- 10.20.193.23:0/725861579 >> v1:10.20.193.23:6789/0 conn(0x7f7e3c06e5f0 legacy=0x7f7e3c06e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:35:23.684 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 1 -- 10.20.193.23:0/725861579 shutdown_connections 2026-02-22T21:35:23.684 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 1 -- 10.20.193.23:0/725861579 >> 10.20.193.23:0/725861579 conn(0x7f7e3c06e1e0 msgr2=0x7f7e3c0bf590 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:35:23.684 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 1 -- 10.20.193.23:0/725861579 shutdown_connections 2026-02-22T21:35:23.684 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 1 -- 10.20.193.23:0/725861579 wait complete. 2026-02-22T21:35:23.684 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding auth protocol: cephx 2026-02-22T21:35:23.684 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 20 AuthRegistry(0x7f7e3c067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:23.685 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding auth protocol: cephx 2026-02-22T21:35:23.685 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 20 AuthRegistry(0x7f7e3c067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:23.685 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding auth protocol: cephx 2026-02-22T21:35:23.685 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 20 AuthRegistry(0x7f7e3c067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:23.685 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding con mode: secure 2026-02-22T21:35:23.685 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding con mode: crc 2026-02-22T21:35:23.685 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 20 AuthRegistry(0x7f7e3c067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:23.685 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding con mode: secure 2026-02-22T21:35:23.685 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding con mode: crc 2026-02-22T21:35:23.685 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 20 AuthRegistry(0x7f7e3c067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:23.685 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding con mode: secure 2026-02-22T21:35:23.685 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding con mode: crc 2026-02-22T21:35:23.685 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 20 AuthRegistry(0x7f7e3c067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:23.685 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding con mode: crc 2026-02-22T21:35:23.685 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding con mode: secure 2026-02-22T21:35:23.685 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 20 AuthRegistry(0x7f7e3c067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:23.685 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding con mode: crc 2026-02-22T21:35:23.685 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding con mode: secure 2026-02-22T21:35:23.685 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 20 AuthRegistry(0x7f7e3c067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:23.685 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding con mode: crc 2026-02-22T21:35:23.685 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding con mode: secure 2026-02-22T21:35:23.685 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 20 AuthRegistry(0x7f7e3c067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:23.685 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 10 AuthRegistry(0x7f7e3c067010) _refresh_config cluster_methods [2] service_methods [2] client_methods [2] 2026-02-22T21:35:23.685 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 10 AuthRegistry(0x7f7e3c067010) _refresh_config mon_cluster_modes [2,1] mon_service_modes [2,1] mon_client_modes [2,1]; cluster_modes [1,2] service_modes [1,2] client_modes [1,2] 2026-02-22T21:35:23.685 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:23.685 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 10 monclient: build_initial_monmap 2026-02-22T21:35:23.685 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 10 monclient: monmap: 2026-02-22T21:35:23.685 INFO:tasks.workunit.client.0.trial023.stderr:epoch 0 2026-02-22T21:35:23.685 INFO:tasks.workunit.client.0.trial023.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T21:35:23.685 INFO:tasks.workunit.client.0.trial023.stderr:last_changed 0.000000 2026-02-22T21:35:23.685 INFO:tasks.workunit.client.0.trial023.stderr:created 0.000000 2026-02-22T21:35:23.685 INFO:tasks.workunit.client.0.trial023.stderr:min_mon_release 0 (unknown) 2026-02-22T21:35:23.685 INFO:tasks.workunit.client.0.trial023.stderr:election_strategy: 1 2026-02-22T21:35:23.685 INFO:tasks.workunit.client.0.trial023.stderr:0: v1:10.20.193.23:6789/0 mon.noname-a 2026-02-22T21:35:23.685 INFO:tasks.workunit.client.0.trial023.stderr: 2026-02-22T21:35:23.685 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c06eaa0) adding auth protocol: cephx 2026-02-22T21:35:23.685 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 20 AuthRegistry(0x7f7e3c06eaa0) _parse_method_list cephx -> [2] 2026-02-22T21:35:23.685 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c06eaa0) adding auth protocol: cephx 2026-02-22T21:35:23.685 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 20 AuthRegistry(0x7f7e3c06eaa0) _parse_method_list cephx -> [2] 2026-02-22T21:35:23.685 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c06eaa0) adding auth protocol: cephx 2026-02-22T21:35:23.685 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 20 AuthRegistry(0x7f7e3c06eaa0) _parse_method_list cephx -> [2] 2026-02-22T21:35:23.685 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c06eaa0) adding con mode: secure 2026-02-22T21:35:23.685 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c06eaa0) adding con mode: crc 2026-02-22T21:35:23.685 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 20 AuthRegistry(0x7f7e3c06eaa0) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:23.685 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c06eaa0) adding con mode: secure 2026-02-22T21:35:23.686 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c06eaa0) adding con mode: crc 2026-02-22T21:35:23.686 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 20 AuthRegistry(0x7f7e3c06eaa0) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:23.686 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c06eaa0) adding con mode: secure 2026-02-22T21:35:23.686 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c06eaa0) adding con mode: crc 2026-02-22T21:35:23.686 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 20 AuthRegistry(0x7f7e3c06eaa0) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:23.686 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c06eaa0) adding con mode: crc 2026-02-22T21:35:23.686 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c06eaa0) adding con mode: secure 2026-02-22T21:35:23.686 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 20 AuthRegistry(0x7f7e3c06eaa0) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:23.686 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c06eaa0) adding con mode: crc 2026-02-22T21:35:23.686 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c06eaa0) adding con mode: secure 2026-02-22T21:35:23.686 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 20 AuthRegistry(0x7f7e3c06eaa0) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:23.686 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c06eaa0) adding con mode: crc 2026-02-22T21:35:23.686 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c06eaa0) adding con mode: secure 2026-02-22T21:35:23.686 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 20 AuthRegistry(0x7f7e3c06eaa0) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:23.686 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 10 AuthRegistry(0x7f7e3c06eaa0) _refresh_config cluster_methods [2] service_methods [2] client_methods [2] 2026-02-22T21:35:23.686 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 10 AuthRegistry(0x7f7e3c06eaa0) _refresh_config mon_cluster_modes [2,1] mon_service_modes [2,1] mon_client_modes [2,1]; cluster_modes [1,2] service_modes [1,2] client_modes [1,2] 2026-02-22T21:35:23.686 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:23.686 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 1 Processor -- start 2026-02-22T21:35:23.686 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 1 -- start start 2026-02-22T21:35:23.686 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 10 monclient: init 2026-02-22T21:35:23.686 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding auth protocol: cephx 2026-02-22T21:35:23.686 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 20 AuthRegistry(0x7f7e3c067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:23.686 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding auth protocol: cephx 2026-02-22T21:35:23.686 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 20 AuthRegistry(0x7f7e3c067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:23.686 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding auth protocol: cephx 2026-02-22T21:35:23.686 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 20 AuthRegistry(0x7f7e3c067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:23.686 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding con mode: secure 2026-02-22T21:35:23.686 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding con mode: crc 2026-02-22T21:35:23.686 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 20 AuthRegistry(0x7f7e3c067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:23.686 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding con mode: secure 2026-02-22T21:35:23.686 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding con mode: crc 2026-02-22T21:35:23.686 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 20 AuthRegistry(0x7f7e3c067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:23.686 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding con mode: secure 2026-02-22T21:35:23.686 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding con mode: crc 2026-02-22T21:35:23.686 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 20 AuthRegistry(0x7f7e3c067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:23.686 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding con mode: crc 2026-02-22T21:35:23.686 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding con mode: secure 2026-02-22T21:35:23.686 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 20 AuthRegistry(0x7f7e3c067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:23.686 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding con mode: crc 2026-02-22T21:35:23.686 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding con mode: secure 2026-02-22T21:35:23.686 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 20 AuthRegistry(0x7f7e3c067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:23.686 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding con mode: crc 2026-02-22T21:35:23.686 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 AuthRegistry(0x7f7e3c067010) adding con mode: secure 2026-02-22T21:35:23.686 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 20 AuthRegistry(0x7f7e3c067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:23.686 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 10 AuthRegistry(0x7f7e3c067010) _refresh_config cluster_methods [2] service_methods [2] client_methods [2] 2026-02-22T21:35:23.686 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 10 AuthRegistry(0x7f7e3c067010) _refresh_config mon_cluster_modes [2,1] mon_service_modes [2,1] mon_client_modes [2,1]; cluster_modes [1,2] service_modes [1,2] client_modes [1,2] 2026-02-22T21:35:23.687 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:23.687 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:23.687 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 10 monclient: _reopen_session rank -1 2026-02-22T21:35:23.687 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 10 monclient: _add_conns ranks=[0] 2026-02-22T21:35:23.687 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 10 monclient(hunting): picked mon.noname-a con 0x7f7e3c06e5f0 addr v1:10.20.193.23:6789/0 2026-02-22T21:35:23.687 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 1 -- --> v1:10.20.193.23:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x7f7e3c148390 con 0x7f7e3c06e5f0 2026-02-22T21:35:23.687 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 10 monclient(hunting): _renew_subs 2026-02-22T21:35:23.687 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 10 monclient(hunting): authenticate will time out at 595.895010s 2026-02-22T21:35:23.687 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3bfff640 1 --1- >> v1:10.20.193.23:6789/0 conn(0x7f7e3c06e5f0 0x7f7e3c14c250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.23:6789/0 says I am v1:10.20.193.23:43284/0 (socket says 10.20.193.23:43284) 2026-02-22T21:35:23.687 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3bfff640 1 -- 10.20.193.23:0/3202464955 learned_addr learned my addr 10.20.193.23:0/3202464955 (peer_addr_for_me v1:10.20.193.23:0/0) 2026-02-22T21:35:23.687 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 1 -- 10.20.193.23:0/3202464955 <== mon.0 v1:10.20.193.23:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3413448393 0 0) 0x7f7e3c0cdfc0 con 0x7f7e3c06e5f0 2026-02-22T21:35:23.687 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 monclient(hunting): _negotiate 2026-02-22T21:35:23.687 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:35:23.687 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:35:23.687 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx client: reset 2026-02-22T21:35:23.687 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx: set_have_need_key no handler for service mon 2026-02-22T21:35:23.687 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx: set_have_need_key no handler for service osd 2026-02-22T21:35:23.687 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx: set_have_need_key no handler for service mgr 2026-02-22T21:35:23.687 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx: set_have_need_key no handler for service auth 2026-02-22T21:35:23.687 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx: validate_tickets want 53 have 0 need 53 2026-02-22T21:35:23.687 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx client: reset 2026-02-22T21:35:23.687 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 monclient(hunting): my global_id is 4245 2026-02-22T21:35:23.687 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx client: 0x7f7e10003550 handle_response ret = 0 2026-02-22T21:35:23.687 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx client: got initial server challenge d6278560a0b05b8d 2026-02-22T21:35:23.687 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx client: validate_tickets: want=53 need=53 have=0 2026-02-22T21:35:23.687 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx: set_have_need_key no handler for service mon 2026-02-22T21:35:23.687 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx: set_have_need_key no handler for service osd 2026-02-22T21:35:23.687 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx: set_have_need_key no handler for service mgr 2026-02-22T21:35:23.687 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx: set_have_need_key no handler for service auth 2026-02-22T21:35:23.687 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx: validate_tickets want 53 have 0 need 53 2026-02-22T21:35:23.687 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx client: want=53 need=53 have=0 2026-02-22T21:35:23.687 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx client: build_request 2026-02-22T21:35:23.687 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx client: get auth session key: client_challenge f1b6934c4c2a83af 2026-02-22T21:35:23.687 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 1 -- 10.20.193.23:0/3202464955 --> v1:10.20.193.23:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e10003630 con 0x7f7e3c06e5f0 2026-02-22T21:35:23.687 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 1 -- 10.20.193.23:0/3202464955 <== mon.0 v1:10.20.193.23:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 732+0+0 (unknown 2467310319 0 0) 0x7f7e10003630 con 0x7f7e3c06e5f0 2026-02-22T21:35:23.687 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx client: 0x7f7e10003550 handle_response ret = 0 2026-02-22T21:35:23.687 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx client: get_auth_session_key 2026-02-22T21:35:23.687 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx: verify_service_ticket_reply got 1 keys 2026-02-22T21:35:23.687 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx: got key for service_id auth 2026-02-22T21:35:23.687 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx: verify_service_ticket_reply ticket.secret_id=2 2026-02-22T21:35:23.687 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx: verify_service_ticket_reply service auth secret_id 2 session_key AQCbdptp+LN+KBAAqFrwM+2uLutJWExseWUfJQ== validity=660.000000 2026-02-22T21:35:23.687 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx: verify_service_ticket_reply ticket expires=2026-02-22T21:46:23.679489+0000 renew_after=2026-02-22T21:43:38.679489+0000 2026-02-22T21:35:23.687 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx client: want=53 need=53 have=0 2026-02-22T21:35:23.687 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx client: got connection bl 0 and extra tickets 518 2026-02-22T21:35:23.687 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx: set_have_need_key no handler for service mon 2026-02-22T21:35:23.688 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx: set_have_need_key no handler for service osd 2026-02-22T21:35:23.688 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx: set_have_need_key no handler for service mgr 2026-02-22T21:35:23.688 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx: validate_tickets want 53 have 32 need 21 2026-02-22T21:35:23.688 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx client: validate_tickets: want=53 need=21 have=32 2026-02-22T21:35:23.688 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx: set_have_need_key no handler for service mon 2026-02-22T21:35:23.688 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx: set_have_need_key no handler for service osd 2026-02-22T21:35:23.688 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx: set_have_need_key no handler for service mgr 2026-02-22T21:35:23.688 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx: validate_tickets want 53 have 32 need 21 2026-02-22T21:35:23.688 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx client: want=53 need=21 have=32 2026-02-22T21:35:23.688 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx client: build_request 2026-02-22T21:35:23.688 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx client: get service keys: want=53 need=21 have=32 2026-02-22T21:35:23.688 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 1 -- 10.20.193.23:0/3202464955 --> v1:10.20.193.23:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7e3c0cdfc0 con 0x7f7e3c06e5f0 2026-02-22T21:35:23.688 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 1 -- 10.20.193.23:0/3202464955 <== mon.0 v1:10.20.193.23:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7f7e28002bd0 con 0x7f7e3c06e5f0 2026-02-22T21:35:23.688 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T21:35:23.688 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T21:35:23.688 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 monclient(hunting): dump: 2026-02-22T21:35:23.688 INFO:tasks.workunit.client.0.trial023.stderr:epoch 1 2026-02-22T21:35:23.688 INFO:tasks.workunit.client.0.trial023.stderr:fsid e2dd7ed3-13e8-4519-aab8-5d5a54f80255 2026-02-22T21:35:23.688 INFO:tasks.workunit.client.0.trial023.stderr:last_changed 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:23.688 INFO:tasks.workunit.client.0.trial023.stderr:created 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:23.688 INFO:tasks.workunit.client.0.trial023.stderr:min_mon_release 19 (squid) 2026-02-22T21:35:23.688 INFO:tasks.workunit.client.0.trial023.stderr:election_strategy: 3 2026-02-22T21:35:23.688 INFO:tasks.workunit.client.0.trial023.stderr:0: v1:10.20.193.23:6789/0 mon.a 2026-02-22T21:35:23.688 INFO:tasks.workunit.client.0.trial023.stderr: 2026-02-22T21:35:23.688 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 monclient(hunting): _finish_auth 0 2026-02-22T21:35:23.688 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 1 -- 10.20.193.23:0/3202464955 <== mon.0 v1:10.20.193.23:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 548+0+0 (unknown 4264331341 0 0) 0x7f7e3c0cdfc0 con 0x7f7e3c06e5f0 2026-02-22T21:35:23.688 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx client: 0x7f7e10003550 handle_response ret = 0 2026-02-22T21:35:23.688 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx client: get_principal_session_key session_key AQCbdptp+LN+KBAAqFrwM+2uLutJWExseWUfJQ== 2026-02-22T21:35:23.688 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx: verify_service_ticket_reply got 3 keys 2026-02-22T21:35:23.688 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx: got key for service_id mon 2026-02-22T21:35:23.688 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx: verify_service_ticket_reply ticket.secret_id=2 2026-02-22T21:35:23.688 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx: verify_service_ticket_reply service mon secret_id 2 session_key AQCbdptpfRmBKBAAoHIT1qs2ykx9DkAFk3ZsTg== validity=240.000000 2026-02-22T21:35:23.688 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx: verify_service_ticket_reply ticket expires=2026-02-22T21:39:23.679613+0000 renew_after=2026-02-22T21:38:23.679613+0000 2026-02-22T21:35:23.688 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx: got key for service_id osd 2026-02-22T21:35:23.688 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx: verify_service_ticket_reply ticket.secret_id=2 2026-02-22T21:35:23.688 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx: verify_service_ticket_reply service osd secret_id 2 session_key AQCbdptpCyGBKBAABHpBI0E9hJ59E1kVM1JyKA== validity=240.000000 2026-02-22T21:35:23.688 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx: verify_service_ticket_reply ticket expires=2026-02-22T21:39:23.679616+0000 renew_after=2026-02-22T21:38:23.679616+0000 2026-02-22T21:35:23.688 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx: got key for service_id mgr 2026-02-22T21:35:23.688 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx: verify_service_ticket_reply ticket.secret_id=2 2026-02-22T21:35:23.688 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx: verify_service_ticket_reply service mgr secret_id 2 session_key AQCbdptpjSqBKBAAeT7bwBcUtqJZRUevx1ZZdg== validity=240.000000 2026-02-22T21:35:23.688 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx: verify_service_ticket_reply ticket expires=2026-02-22T21:39:23.679619+0000 renew_after=2026-02-22T21:38:23.679619+0000 2026-02-22T21:35:23.688 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx: validate_tickets want 53 have 53 need 0 2026-02-22T21:35:23.688 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 monclient: _finish_hunting 0 2026-02-22T21:35:23.688 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 1 monclient: found mon.a 2026-02-22T21:35:23.688 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.23:6789/0 2026-02-22T21:35:23.689 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 1 -- 10.20.193.23:0/3202464955 --> v1:10.20.193.23:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e3c0bdb10 con 0x7f7e3c06e5f0 2026-02-22T21:35:23.689 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 monclient: _finish_auth 0 2026-02-22T21:35:23.689 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 monclient: _check_auth_tickets 2026-02-22T21:35:23.689 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx: validate_tickets want 53 have 53 need 0 2026-02-22T21:35:23.689 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 20 cephx client: need_tickets: want=53 have=53 need=0 2026-02-22T21:35:23.689 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 monclient: _check_auth_rotating renewing rotating keys (they expired before 2026-02-22T21:34:53.679629+0000) 2026-02-22T21:35:23.689 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx client: build_rotating_request 2026-02-22T21:35:23.689 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.23:6789/0 2026-02-22T21:35:23.689 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 1 -- 10.20.193.23:0/3202464955 --> v1:10.20.193.23:6789/0 -- auth(proto 2 2 bytes epoch 0) -- 0x7f7e10003630 con 0x7f7e3c06e5f0 2026-02-22T21:35:23.689 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 5 monclient: authenticate success, global_id 4245 2026-02-22T21:35:23.689 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 10 monclient: _renew_subs 2026-02-22T21:35:23.689 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.23:6789/0 2026-02-22T21:35:23.689 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 1 -- 10.20.193.23:0/3202464955 --> v1:10.20.193.23:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7e3c15e0e0 con 0x7f7e3c06e5f0 2026-02-22T21:35:23.689 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 10 monclient: _renew_subs 2026-02-22T21:35:23.689 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.23:6789/0 2026-02-22T21:35:23.689 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e42914640 1 -- 10.20.193.23:0/3202464955 --> v1:10.20.193.23:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7e3c1fa960 con 0x7f7e3c06e5f0 2026-02-22T21:35:23.689 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 1 -- 10.20.193.23:0/3202464955 <== mon.0 v1:10.20.193.23:6789/0 5 ==== config(1 keys) ==== 25+0+0 (unknown 1514702568 0 0) 0x7f7e280030a0 con 0x7f7e3c06e5f0 2026-02-22T21:35:23.689 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 monclient: handle_config config(1 keys) 2026-02-22T21:35:23.689 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 1 -- 10.20.193.23:0/3202464955 <== mon.0 v1:10.20.193.23:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7f7e28004cc0 con 0x7f7e3c06e5f0 2026-02-22T21:35:23.689 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:35:23.689 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T21:35:23.689 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 monclient: dump: 2026-02-22T21:35:23.689 INFO:tasks.workunit.client.0.trial023.stderr:epoch 1 2026-02-22T21:35:23.689 INFO:tasks.workunit.client.0.trial023.stderr:fsid e2dd7ed3-13e8-4519-aab8-5d5a54f80255 2026-02-22T21:35:23.689 INFO:tasks.workunit.client.0.trial023.stderr:last_changed 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:23.689 INFO:tasks.workunit.client.0.trial023.stderr:created 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:23.689 INFO:tasks.workunit.client.0.trial023.stderr:min_mon_release 19 (squid) 2026-02-22T21:35:23.689 INFO:tasks.workunit.client.0.trial023.stderr:election_strategy: 3 2026-02-22T21:35:23.689 INFO:tasks.workunit.client.0.trial023.stderr:0: v1:10.20.193.23:6789/0 mon.a 2026-02-22T21:35:23.689 INFO:tasks.workunit.client.0.trial023.stderr: 2026-02-22T21:35:23.689 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e3a7fc640 4 set_mon_vals no callback set 2026-02-22T21:35:23.689 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 1 -- 10.20.193.23:0/3202464955 <== mon.0 v1:10.20.193.23:6789/0 7 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (unknown 1264794232 0 0) 0x7f7e3c1fa960 con 0x7f7e3c06e5f0 2026-02-22T21:35:23.689 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx client: 0x7f7e10003550 handle_response ret = 0 2026-02-22T21:35:23.689 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx client: get_rotating_key 2026-02-22T21:35:23.689 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 auth: dump_rotating: 2026-02-22T21:35:23.689 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 auth: id 1 AQBddptpfYjTLhAAXh1N3uFywlax+2y6vwZmsw== expires 2026-02-22T21:38:21.785614+0000 2026-02-22T21:35:23.689 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 auth: id 2 AQBddptpiI/TLhAAdz7mEzTpWi2a8fttyDShuw== expires 2026-02-22T21:42:21.785614+0000 2026-02-22T21:35:23.689 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 auth: id 3 AQBddptpNJfTLhAA8yUoZRot9tLYY9D+lZZAdA== expires 2026-02-22T21:46:21.785614+0000 2026-02-22T21:35:23.689 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 monclient: _finish_auth 0 2026-02-22T21:35:23.689 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 monclient: _check_auth_tickets 2026-02-22T21:35:23.689 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 cephx: validate_tickets want 53 have 53 need 0 2026-02-22T21:35:23.689 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 20 cephx client: need_tickets: want=53 have=53 need=0 2026-02-22T21:35:23.689 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2026-02-22T21:34:53.679788+0000) 2026-02-22T21:35:23.689 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 auth: dump_rotating: 2026-02-22T21:35:23.690 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 auth: id 1 AQBddptpfYjTLhAAXh1N3uFywlax+2y6vwZmsw== expires 2026-02-22T21:38:21.785614+0000 2026-02-22T21:35:23.690 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 auth: id 2 AQBddptpiI/TLhAAdz7mEzTpWi2a8fttyDShuw== expires 2026-02-22T21:42:21.785614+0000 2026-02-22T21:35:23.690 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.672+0000 7f7e397fa640 10 auth: id 3 AQBddptpNJfTLhAA8yUoZRot9tLYY9D+lZZAdA== expires 2026-02-22T21:46:21.785614+0000 2026-02-22T21:35:23.690 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.676+0000 7f7e42914640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T21:35:23.690 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.676+0000 7f7e42914640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:35:23.690 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.676+0000 7f7e42914640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.23:6789/0 2026-02-22T21:35:23.690 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.676+0000 7f7e42914640 1 -- 10.20.193.23:0/3202464955 --> v1:10.20.193.23:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e3c09aae0 con 0x7f7e3c06e5f0 2026-02-22T21:35:23.690 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.676+0000 7f7e397fa640 1 -- 10.20.193.23:0/3202464955 <== mon.0 v1:10.20.193.23:6789/0 8 ==== mgrmap(e 4) ==== 47400+0+0 (unknown 1603120368 0 0) 0x7f7e28010900 con 0x7f7e3c06e5f0 2026-02-22T21:35:23.690 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.676+0000 7f7e397fa640 1 -- 10.20.193.23:0/3202464955 <== mon.0 v1:10.20.193.23:6789/0 9 ==== osd_map(14..14 src has 1..14) ==== 2160+0+0 (unknown 946035718 0 0) 0x7f7e28048ce0 con 0x7f7e3c06e5f0 2026-02-22T21:35:23.690 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.676+0000 7f7e3b7fe640 10 monclient: get_auth_request con 0x7f7e1003ba00 auth_method 0 2026-02-22T21:35:23.690 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.676+0000 7f7e3b7fe640 10 cephx client: build_authorizer for service mgr 2026-02-22T21:35:23.690 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.676+0000 7f7e3b7fe640 10 In get_auth_session_handler for protocol 2 2026-02-22T21:35:23.690 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.676+0000 7f7e397fa640 1 -- 10.20.193.23:0/3202464955 <== mon.0 v1:10.20.193.23:6789/0 10 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (unknown 1092875540 0 3570997608) 0x7f7e3c148390 con 0x7f7e3c06e5f0 2026-02-22T21:35:23.690 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.676+0000 7f7e397fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:35:23.690 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.676+0000 7f7e397fa640 10 monclient: _finish_command 1 = system:0 2026-02-22T21:35:23.796 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.788+0000 7f7e42914640 10 start_mon_command cmd=[{"prefix": "config-key get", "key": "daemon-private/osd.123/test-foo"}] 2026-02-22T21:35:23.796 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.788+0000 7f7e42914640 10 monclient: _send_command 2 [{"prefix": "config-key get", "key": "daemon-private/osd.123/test-foo"}] 2026-02-22T21:35:23.796 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.788+0000 7f7e42914640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.23:6789/0 2026-02-22T21:35:23.796 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.788+0000 7f7e42914640 1 -- 10.20.193.23:0/3202464955 --> v1:10.20.193.23:6789/0 -- mon_command({"prefix": "config-key get", "key": "daemon-private/osd.123/test-foo"} v 0) -- 0x7f7e3c14b870 con 0x7f7e3c06e5f0 2026-02-22T21:35:23.796 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.788+0000 7f7e397fa640 1 -- 10.20.193.23:0/3202464955 <== mon.0 v1:10.20.193.23:6789/0 11 ==== mon_command_ack([{"prefix": "config-key get", "key": "daemon-private/osd.123/test-foo"}]=0 v13) ==== 104+0+0 (unknown 3728622630 0 0) 0x7f7e28016970 con 0x7f7e3c06e5f0 2026-02-22T21:35:23.796 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.788+0000 7f7e397fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config-key get", "key": "daemon-private/osd.123/test-foo"}] 2026-02-22T21:35:23.796 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.788+0000 7f7e397fa640 10 monclient: _finish_command 2 = system:0 2026-02-22T21:35:23.877 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.868+0000 7f7e42914640 10 start_mon_command cmd=[{"prefix": "config-key get", "key": "daemon-private/osd.123/test-foo"}] 2026-02-22T21:35:23.878 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.868+0000 7f7e42914640 10 monclient: _send_command 3 [{"prefix": "config-key get", "key": "daemon-private/osd.123/test-foo"}] 2026-02-22T21:35:23.878 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.868+0000 7f7e42914640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.23:6789/0 2026-02-22T21:35:23.878 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.868+0000 7f7e42914640 1 -- 10.20.193.23:0/3202464955 --> v1:10.20.193.23:6789/0 -- mon_command({"prefix": "config-key get", "key": "daemon-private/osd.123/test-foo"} v 0) -- 0x7f7e3c0776b0 con 0x7f7e3c06e5f0 2026-02-22T21:35:23.878 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.872+0000 7f7e397fa640 1 -- 10.20.193.23:0/3202464955 <== mon.0 v1:10.20.193.23:6789/0 12 ==== mon_command_ack([{"prefix": "config-key get", "key": "daemon-private/osd.123/test-foo"}]=0 v13) ==== 104+0+0 (unknown 3728622630 0 0) 0x7f7e28016270 con 0x7f7e3c06e5f0 2026-02-22T21:35:23.878 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.872+0000 7f7e397fa640 10 monclient: handle_mon_command_ack 3 [{"prefix": "config-key get", "key": "daemon-private/osd.123/test-foo"}] 2026-02-22T21:35:23.878 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.872+0000 7f7e397fa640 10 monclient: _finish_command 3 = system:0 2026-02-22T21:35:23.878 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.872+0000 7f7e42914640 1 -- 10.20.193.23:0/3202464955 >> v1:10.20.193.23:6800/2834055528 conn(0x7f7e1003ba00 legacy=0x7f7e1003dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:35:23.878 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.872+0000 7f7e42914640 10 monclient: shutdown 2026-02-22T21:35:23.878 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.872+0000 7f7e42914640 1 -- 10.20.193.23:0/3202464955 >> v1:10.20.193.23:6789/0 conn(0x7f7e3c06e5f0 legacy=0x7f7e3c14c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:35:23.879 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.872+0000 7f7e42914640 1 -- 10.20.193.23:0/3202464955 shutdown_connections 2026-02-22T21:35:23.879 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.872+0000 7f7e42914640 1 -- 10.20.193.23:0/3202464955 >> 10.20.193.23:0/3202464955 conn(0x7f7e3c06e1e0 msgr2=0x7f7e3c15e610 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:35:23.879 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.872+0000 7f7e42914640 1 -- 10.20.193.23:0/3202464955 shutdown_connections 2026-02-22T21:35:23.879 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.872+0000 7f7e42914640 1 -- 10.20.193.23:0/3202464955 wait complete. 2026-02-22T21:35:23.887 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name mgr.a config-key get mgr/test-foo 2026-02-22T21:35:23.952 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.932+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding auth protocol: cephx 2026-02-22T21:35:23.952 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.932+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cec067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:23.952 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.932+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding auth protocol: cephx 2026-02-22T21:35:23.952 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.932+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cec067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:23.952 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.932+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding auth protocol: cephx 2026-02-22T21:35:23.952 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.932+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cec067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:23.952 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.932+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding con mode: secure 2026-02-22T21:35:23.952 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.932+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding con mode: crc 2026-02-22T21:35:23.953 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.932+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cec067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:23.953 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.932+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding con mode: secure 2026-02-22T21:35:23.953 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.932+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding con mode: crc 2026-02-22T21:35:23.953 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.932+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cec067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:23.953 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.932+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding con mode: secure 2026-02-22T21:35:23.953 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.932+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding con mode: crc 2026-02-22T21:35:23.953 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.932+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cec067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:23.953 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.932+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding con mode: crc 2026-02-22T21:35:23.953 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.932+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding con mode: secure 2026-02-22T21:35:23.953 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.932+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cec067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:23.953 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.932+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding con mode: crc 2026-02-22T21:35:23.953 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.932+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding con mode: secure 2026-02-22T21:35:23.954 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.932+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cec067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:23.954 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.932+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding con mode: crc 2026-02-22T21:35:23.954 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.932+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding con mode: secure 2026-02-22T21:35:23.954 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.932+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cec067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:23.954 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.932+0000 7f5cf2f45640 10 AuthRegistry(0x7f5cec067010) _refresh_config cluster_methods [2] service_methods [2] client_methods [2] 2026-02-22T21:35:23.954 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.932+0000 7f5cf2f45640 10 AuthRegistry(0x7f5cec067010) _refresh_config mon_cluster_modes [2,1] mon_service_modes [2,1] mon_client_modes [2,1]; cluster_modes [1,2] service_modes [1,2] client_modes [1,2] 2026-02-22T21:35:23.954 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.932+0000 7f5cf2f45640 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2026-02-22T21:35:23.954 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.932+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding auth protocol: cephx 2026-02-22T21:35:23.954 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.932+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cec067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:23.954 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.932+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding auth protocol: cephx 2026-02-22T21:35:23.954 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.932+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cec067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:23.954 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.932+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding auth protocol: cephx 2026-02-22T21:35:23.954 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.932+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cec067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:23.955 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.932+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding con mode: secure 2026-02-22T21:35:23.955 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.932+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding con mode: crc 2026-02-22T21:35:23.955 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.932+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cec067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:23.955 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.932+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding con mode: secure 2026-02-22T21:35:23.955 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.932+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding con mode: crc 2026-02-22T21:35:23.955 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.932+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cec067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:23.955 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.932+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding con mode: secure 2026-02-22T21:35:23.955 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.932+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding con mode: crc 2026-02-22T21:35:23.955 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.932+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cec067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:23.955 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.932+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding con mode: crc 2026-02-22T21:35:23.955 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.932+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding con mode: secure 2026-02-22T21:35:23.955 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.932+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cec067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:23.956 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.932+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding con mode: crc 2026-02-22T21:35:23.956 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.932+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding con mode: secure 2026-02-22T21:35:23.956 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.932+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cec067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:23.956 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.932+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding con mode: crc 2026-02-22T21:35:23.956 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.932+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding con mode: secure 2026-02-22T21:35:23.956 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.932+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cec067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:23.956 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.932+0000 7f5cf2f45640 10 AuthRegistry(0x7f5cec067010) _refresh_config cluster_methods [2] service_methods [2] client_methods [2] 2026-02-22T21:35:23.956 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.932+0000 7f5cf2f45640 10 AuthRegistry(0x7f5cec067010) _refresh_config mon_cluster_modes [2,1] mon_service_modes [2,1] mon_client_modes [2,1]; cluster_modes [1,2] service_modes [1,2] client_modes [1,2] 2026-02-22T21:35:23.956 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:23.956 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 10 monclient: get_monmap_and_config 2026-02-22T21:35:23.956 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 10 monclient: build_initial_monmap 2026-02-22T21:35:23.956 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 10 monclient: monmap: 2026-02-22T21:35:23.957 INFO:tasks.workunit.client.0.trial023.stderr:epoch 0 2026-02-22T21:35:23.957 INFO:tasks.workunit.client.0.trial023.stderr:fsid e2dd7ed3-13e8-4519-aab8-5d5a54f80255 2026-02-22T21:35:23.957 INFO:tasks.workunit.client.0.trial023.stderr:last_changed 2026-02-22T21:35:23.940196+0000 2026-02-22T21:35:23.957 INFO:tasks.workunit.client.0.trial023.stderr:created 2026-02-22T21:35:23.940196+0000 2026-02-22T21:35:23.957 INFO:tasks.workunit.client.0.trial023.stderr:min_mon_release 0 (unknown) 2026-02-22T21:35:23.957 INFO:tasks.workunit.client.0.trial023.stderr:election_strategy: 3 2026-02-22T21:35:23.957 INFO:tasks.workunit.client.0.trial023.stderr:0: v1:10.20.193.23:6789/0 mon.noname-a 2026-02-22T21:35:23.957 INFO:tasks.workunit.client.0.trial023.stderr: 2026-02-22T21:35:23.957 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec068a80) adding auth protocol: cephx 2026-02-22T21:35:23.957 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cec068a80) _parse_method_list cephx -> [2] 2026-02-22T21:35:23.957 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec068a80) adding auth protocol: cephx 2026-02-22T21:35:23.957 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cec068a80) _parse_method_list cephx -> [2] 2026-02-22T21:35:23.958 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec068a80) adding auth protocol: cephx 2026-02-22T21:35:23.958 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cec068a80) _parse_method_list cephx -> [2] 2026-02-22T21:35:23.958 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec068a80) adding con mode: secure 2026-02-22T21:35:23.958 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec068a80) adding con mode: crc 2026-02-22T21:35:23.958 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cec068a80) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:23.958 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec068a80) adding con mode: secure 2026-02-22T21:35:23.958 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec068a80) adding con mode: crc 2026-02-22T21:35:23.958 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cec068a80) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:23.958 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec068a80) adding con mode: secure 2026-02-22T21:35:23.958 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec068a80) adding con mode: crc 2026-02-22T21:35:23.958 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cec068a80) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:23.958 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec068a80) adding con mode: crc 2026-02-22T21:35:23.958 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec068a80) adding con mode: secure 2026-02-22T21:35:23.959 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cec068a80) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:23.959 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec068a80) adding con mode: crc 2026-02-22T21:35:23.959 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec068a80) adding con mode: secure 2026-02-22T21:35:23.959 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cec068a80) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:23.959 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec068a80) adding con mode: crc 2026-02-22T21:35:23.959 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec068a80) adding con mode: secure 2026-02-22T21:35:23.959 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cec068a80) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:23.959 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 10 AuthRegistry(0x7f5cec068a80) _refresh_config cluster_methods [2] service_methods [2] client_methods [2] 2026-02-22T21:35:23.959 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 10 AuthRegistry(0x7f5cec068a80) _refresh_config mon_cluster_modes [2,1] mon_service_modes [2,1] mon_client_modes [2,1]; cluster_modes [1,2] service_modes [1,2] client_modes [1,2] 2026-02-22T21:35:23.959 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:23.959 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 1 Processor -- start 2026-02-22T21:35:23.960 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 1 -- start start 2026-02-22T21:35:23.960 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 10 monclient: init 2026-02-22T21:35:23.960 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cf2f43f50) adding auth protocol: cephx 2026-02-22T21:35:23.960 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cf2f43f50) _parse_method_list cephx -> [2] 2026-02-22T21:35:23.960 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cf2f43f50) adding auth protocol: cephx 2026-02-22T21:35:23.960 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cf2f43f50) _parse_method_list cephx -> [2] 2026-02-22T21:35:23.960 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cf2f43f50) adding auth protocol: cephx 2026-02-22T21:35:23.960 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cf2f43f50) _parse_method_list cephx -> [2] 2026-02-22T21:35:23.960 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cf2f43f50) adding con mode: secure 2026-02-22T21:35:23.960 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cf2f43f50) adding con mode: crc 2026-02-22T21:35:23.960 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cf2f43f50) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:23.961 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cf2f43f50) adding con mode: secure 2026-02-22T21:35:23.961 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cf2f43f50) adding con mode: crc 2026-02-22T21:35:23.961 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cf2f43f50) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:23.961 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cf2f43f50) adding con mode: secure 2026-02-22T21:35:23.961 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cf2f43f50) adding con mode: crc 2026-02-22T21:35:23.961 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cf2f43f50) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:23.961 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cf2f43f50) adding con mode: crc 2026-02-22T21:35:23.961 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cf2f43f50) adding con mode: secure 2026-02-22T21:35:23.961 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cf2f43f50) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:23.961 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cf2f43f50) adding con mode: crc 2026-02-22T21:35:23.962 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cf2f43f50) adding con mode: secure 2026-02-22T21:35:23.962 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cf2f43f50) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:23.962 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cf2f43f50) adding con mode: crc 2026-02-22T21:35:23.962 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cf2f43f50) adding con mode: secure 2026-02-22T21:35:23.962 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cf2f43f50) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:23.962 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 10 AuthRegistry(0x7f5cf2f43f50) _refresh_config cluster_methods [2] service_methods [2] client_methods [2] 2026-02-22T21:35:23.962 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 10 AuthRegistry(0x7f5cf2f43f50) _refresh_config mon_cluster_modes [2,1] mon_service_modes [2,1] mon_client_modes [2,1]; cluster_modes [1,2] service_modes [1,2] client_modes [1,2] 2026-02-22T21:35:23.962 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:23.962 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:23.962 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 10 monclient: _reopen_session rank -1 2026-02-22T21:35:23.962 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 10 monclient: _add_conns ranks=[0] 2026-02-22T21:35:23.962 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 10 monclient(hunting): picked mon.noname-a con 0x7f5cec14d580 addr v1:10.20.193.23:6789/0 2026-02-22T21:35:23.963 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 1 -- --> v1:10.20.193.23:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x7f5cec1656c0 con 0x7f5cec14d580 2026-02-22T21:35:23.963 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 10 monclient(hunting): _renew_subs 2026-02-22T21:35:23.963 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 10 monclient(hunting): authenticate will time out at 596.157519s 2026-02-22T21:35:23.963 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf0cba640 1 --1- >> v1:10.20.193.23:6789/0 conn(0x7f5cec14d580 0x7f5cec164bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.23:6789/0 says I am v1:10.20.193.23:43298/0 (socket says 10.20.193.23:43298) 2026-02-22T21:35:23.963 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf0cba640 1 -- 10.20.193.23:0/477896340 learned_addr learned my addr 10.20.193.23:0/477896340 (peer_addr_for_me v1:10.20.193.23:0/0) 2026-02-22T21:35:23.963 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 1 -- 10.20.193.23:0/477896340 <== mon.0 v1:10.20.193.23:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4207954394 0 0) 0x7f5cec1656c0 con 0x7f5cec14d580 2026-02-22T21:35:23.963 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 10 monclient(hunting): _negotiate 2026-02-22T21:35:23.963 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:35:23.963 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:35:23.963 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 10 cephx client: reset 2026-02-22T21:35:23.963 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 10 cephx: set_have_need_key no handler for service auth 2026-02-22T21:35:23.963 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 10 cephx: validate_tickets want 32 have 0 need 32 2026-02-22T21:35:23.963 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 10 cephx client: reset 2026-02-22T21:35:23.964 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 10 monclient(hunting): my global_id is 4246 2026-02-22T21:35:23.964 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 10 cephx client: 0x7f5cd8003550 handle_response ret = 0 2026-02-22T21:35:23.964 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 10 cephx client: got initial server challenge 227fb6c6d3730f90 2026-02-22T21:35:23.964 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 10 cephx client: validate_tickets: want=32 need=32 have=0 2026-02-22T21:35:23.964 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 10 cephx: set_have_need_key no handler for service auth 2026-02-22T21:35:23.964 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 10 cephx: validate_tickets want 32 have 0 need 32 2026-02-22T21:35:23.964 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 10 cephx client: want=32 need=32 have=0 2026-02-22T21:35:23.964 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 10 cephx client: build_request 2026-02-22T21:35:23.964 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 10 cephx client: get auth session key: client_challenge 8fbf58f1f7d5eaf1 2026-02-22T21:35:23.964 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 1 -- 10.20.193.23:0/477896340 --> v1:10.20.193.23:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5cd8003630 con 0x7f5cec14d580 2026-02-22T21:35:23.964 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 1 -- 10.20.193.23:0/477896340 <== mon.0 v1:10.20.193.23:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 594991714 0 0) 0x7f5cd8003630 con 0x7f5cec14d580 2026-02-22T21:35:23.964 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 10 cephx client: 0x7f5cd8003550 handle_response ret = 0 2026-02-22T21:35:23.964 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 10 cephx client: get_auth_session_key 2026-02-22T21:35:23.965 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 10 cephx: verify_service_ticket_reply got 1 keys 2026-02-22T21:35:23.965 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 10 cephx: got key for service_id auth 2026-02-22T21:35:23.965 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 10 cephx: verify_service_ticket_reply ticket.secret_id=2 2026-02-22T21:35:23.965 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 10 cephx: verify_service_ticket_reply service auth secret_id 2 session_key AQCbdptpxXYlOBAAKDnjyxT72mJk8O9vJr53JA== validity=660.000000 2026-02-22T21:35:23.965 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 10 cephx: verify_service_ticket_reply ticket expires=2026-02-22T21:46:23.942062+0000 renew_after=2026-02-22T21:43:38.942062+0000 2026-02-22T21:35:23.965 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 10 cephx client: want=32 need=32 have=0 2026-02-22T21:35:23.965 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 10 cephx client: got connection bl 0 and extra tickets 0 2026-02-22T21:35:23.965 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 10 cephx: validate_tickets want 32 have 32 need 0 2026-02-22T21:35:23.965 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 10 monclient: _finish_hunting 0 2026-02-22T21:35:23.965 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 1 monclient: found mon.noname-a 2026-02-22T21:35:23.965 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.23:6789/0 2026-02-22T21:35:23.966 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 1 -- 10.20.193.23:0/477896340 --> v1:10.20.193.23:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cec1652d0 con 0x7f5cec14d580 2026-02-22T21:35:23.966 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 10 monclient: _finish_auth 0 2026-02-22T21:35:23.966 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 10 monclient: _check_auth_tickets 2026-02-22T21:35:23.966 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 10 cephx: validate_tickets want 32 have 32 need 0 2026-02-22T21:35:23.966 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 20 cephx client: need_tickets: want=32 have=32 need=0 2026-02-22T21:35:23.966 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 10 monclient: _check_auth_rotating renewing rotating keys (they expired before 2026-02-22T21:34:53.942081+0000) 2026-02-22T21:35:23.966 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 10 cephx client: build_rotating_request 2026-02-22T21:35:23.966 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.23:6789/0 2026-02-22T21:35:23.966 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 1 -- 10.20.193.23:0/477896340 --> v1:10.20.193.23:6789/0 -- auth(proto 2 2 bytes epoch 0) -- 0x7f5cec1656c0 con 0x7f5cec14d580 2026-02-22T21:35:23.966 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 1 -- 10.20.193.23:0/477896340 <== mon.0 v1:10.20.193.23:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7f5cdc002e20 con 0x7f5cec14d580 2026-02-22T21:35:23.966 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 monclient: authenticate success, global_id 4246 2026-02-22T21:35:23.966 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:35:23.966 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T21:35:23.967 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 10 monclient: dump: 2026-02-22T21:35:23.967 INFO:tasks.workunit.client.0.trial023.stderr:epoch 1 2026-02-22T21:35:23.967 INFO:tasks.workunit.client.0.trial023.stderr:fsid e2dd7ed3-13e8-4519-aab8-5d5a54f80255 2026-02-22T21:35:23.967 INFO:tasks.workunit.client.0.trial023.stderr:last_changed 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:23.967 INFO:tasks.workunit.client.0.trial023.stderr:created 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:23.967 INFO:tasks.workunit.client.0.trial023.stderr:min_mon_release 19 (squid) 2026-02-22T21:35:23.967 INFO:tasks.workunit.client.0.trial023.stderr:election_strategy: 3 2026-02-22T21:35:23.967 INFO:tasks.workunit.client.0.trial023.stderr:0: v1:10.20.193.23:6789/0 mon.a 2026-02-22T21:35:23.967 INFO:tasks.workunit.client.0.trial023.stderr: 2026-02-22T21:35:23.967 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 1 -- 10.20.193.23:0/477896340 <== mon.0 v1:10.20.193.23:6789/0 4 ==== config(1 keys) ==== 25+0+0 (unknown 1514702568 0 0) 0x7f5cdc0030a0 con 0x7f5cec14d580 2026-02-22T21:35:23.967 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 10 monclient: handle_config config(1 keys) 2026-02-22T21:35:23.967 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 1 -- 10.20.193.23:0/477896340 <== mon.0 v1:10.20.193.23:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7f5cdc003510 con 0x7f5cec14d580 2026-02-22T21:35:23.968 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:35:23.968 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T21:35:23.968 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 10 monclient: dump: 2026-02-22T21:35:23.968 INFO:tasks.workunit.client.0.trial023.stderr:epoch 1 2026-02-22T21:35:23.968 INFO:tasks.workunit.client.0.trial023.stderr:fsid e2dd7ed3-13e8-4519-aab8-5d5a54f80255 2026-02-22T21:35:23.968 INFO:tasks.workunit.client.0.trial023.stderr:last_changed 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:23.968 INFO:tasks.workunit.client.0.trial023.stderr:created 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:23.968 INFO:tasks.workunit.client.0.trial023.stderr:min_mon_release 19 (squid) 2026-02-22T21:35:23.968 INFO:tasks.workunit.client.0.trial023.stderr:election_strategy: 3 2026-02-22T21:35:23.968 INFO:tasks.workunit.client.0.trial023.stderr:0: v1:10.20.193.23:6789/0 mon.a 2026-02-22T21:35:23.968 INFO:tasks.workunit.client.0.trial023.stderr: 2026-02-22T21:35:23.968 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 10 monclient: get_monmap_and_config success 2026-02-22T21:35:23.969 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 4 set_mon_vals no callback set 2026-02-22T21:35:23.969 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 10 set_mon_vals mgr_pool = false 2026-02-22T21:35:23.969 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 1 -- 10.20.193.23:0/477896340 <== mon.0 v1:10.20.193.23:6789/0 6 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (unknown 4069196537 0 0) 0x7f5cec1656c0 con 0x7f5cec14d580 2026-02-22T21:35:23.969 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 10 cephx client: 0x7f5cd8003550 handle_response ret = 0 2026-02-22T21:35:23.969 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 10 cephx client: get_rotating_key 2026-02-22T21:35:23.969 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 10 auth: dump_rotating: 2026-02-22T21:35:23.969 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 10 auth: id 1 AQBddptpfYjTLhAAXh1N3uFywlax+2y6vwZmsw== expires 2026-02-22T21:38:21.785614+0000 2026-02-22T21:35:23.969 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 10 auth: id 2 AQBddptpiI/TLhAAdz7mEzTpWi2a8fttyDShuw== expires 2026-02-22T21:42:21.785614+0000 2026-02-22T21:35:23.969 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 10 auth: id 3 AQBddptpNJfTLhAA8yUoZRot9tLYY9D+lZZAdA== expires 2026-02-22T21:46:21.785614+0000 2026-02-22T21:35:23.969 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 10 monclient: _finish_auth 0 2026-02-22T21:35:23.969 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 10 monclient: _check_auth_tickets 2026-02-22T21:35:23.969 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 10 cephx: validate_tickets want 32 have 32 need 0 2026-02-22T21:35:23.969 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 20 cephx client: need_tickets: want=32 have=32 need=0 2026-02-22T21:35:23.970 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2026-02-22T21:34:53.942212+0000) 2026-02-22T21:35:23.970 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 10 auth: dump_rotating: 2026-02-22T21:35:23.970 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 10 auth: id 1 AQBddptpfYjTLhAAXh1N3uFywlax+2y6vwZmsw== expires 2026-02-22T21:38:21.785614+0000 2026-02-22T21:35:23.970 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 10 auth: id 2 AQBddptpiI/TLhAAdz7mEzTpWi2a8fttyDShuw== expires 2026-02-22T21:42:21.785614+0000 2026-02-22T21:35:23.970 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5ce37fe640 10 auth: id 3 AQBddptpNJfTLhAA8yUoZRot9tLYY9D+lZZAdA== expires 2026-02-22T21:46:21.785614+0000 2026-02-22T21:35:23.970 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 10 monclient: shutdown 2026-02-22T21:35:23.970 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 1 -- 10.20.193.23:0/477896340 >> v1:10.20.193.23:6789/0 conn(0x7f5cec14d580 legacy=0x7f5cec164bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:35:23.970 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 1 -- 10.20.193.23:0/477896340 shutdown_connections 2026-02-22T21:35:23.970 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 1 -- 10.20.193.23:0/477896340 >> 10.20.193.23:0/477896340 conn(0x7f5cec06c860 msgr2=0x7f5cec0bf590 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:35:23.970 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 1 -- 10.20.193.23:0/477896340 shutdown_connections 2026-02-22T21:35:23.970 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 1 -- 10.20.193.23:0/477896340 wait complete. 2026-02-22T21:35:23.970 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding auth protocol: cephx 2026-02-22T21:35:23.970 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cec067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:23.971 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding auth protocol: cephx 2026-02-22T21:35:23.971 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cec067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:23.971 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding auth protocol: cephx 2026-02-22T21:35:23.971 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cec067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:23.971 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding con mode: secure 2026-02-22T21:35:23.971 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding con mode: crc 2026-02-22T21:35:23.971 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cec067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:23.971 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding con mode: secure 2026-02-22T21:35:23.971 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding con mode: crc 2026-02-22T21:35:23.971 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cec067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:23.971 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding con mode: secure 2026-02-22T21:35:23.971 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding con mode: crc 2026-02-22T21:35:23.971 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cec067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:23.972 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding con mode: crc 2026-02-22T21:35:23.972 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding con mode: secure 2026-02-22T21:35:23.972 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cec067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:23.972 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding con mode: crc 2026-02-22T21:35:23.972 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding con mode: secure 2026-02-22T21:35:23.972 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cec067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:23.972 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding con mode: crc 2026-02-22T21:35:23.972 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding con mode: secure 2026-02-22T21:35:23.972 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cec067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:23.972 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 10 AuthRegistry(0x7f5cec067010) _refresh_config cluster_methods [2] service_methods [2] client_methods [2] 2026-02-22T21:35:23.972 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 10 AuthRegistry(0x7f5cec067010) _refresh_config mon_cluster_modes [2,1] mon_service_modes [2,1] mon_client_modes [2,1]; cluster_modes [1,2] service_modes [1,2] client_modes [1,2] 2026-02-22T21:35:23.972 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:23.973 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 10 monclient: build_initial_monmap 2026-02-22T21:35:23.973 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 10 monclient: monmap: 2026-02-22T21:35:23.973 INFO:tasks.workunit.client.0.trial023.stderr:epoch 0 2026-02-22T21:35:23.973 INFO:tasks.workunit.client.0.trial023.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T21:35:23.973 INFO:tasks.workunit.client.0.trial023.stderr:last_changed 0.000000 2026-02-22T21:35:23.973 INFO:tasks.workunit.client.0.trial023.stderr:created 0.000000 2026-02-22T21:35:23.973 INFO:tasks.workunit.client.0.trial023.stderr:min_mon_release 0 (unknown) 2026-02-22T21:35:23.973 INFO:tasks.workunit.client.0.trial023.stderr:election_strategy: 1 2026-02-22T21:35:23.973 INFO:tasks.workunit.client.0.trial023.stderr:0: v1:10.20.193.23:6789/0 mon.noname-a 2026-02-22T21:35:23.973 INFO:tasks.workunit.client.0.trial023.stderr: 2026-02-22T21:35:23.973 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec06e100) adding auth protocol: cephx 2026-02-22T21:35:23.973 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cec06e100) _parse_method_list cephx -> [2] 2026-02-22T21:35:23.973 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec06e100) adding auth protocol: cephx 2026-02-22T21:35:23.974 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cec06e100) _parse_method_list cephx -> [2] 2026-02-22T21:35:23.974 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec06e100) adding auth protocol: cephx 2026-02-22T21:35:23.974 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cec06e100) _parse_method_list cephx -> [2] 2026-02-22T21:35:23.974 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec06e100) adding con mode: secure 2026-02-22T21:35:23.974 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec06e100) adding con mode: crc 2026-02-22T21:35:23.974 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cec06e100) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:23.974 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec06e100) adding con mode: secure 2026-02-22T21:35:23.974 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec06e100) adding con mode: crc 2026-02-22T21:35:23.974 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cec06e100) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:23.974 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec06e100) adding con mode: secure 2026-02-22T21:35:23.974 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec06e100) adding con mode: crc 2026-02-22T21:35:23.974 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cec06e100) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:23.975 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec06e100) adding con mode: crc 2026-02-22T21:35:23.975 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec06e100) adding con mode: secure 2026-02-22T21:35:23.975 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cec06e100) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:23.975 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec06e100) adding con mode: crc 2026-02-22T21:35:23.975 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec06e100) adding con mode: secure 2026-02-22T21:35:23.975 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cec06e100) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:23.975 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec06e100) adding con mode: crc 2026-02-22T21:35:23.975 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec06e100) adding con mode: secure 2026-02-22T21:35:23.975 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cec06e100) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:23.975 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 10 AuthRegistry(0x7f5cec06e100) _refresh_config cluster_methods [2] service_methods [2] client_methods [2] 2026-02-22T21:35:23.975 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 10 AuthRegistry(0x7f5cec06e100) _refresh_config mon_cluster_modes [2,1] mon_service_modes [2,1] mon_client_modes [2,1]; cluster_modes [1,2] service_modes [1,2] client_modes [1,2] 2026-02-22T21:35:23.975 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:23.975 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 1 Processor -- start 2026-02-22T21:35:23.976 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 1 -- start start 2026-02-22T21:35:23.976 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 10 monclient: init 2026-02-22T21:35:23.976 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding auth protocol: cephx 2026-02-22T21:35:23.976 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cec067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:23.976 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding auth protocol: cephx 2026-02-22T21:35:23.976 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cec067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:23.976 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding auth protocol: cephx 2026-02-22T21:35:23.976 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cec067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:23.976 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding con mode: secure 2026-02-22T21:35:23.976 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding con mode: crc 2026-02-22T21:35:23.976 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cec067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:23.976 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding con mode: secure 2026-02-22T21:35:23.976 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding con mode: crc 2026-02-22T21:35:23.976 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cec067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:23.977 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding con mode: secure 2026-02-22T21:35:23.977 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding con mode: crc 2026-02-22T21:35:23.977 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cec067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:23.977 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding con mode: crc 2026-02-22T21:35:23.977 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding con mode: secure 2026-02-22T21:35:23.977 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cec067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:23.977 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding con mode: crc 2026-02-22T21:35:23.977 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding con mode: secure 2026-02-22T21:35:23.977 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cec067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:23.977 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding con mode: crc 2026-02-22T21:35:23.977 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 5 AuthRegistry(0x7f5cec067010) adding con mode: secure 2026-02-22T21:35:23.977 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 20 AuthRegistry(0x7f5cec067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:23.977 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 10 AuthRegistry(0x7f5cec067010) _refresh_config cluster_methods [2] service_methods [2] client_methods [2] 2026-02-22T21:35:23.977 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 10 AuthRegistry(0x7f5cec067010) _refresh_config mon_cluster_modes [2,1] mon_service_modes [2,1] mon_client_modes [2,1]; cluster_modes [1,2] service_modes [1,2] client_modes [1,2] 2026-02-22T21:35:23.978 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.936+0000 7f5cf2f45640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:23.978 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5cf2f45640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:23.978 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5cf2f45640 10 monclient: _reopen_session rank -1 2026-02-22T21:35:23.978 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5cf2f45640 10 monclient: _add_conns ranks=[0] 2026-02-22T21:35:23.978 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5cf2f45640 10 monclient(hunting): picked mon.noname-a con 0x7f5cec14d580 addr v1:10.20.193.23:6789/0 2026-02-22T21:35:23.978 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5cf2f45640 1 -- --> v1:10.20.193.23:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x7f5cec15c120 con 0x7f5cec14d580 2026-02-22T21:35:23.978 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5cf2f45640 10 monclient(hunting): _renew_subs 2026-02-22T21:35:23.978 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5cf2f45640 10 monclient(hunting): authenticate will time out at 596.160336s 2026-02-22T21:35:23.978 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5cf0cba640 1 --1- >> v1:10.20.193.23:6789/0 conn(0x7f5cec14d580 0x7f5cec15b8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.23:6789/0 says I am v1:10.20.193.23:43306/0 (socket says 10.20.193.23:43306) 2026-02-22T21:35:23.978 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5cf0cba640 1 -- 10.20.193.23:0/3591215204 learned_addr learned my addr 10.20.193.23:0/3591215204 (peer_addr_for_me v1:10.20.193.23:0/0) 2026-02-22T21:35:23.978 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 1 -- 10.20.193.23:0/3591215204 <== mon.0 v1:10.20.193.23:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3083580167 0 0) 0x7f5cec15c120 con 0x7f5cec14d580 2026-02-22T21:35:23.978 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 monclient(hunting): _negotiate 2026-02-22T21:35:23.978 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:35:23.979 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:35:23.979 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx client: reset 2026-02-22T21:35:23.979 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx: set_have_need_key no handler for service mon 2026-02-22T21:35:23.979 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx: set_have_need_key no handler for service osd 2026-02-22T21:35:23.979 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx: set_have_need_key no handler for service mgr 2026-02-22T21:35:23.979 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx: set_have_need_key no handler for service auth 2026-02-22T21:35:23.979 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx: validate_tickets want 53 have 0 need 53 2026-02-22T21:35:23.979 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx client: reset 2026-02-22T21:35:23.979 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 monclient(hunting): my global_id is 4247 2026-02-22T21:35:23.979 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx client: 0x7f5cc8003550 handle_response ret = 0 2026-02-22T21:35:23.979 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx client: got initial server challenge dfbdc357c7d3f56e 2026-02-22T21:35:23.979 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx client: validate_tickets: want=53 need=53 have=0 2026-02-22T21:35:23.979 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx: set_have_need_key no handler for service mon 2026-02-22T21:35:23.979 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx: set_have_need_key no handler for service osd 2026-02-22T21:35:23.979 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx: set_have_need_key no handler for service mgr 2026-02-22T21:35:23.980 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx: set_have_need_key no handler for service auth 2026-02-22T21:35:23.980 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx: validate_tickets want 53 have 0 need 53 2026-02-22T21:35:23.980 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx client: want=53 need=53 have=0 2026-02-22T21:35:23.980 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx client: build_request 2026-02-22T21:35:23.980 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx client: get auth session key: client_challenge de375c3f10389d48 2026-02-22T21:35:23.980 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 1 -- 10.20.193.23:0/3591215204 --> v1:10.20.193.23:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5cc8003630 con 0x7f5cec14d580 2026-02-22T21:35:23.980 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 1 -- 10.20.193.23:0/3591215204 <== mon.0 v1:10.20.193.23:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 732+0+0 (unknown 1499482457 0 0) 0x7f5cc8003630 con 0x7f5cec14d580 2026-02-22T21:35:23.980 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx client: 0x7f5cc8003550 handle_response ret = 0 2026-02-22T21:35:23.980 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx client: get_auth_session_key 2026-02-22T21:35:23.980 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx: verify_service_ticket_reply got 1 keys 2026-02-22T21:35:23.980 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx: got key for service_id auth 2026-02-22T21:35:23.980 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx: verify_service_ticket_reply ticket.secret_id=2 2026-02-22T21:35:23.980 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx: verify_service_ticket_reply service auth secret_id 2 session_key AQCbdptpYZdOOBAAGJohOUXu/cH3GjiwR9ojsA== validity=660.000000 2026-02-22T21:35:23.981 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx: verify_service_ticket_reply ticket expires=2026-02-22T21:46:23.944743+0000 renew_after=2026-02-22T21:43:38.944743+0000 2026-02-22T21:35:23.981 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx client: want=53 need=53 have=0 2026-02-22T21:35:23.981 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx client: got connection bl 0 and extra tickets 518 2026-02-22T21:35:23.981 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx: set_have_need_key no handler for service mon 2026-02-22T21:35:23.981 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx: set_have_need_key no handler for service osd 2026-02-22T21:35:23.981 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx: set_have_need_key no handler for service mgr 2026-02-22T21:35:23.981 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx: validate_tickets want 53 have 32 need 21 2026-02-22T21:35:23.981 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx client: validate_tickets: want=53 need=21 have=32 2026-02-22T21:35:23.981 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx: set_have_need_key no handler for service mon 2026-02-22T21:35:23.981 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx: set_have_need_key no handler for service osd 2026-02-22T21:35:23.981 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx: set_have_need_key no handler for service mgr 2026-02-22T21:35:23.981 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx: validate_tickets want 53 have 32 need 21 2026-02-22T21:35:23.981 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx client: want=53 need=21 have=32 2026-02-22T21:35:23.981 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx client: build_request 2026-02-22T21:35:23.982 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx client: get service keys: want=53 need=21 have=32 2026-02-22T21:35:23.982 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 1 -- 10.20.193.23:0/3591215204 --> v1:10.20.193.23:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5cec15c120 con 0x7f5cec14d580 2026-02-22T21:35:23.982 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 1 -- 10.20.193.23:0/3591215204 <== mon.0 v1:10.20.193.23:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7f5cdc003420 con 0x7f5cec14d580 2026-02-22T21:35:23.982 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T21:35:23.982 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T21:35:23.982 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 monclient(hunting): dump: 2026-02-22T21:35:23.982 INFO:tasks.workunit.client.0.trial023.stderr:epoch 1 2026-02-22T21:35:23.982 INFO:tasks.workunit.client.0.trial023.stderr:fsid e2dd7ed3-13e8-4519-aab8-5d5a54f80255 2026-02-22T21:35:23.982 INFO:tasks.workunit.client.0.trial023.stderr:last_changed 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:23.982 INFO:tasks.workunit.client.0.trial023.stderr:created 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:23.982 INFO:tasks.workunit.client.0.trial023.stderr:min_mon_release 19 (squid) 2026-02-22T21:35:23.982 INFO:tasks.workunit.client.0.trial023.stderr:election_strategy: 3 2026-02-22T21:35:23.982 INFO:tasks.workunit.client.0.trial023.stderr:0: v1:10.20.193.23:6789/0 mon.a 2026-02-22T21:35:23.982 INFO:tasks.workunit.client.0.trial023.stderr: 2026-02-22T21:35:23.983 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 monclient(hunting): _finish_auth 0 2026-02-22T21:35:23.983 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 1 -- 10.20.193.23:0/3591215204 <== mon.0 v1:10.20.193.23:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 548+0+0 (unknown 1499002993 0 0) 0x7f5cec15c120 con 0x7f5cec14d580 2026-02-22T21:35:23.983 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx client: 0x7f5cc8003550 handle_response ret = 0 2026-02-22T21:35:23.983 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx client: get_principal_session_key session_key AQCbdptpYZdOOBAAGJohOUXu/cH3GjiwR9ojsA== 2026-02-22T21:35:23.983 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx: verify_service_ticket_reply got 3 keys 2026-02-22T21:35:23.983 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx: got key for service_id mon 2026-02-22T21:35:23.983 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx: verify_service_ticket_reply ticket.secret_id=2 2026-02-22T21:35:23.983 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx: verify_service_ticket_reply service mon secret_id 2 session_key AQCbdptpwH1QOBAAE4Klsbh3KDxUEHST/GexBw== validity=240.000000 2026-02-22T21:35:23.983 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx: verify_service_ticket_reply ticket expires=2026-02-22T21:39:23.944842+0000 renew_after=2026-02-22T21:38:23.944842+0000 2026-02-22T21:35:23.983 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx: got key for service_id osd 2026-02-22T21:35:23.983 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx: verify_service_ticket_reply ticket.secret_id=2 2026-02-22T21:35:23.983 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx: verify_service_ticket_reply service osd secret_id 2 session_key AQCbdptpEoNQOBAAGdknVQ9SfuB61/fK60vg+g== validity=240.000000 2026-02-22T21:35:23.983 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx: verify_service_ticket_reply ticket expires=2026-02-22T21:39:23.944845+0000 renew_after=2026-02-22T21:38:23.944845+0000 2026-02-22T21:35:23.983 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx: got key for service_id mgr 2026-02-22T21:35:23.983 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx: verify_service_ticket_reply ticket.secret_id=2 2026-02-22T21:35:23.983 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx: verify_service_ticket_reply service mgr secret_id 2 session_key AQCbdptpnIlQOBAA1yKzqSGjrNixbANk2JdTQw== validity=240.000000 2026-02-22T21:35:23.984 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx: verify_service_ticket_reply ticket expires=2026-02-22T21:39:23.944848+0000 renew_after=2026-02-22T21:38:23.944848+0000 2026-02-22T21:35:23.984 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx: validate_tickets want 53 have 53 need 0 2026-02-22T21:35:23.984 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 monclient: _finish_hunting 0 2026-02-22T21:35:23.984 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 1 monclient: found mon.a 2026-02-22T21:35:23.984 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.23:6789/0 2026-02-22T21:35:23.984 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 1 -- 10.20.193.23:0/3591215204 --> v1:10.20.193.23:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cec1494b0 con 0x7f5cec14d580 2026-02-22T21:35:23.984 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 monclient: _finish_auth 0 2026-02-22T21:35:23.984 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 monclient: _check_auth_tickets 2026-02-22T21:35:23.984 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx: validate_tickets want 53 have 53 need 0 2026-02-22T21:35:23.984 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 20 cephx client: need_tickets: want=53 have=53 need=0 2026-02-22T21:35:23.984 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 monclient: _check_auth_rotating renewing rotating keys (they expired before 2026-02-22T21:34:53.944856+0000) 2026-02-22T21:35:23.984 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx client: build_rotating_request 2026-02-22T21:35:23.984 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.23:6789/0 2026-02-22T21:35:23.984 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 1 -- 10.20.193.23:0/3591215204 --> v1:10.20.193.23:6789/0 -- auth(proto 2 2 bytes epoch 0) -- 0x7f5cc8003630 con 0x7f5cec14d580 2026-02-22T21:35:23.984 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5cf2f45640 5 monclient: authenticate success, global_id 4247 2026-02-22T21:35:23.985 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5cf2f45640 10 monclient: _renew_subs 2026-02-22T21:35:23.985 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5cf2f45640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.23:6789/0 2026-02-22T21:35:23.985 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5cf2f45640 1 -- 10.20.193.23:0/3591215204 --> v1:10.20.193.23:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5cec093bb0 con 0x7f5cec14d580 2026-02-22T21:35:23.985 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5cf2f45640 10 monclient: _renew_subs 2026-02-22T21:35:23.985 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5cf2f45640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.23:6789/0 2026-02-22T21:35:23.985 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5cf2f45640 1 -- 10.20.193.23:0/3591215204 --> v1:10.20.193.23:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f5cec147ed0 con 0x7f5cec14d580 2026-02-22T21:35:23.985 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 1 -- 10.20.193.23:0/3591215204 <== mon.0 v1:10.20.193.23:6789/0 5 ==== config(1 keys) ==== 25+0+0 (unknown 1514702568 0 0) 0x7f5cdc0030a0 con 0x7f5cec14d580 2026-02-22T21:35:23.985 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 monclient: handle_config config(1 keys) 2026-02-22T21:35:23.985 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 1 -- 10.20.193.23:0/3591215204 <== mon.0 v1:10.20.193.23:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7f5cdc004c90 con 0x7f5cec14d580 2026-02-22T21:35:23.985 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:35:23.985 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T21:35:23.985 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 monclient: dump: 2026-02-22T21:35:23.985 INFO:tasks.workunit.client.0.trial023.stderr:epoch 1 2026-02-22T21:35:23.985 INFO:tasks.workunit.client.0.trial023.stderr:fsid e2dd7ed3-13e8-4519-aab8-5d5a54f80255 2026-02-22T21:35:23.985 INFO:tasks.workunit.client.0.trial023.stderr:last_changed 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:23.986 INFO:tasks.workunit.client.0.trial023.stderr:created 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:23.986 INFO:tasks.workunit.client.0.trial023.stderr:min_mon_release 19 (squid) 2026-02-22T21:35:23.986 INFO:tasks.workunit.client.0.trial023.stderr:election_strategy: 3 2026-02-22T21:35:23.986 INFO:tasks.workunit.client.0.trial023.stderr:0: v1:10.20.193.23:6789/0 mon.a 2026-02-22T21:35:23.986 INFO:tasks.workunit.client.0.trial023.stderr: 2026-02-22T21:35:23.986 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 1 -- 10.20.193.23:0/3591215204 <== mon.0 v1:10.20.193.23:6789/0 7 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (unknown 2586634886 0 0) 0x7f5cec093bb0 con 0x7f5cec14d580 2026-02-22T21:35:23.986 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx client: 0x7f5cc8003550 handle_response ret = 0 2026-02-22T21:35:23.986 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx client: get_rotating_key 2026-02-22T21:35:23.986 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce2ffd640 4 set_mon_vals no callback set 2026-02-22T21:35:23.986 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 auth: dump_rotating: 2026-02-22T21:35:23.986 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 auth: id 1 AQBddptpfYjTLhAAXh1N3uFywlax+2y6vwZmsw== expires 2026-02-22T21:38:21.785614+0000 2026-02-22T21:35:23.986 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 auth: id 2 AQBddptpiI/TLhAAdz7mEzTpWi2a8fttyDShuw== expires 2026-02-22T21:42:21.785614+0000 2026-02-22T21:35:23.986 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 auth: id 3 AQBddptpNJfTLhAA8yUoZRot9tLYY9D+lZZAdA== expires 2026-02-22T21:46:21.785614+0000 2026-02-22T21:35:23.986 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 monclient: _finish_auth 0 2026-02-22T21:35:23.986 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 monclient: _check_auth_tickets 2026-02-22T21:35:23.986 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 cephx: validate_tickets want 53 have 53 need 0 2026-02-22T21:35:23.986 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 20 cephx client: need_tickets: want=53 have=53 need=0 2026-02-22T21:35:23.987 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2026-02-22T21:34:53.944979+0000) 2026-02-22T21:35:23.987 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 auth: dump_rotating: 2026-02-22T21:35:23.987 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 auth: id 1 AQBddptpfYjTLhAAXh1N3uFywlax+2y6vwZmsw== expires 2026-02-22T21:38:21.785614+0000 2026-02-22T21:35:23.987 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 auth: id 2 AQBddptpiI/TLhAAdz7mEzTpWi2a8fttyDShuw== expires 2026-02-22T21:42:21.785614+0000 2026-02-22T21:35:23.987 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 auth: id 3 AQBddptpNJfTLhAA8yUoZRot9tLYY9D+lZZAdA== expires 2026-02-22T21:46:21.785614+0000 2026-02-22T21:35:23.987 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5cf2f45640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T21:35:23.987 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5cf2f45640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:35:23.987 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5cf2f45640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.23:6789/0 2026-02-22T21:35:23.987 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5cf2f45640 1 -- 10.20.193.23:0/3591215204 --> v1:10.20.193.23:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cec162ea0 con 0x7f5cec14d580 2026-02-22T21:35:23.987 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 1 -- 10.20.193.23:0/3591215204 <== mon.0 v1:10.20.193.23:6789/0 8 ==== mgrmap(e 4) ==== 47400+0+0 (unknown 1603120368 0 0) 0x7f5cdc004fe0 con 0x7f5cec14d580 2026-02-22T21:35:23.987 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 1 -- 10.20.193.23:0/3591215204 <== mon.0 v1:10.20.193.23:6789/0 9 ==== osd_map(14..14 src has 1..14) ==== 2160+0+0 (unknown 946035718 0 0) 0x7f5cdc048cd0 con 0x7f5cec14d580 2026-02-22T21:35:23.987 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce3fff640 10 monclient: get_auth_request con 0x7f5cc803ba00 auth_method 0 2026-02-22T21:35:23.987 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce3fff640 10 cephx client: build_authorizer for service mgr 2026-02-22T21:35:23.987 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce3fff640 10 In get_auth_session_handler for protocol 2 2026-02-22T21:35:23.987 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 1 -- 10.20.193.23:0/3591215204 <== mon.0 v1:10.20.193.23:6789/0 10 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (unknown 1092875540 0 3570997608) 0x7f5cdc016960 con 0x7f5cec14d580 2026-02-22T21:35:23.987 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:35:23.987 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:23.940+0000 7f5ce1ffb640 10 monclient: _finish_command 1 = system:0 2026-02-22T21:35:24.059 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.052+0000 7f5cf2f45640 10 start_mon_command cmd=[{"prefix": "config-key get", "key": "mgr/test-foo"}] 2026-02-22T21:35:24.059 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.052+0000 7f5cf2f45640 10 monclient: _send_command 2 [{"prefix": "config-key get", "key": "mgr/test-foo"}] 2026-02-22T21:35:24.059 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.052+0000 7f5cf2f45640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.23:6789/0 2026-02-22T21:35:24.060 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.052+0000 7f5cf2f45640 1 -- 10.20.193.23:0/3591215204 --> v1:10.20.193.23:6789/0 -- mon_command({"prefix": "config-key get", "key": "mgr/test-foo"} v 0) -- 0x7f5cec0c1dd0 con 0x7f5cec14d580 2026-02-22T21:35:24.060 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.052+0000 7f5ce1ffb640 1 -- 10.20.193.23:0/3591215204 <== mon.0 v1:10.20.193.23:6789/0 11 ==== mon_command_ack([{"prefix": "config-key get", "key": "mgr/test-foo"}]=0 v13) ==== 85+0+0 (unknown 2685503681 0 0) 0x7f5cdc016260 con 0x7f5cec14d580 2026-02-22T21:35:24.060 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.052+0000 7f5ce1ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config-key get", "key": "mgr/test-foo"}] 2026-02-22T21:35:24.060 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.052+0000 7f5ce1ffb640 10 monclient: _finish_command 2 = system:0 2026-02-22T21:35:24.137 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.132+0000 7f5cf2f45640 10 start_mon_command cmd=[{"prefix": "config-key get", "key": "mgr/test-foo"}] 2026-02-22T21:35:24.138 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.132+0000 7f5cf2f45640 10 monclient: _send_command 3 [{"prefix": "config-key get", "key": "mgr/test-foo"}] 2026-02-22T21:35:24.138 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.132+0000 7f5cf2f45640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.23:6789/0 2026-02-22T21:35:24.138 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.132+0000 7f5cf2f45640 1 -- 10.20.193.23:0/3591215204 --> v1:10.20.193.23:6789/0 -- mon_command({"prefix": "config-key get", "key": "mgr/test-foo"} v 0) -- 0x7f5cec15b6c0 con 0x7f5cec14d580 2026-02-22T21:35:24.138 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.132+0000 7f5ce1ffb640 1 -- 10.20.193.23:0/3591215204 <== mon.0 v1:10.20.193.23:6789/0 12 ==== mon_command_ack([{"prefix": "config-key get", "key": "mgr/test-foo"}]=0 v13) ==== 85+0+0 (unknown 2685503681 0 0) 0x7f5cdc047130 con 0x7f5cec14d580 2026-02-22T21:35:24.138 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.132+0000 7f5ce1ffb640 10 monclient: handle_mon_command_ack 3 [{"prefix": "config-key get", "key": "mgr/test-foo"}] 2026-02-22T21:35:24.138 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.132+0000 7f5ce1ffb640 10 monclient: _finish_command 3 = system:0 2026-02-22T21:35:24.139 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.132+0000 7f5cf2f45640 1 -- 10.20.193.23:0/3591215204 >> v1:10.20.193.23:6800/2834055528 conn(0x7f5cc803ba00 legacy=0x7f5cc803dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:35:24.139 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.132+0000 7f5cf2f45640 10 monclient: shutdown 2026-02-22T21:35:24.139 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.132+0000 7f5cf2f45640 1 -- 10.20.193.23:0/3591215204 >> v1:10.20.193.23:6789/0 conn(0x7f5cec14d580 legacy=0x7f5cec15b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:35:24.139 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.132+0000 7f5cf2f45640 1 -- 10.20.193.23:0/3591215204 shutdown_connections 2026-02-22T21:35:24.139 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.132+0000 7f5cf2f45640 1 -- 10.20.193.23:0/3591215204 >> 10.20.193.23:0/3591215204 conn(0x7f5cec06c860 msgr2=0x7f5cec0ccd20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:35:24.140 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.132+0000 7f5cf2f45640 1 -- 10.20.193.23:0/3591215204 shutdown_connections 2026-02-22T21:35:24.140 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.132+0000 7f5cf2f45640 1 -- 10.20.193.23:0/3591215204 wait complete. 2026-02-22T21:35:24.146 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name mgr.a config-key get device/test-foo 2026-02-22T21:35:24.215 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.204+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding auth protocol: cephx 2026-02-22T21:35:24.215 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.204+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a0067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.215 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.204+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding auth protocol: cephx 2026-02-22T21:35:24.215 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.204+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a0067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.215 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.204+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding auth protocol: cephx 2026-02-22T21:35:24.215 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.204+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a0067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.216 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.204+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding con mode: secure 2026-02-22T21:35:24.216 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.204+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding con mode: crc 2026-02-22T21:35:24.216 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.204+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a0067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.216 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.204+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding con mode: secure 2026-02-22T21:35:24.216 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.204+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding con mode: crc 2026-02-22T21:35:24.216 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.204+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a0067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.216 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.204+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding con mode: secure 2026-02-22T21:35:24.216 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.204+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding con mode: crc 2026-02-22T21:35:24.216 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.204+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a0067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.216 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.204+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding con mode: crc 2026-02-22T21:35:24.216 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.204+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding con mode: secure 2026-02-22T21:35:24.216 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.204+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a0067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.216 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.204+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding con mode: crc 2026-02-22T21:35:24.216 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.204+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding con mode: secure 2026-02-22T21:35:24.216 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.204+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a0067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.216 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.204+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding con mode: crc 2026-02-22T21:35:24.216 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.204+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding con mode: secure 2026-02-22T21:35:24.216 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.204+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a0067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.216 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.204+0000 7f00a7ef1640 10 AuthRegistry(0x7f00a0067010) _refresh_config cluster_methods [2] service_methods [2] client_methods [2] 2026-02-22T21:35:24.216 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.204+0000 7f00a7ef1640 10 AuthRegistry(0x7f00a0067010) _refresh_config mon_cluster_modes [2,1] mon_service_modes [2,1] mon_client_modes [2,1]; cluster_modes [1,2] service_modes [1,2] client_modes [1,2] 2026-02-22T21:35:24.216 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.204+0000 7f00a7ef1640 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2026-02-22T21:35:24.216 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding auth protocol: cephx 2026-02-22T21:35:24.216 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a0067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.216 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding auth protocol: cephx 2026-02-22T21:35:24.217 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a0067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.217 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding auth protocol: cephx 2026-02-22T21:35:24.217 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a0067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.217 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding con mode: secure 2026-02-22T21:35:24.217 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding con mode: crc 2026-02-22T21:35:24.217 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a0067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.217 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding con mode: secure 2026-02-22T21:35:24.217 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding con mode: crc 2026-02-22T21:35:24.217 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a0067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.217 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding con mode: secure 2026-02-22T21:35:24.217 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding con mode: crc 2026-02-22T21:35:24.217 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a0067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.217 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding con mode: crc 2026-02-22T21:35:24.217 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding con mode: secure 2026-02-22T21:35:24.217 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a0067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.217 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding con mode: crc 2026-02-22T21:35:24.217 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding con mode: secure 2026-02-22T21:35:24.217 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a0067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.217 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding con mode: crc 2026-02-22T21:35:24.217 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding con mode: secure 2026-02-22T21:35:24.217 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a0067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.217 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 10 AuthRegistry(0x7f00a0067010) _refresh_config cluster_methods [2] service_methods [2] client_methods [2] 2026-02-22T21:35:24.217 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 10 AuthRegistry(0x7f00a0067010) _refresh_config mon_cluster_modes [2,1] mon_service_modes [2,1] mon_client_modes [2,1]; cluster_modes [1,2] service_modes [1,2] client_modes [1,2] 2026-02-22T21:35:24.217 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:24.217 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 10 monclient: get_monmap_and_config 2026-02-22T21:35:24.217 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 10 monclient: build_initial_monmap 2026-02-22T21:35:24.217 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 10 monclient: monmap: 2026-02-22T21:35:24.217 INFO:tasks.workunit.client.0.trial023.stderr:epoch 0 2026-02-22T21:35:24.217 INFO:tasks.workunit.client.0.trial023.stderr:fsid e2dd7ed3-13e8-4519-aab8-5d5a54f80255 2026-02-22T21:35:24.218 INFO:tasks.workunit.client.0.trial023.stderr:last_changed 2026-02-22T21:35:24.213853+0000 2026-02-22T21:35:24.218 INFO:tasks.workunit.client.0.trial023.stderr:created 2026-02-22T21:35:24.213853+0000 2026-02-22T21:35:24.218 INFO:tasks.workunit.client.0.trial023.stderr:min_mon_release 0 (unknown) 2026-02-22T21:35:24.218 INFO:tasks.workunit.client.0.trial023.stderr:election_strategy: 3 2026-02-22T21:35:24.218 INFO:tasks.workunit.client.0.trial023.stderr:0: v1:10.20.193.23:6789/0 mon.noname-a 2026-02-22T21:35:24.218 INFO:tasks.workunit.client.0.trial023.stderr: 2026-02-22T21:35:24.218 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0068a80) adding auth protocol: cephx 2026-02-22T21:35:24.218 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a0068a80) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.218 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0068a80) adding auth protocol: cephx 2026-02-22T21:35:24.218 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a0068a80) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.218 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0068a80) adding auth protocol: cephx 2026-02-22T21:35:24.218 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a0068a80) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.218 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0068a80) adding con mode: secure 2026-02-22T21:35:24.218 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0068a80) adding con mode: crc 2026-02-22T21:35:24.218 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a0068a80) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.218 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0068a80) adding con mode: secure 2026-02-22T21:35:24.218 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0068a80) adding con mode: crc 2026-02-22T21:35:24.218 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a0068a80) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.218 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0068a80) adding con mode: secure 2026-02-22T21:35:24.218 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0068a80) adding con mode: crc 2026-02-22T21:35:24.218 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a0068a80) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.218 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0068a80) adding con mode: crc 2026-02-22T21:35:24.218 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0068a80) adding con mode: secure 2026-02-22T21:35:24.218 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a0068a80) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.218 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0068a80) adding con mode: crc 2026-02-22T21:35:24.218 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0068a80) adding con mode: secure 2026-02-22T21:35:24.218 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a0068a80) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.219 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0068a80) adding con mode: crc 2026-02-22T21:35:24.219 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0068a80) adding con mode: secure 2026-02-22T21:35:24.219 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a0068a80) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.219 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 10 AuthRegistry(0x7f00a0068a80) _refresh_config cluster_methods [2] service_methods [2] client_methods [2] 2026-02-22T21:35:24.219 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 10 AuthRegistry(0x7f00a0068a80) _refresh_config mon_cluster_modes [2,1] mon_service_modes [2,1] mon_client_modes [2,1]; cluster_modes [1,2] service_modes [1,2] client_modes [1,2] 2026-02-22T21:35:24.219 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:24.219 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 1 Processor -- start 2026-02-22T21:35:24.219 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 1 -- start start 2026-02-22T21:35:24.219 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 10 monclient: init 2026-02-22T21:35:24.219 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a7eeff50) adding auth protocol: cephx 2026-02-22T21:35:24.219 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a7eeff50) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.219 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a7eeff50) adding auth protocol: cephx 2026-02-22T21:35:24.219 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a7eeff50) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.219 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a7eeff50) adding auth protocol: cephx 2026-02-22T21:35:24.219 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a7eeff50) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.219 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a7eeff50) adding con mode: secure 2026-02-22T21:35:24.219 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a7eeff50) adding con mode: crc 2026-02-22T21:35:24.219 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a7eeff50) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.219 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a7eeff50) adding con mode: secure 2026-02-22T21:35:24.219 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a7eeff50) adding con mode: crc 2026-02-22T21:35:24.219 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a7eeff50) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.219 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a7eeff50) adding con mode: secure 2026-02-22T21:35:24.219 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a7eeff50) adding con mode: crc 2026-02-22T21:35:24.219 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a7eeff50) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.219 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a7eeff50) adding con mode: crc 2026-02-22T21:35:24.219 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a7eeff50) adding con mode: secure 2026-02-22T21:35:24.219 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a7eeff50) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.219 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a7eeff50) adding con mode: crc 2026-02-22T21:35:24.219 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a7eeff50) adding con mode: secure 2026-02-22T21:35:24.220 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a7eeff50) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.220 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a7eeff50) adding con mode: crc 2026-02-22T21:35:24.220 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a7eeff50) adding con mode: secure 2026-02-22T21:35:24.220 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a7eeff50) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.220 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 10 AuthRegistry(0x7f00a7eeff50) _refresh_config cluster_methods [2] service_methods [2] client_methods [2] 2026-02-22T21:35:24.220 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 10 AuthRegistry(0x7f00a7eeff50) _refresh_config mon_cluster_modes [2,1] mon_service_modes [2,1] mon_client_modes [2,1]; cluster_modes [1,2] service_modes [1,2] client_modes [1,2] 2026-02-22T21:35:24.220 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:24.224 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:24.224 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 10 monclient: _reopen_session rank -1 2026-02-22T21:35:24.224 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 10 monclient: _add_conns ranks=[0] 2026-02-22T21:35:24.224 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 10 monclient(hunting): picked mon.noname-a con 0x7f00a01574a0 addr v1:10.20.193.23:6789/0 2026-02-22T21:35:24.224 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 1 -- --> v1:10.20.193.23:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x7f00a00bfd30 con 0x7f00a01574a0 2026-02-22T21:35:24.224 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 10 monclient(hunting): _renew_subs 2026-02-22T21:35:24.224 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 10 monclient(hunting): authenticate will time out at 596.431390s 2026-02-22T21:35:24.224 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a5c66640 1 --1- >> v1:10.20.193.23:6789/0 conn(0x7f00a01574a0 0x7f00a00bf620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.23:6789/0 says I am v1:10.20.193.23:43320/0 (socket says 10.20.193.23:43320) 2026-02-22T21:35:24.224 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a5c66640 1 -- 10.20.193.23:0/1276585121 learned_addr learned my addr 10.20.193.23:0/1276585121 (peer_addr_for_me v1:10.20.193.23:0/0) 2026-02-22T21:35:24.224 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 1 -- 10.20.193.23:0/1276585121 <== mon.0 v1:10.20.193.23:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3036319740 0 0) 0x7f00a00bfd30 con 0x7f00a01574a0 2026-02-22T21:35:24.224 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 10 monclient(hunting): _negotiate 2026-02-22T21:35:24.224 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:35:24.224 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:35:24.224 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 10 cephx client: reset 2026-02-22T21:35:24.224 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 10 cephx: set_have_need_key no handler for service auth 2026-02-22T21:35:24.224 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 10 cephx: validate_tickets want 32 have 0 need 32 2026-02-22T21:35:24.225 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 10 cephx client: reset 2026-02-22T21:35:24.225 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 10 monclient(hunting): my global_id is 4248 2026-02-22T21:35:24.225 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 10 cephx client: 0x7f0088003550 handle_response ret = 0 2026-02-22T21:35:24.225 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 10 cephx client: got initial server challenge 97a777c708b5dba0 2026-02-22T21:35:24.225 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 10 cephx client: validate_tickets: want=32 need=32 have=0 2026-02-22T21:35:24.225 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 10 cephx: set_have_need_key no handler for service auth 2026-02-22T21:35:24.225 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 10 cephx: validate_tickets want 32 have 0 need 32 2026-02-22T21:35:24.225 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 10 cephx client: want=32 need=32 have=0 2026-02-22T21:35:24.225 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 10 cephx client: build_request 2026-02-22T21:35:24.225 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 10 cephx client: get auth session key: client_challenge 18d37dcd6682e104 2026-02-22T21:35:24.225 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 1 -- 10.20.193.23:0/1276585121 --> v1:10.20.193.23:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0088003630 con 0x7f00a01574a0 2026-02-22T21:35:24.225 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 1 -- 10.20.193.23:0/1276585121 <== mon.0 v1:10.20.193.23:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1338838948 0 0) 0x7f0088003630 con 0x7f00a01574a0 2026-02-22T21:35:24.225 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 10 cephx client: 0x7f0088003550 handle_response ret = 0 2026-02-22T21:35:24.225 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 10 cephx client: get_auth_session_key 2026-02-22T21:35:24.225 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 10 cephx: verify_service_ticket_reply got 1 keys 2026-02-22T21:35:24.225 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 10 cephx: got key for service_id auth 2026-02-22T21:35:24.225 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 10 cephx: verify_service_ticket_reply ticket.secret_id=2 2026-02-22T21:35:24.225 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 10 cephx: verify_service_ticket_reply service auth secret_id 2 session_key AQCcdptpGGXdDBAANqZCpAYIKMWH67pj4nl/xA== validity=660.000000 2026-02-22T21:35:24.225 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 10 cephx: verify_service_ticket_reply ticket expires=2026-02-22T21:46:24.215918+0000 renew_after=2026-02-22T21:43:39.215918+0000 2026-02-22T21:35:24.225 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 10 cephx client: want=32 need=32 have=0 2026-02-22T21:35:24.225 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 10 cephx client: got connection bl 0 and extra tickets 0 2026-02-22T21:35:24.225 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 10 cephx: validate_tickets want 32 have 32 need 0 2026-02-22T21:35:24.225 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 10 monclient: _finish_hunting 0 2026-02-22T21:35:24.225 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 1 monclient: found mon.noname-a 2026-02-22T21:35:24.226 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.23:6789/0 2026-02-22T21:35:24.226 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 1 -- 10.20.193.23:0/1276585121 --> v1:10.20.193.23:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00a0166390 con 0x7f00a01574a0 2026-02-22T21:35:24.226 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 10 monclient: _finish_auth 0 2026-02-22T21:35:24.226 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 10 monclient: _check_auth_tickets 2026-02-22T21:35:24.226 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 10 cephx: validate_tickets want 32 have 32 need 0 2026-02-22T21:35:24.226 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 20 cephx client: need_tickets: want=32 have=32 need=0 2026-02-22T21:35:24.226 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 10 monclient: _check_auth_rotating renewing rotating keys (they expired before 2026-02-22T21:34:54.215930+0000) 2026-02-22T21:35:24.226 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 10 cephx client: build_rotating_request 2026-02-22T21:35:24.226 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.23:6789/0 2026-02-22T21:35:24.226 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 1 -- 10.20.193.23:0/1276585121 --> v1:10.20.193.23:6789/0 -- auth(proto 2 2 bytes epoch 0) -- 0x7f00a00bfd30 con 0x7f00a01574a0 2026-02-22T21:35:24.226 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 1 -- 10.20.193.23:0/1276585121 <== mon.0 v1:10.20.193.23:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7f0090002e20 con 0x7f00a01574a0 2026-02-22T21:35:24.226 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:35:24.226 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T21:35:24.226 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 10 monclient: dump: 2026-02-22T21:35:24.226 INFO:tasks.workunit.client.0.trial023.stderr:epoch 1 2026-02-22T21:35:24.226 INFO:tasks.workunit.client.0.trial023.stderr:fsid e2dd7ed3-13e8-4519-aab8-5d5a54f80255 2026-02-22T21:35:24.226 INFO:tasks.workunit.client.0.trial023.stderr:last_changed 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:24.226 INFO:tasks.workunit.client.0.trial023.stderr:created 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:24.226 INFO:tasks.workunit.client.0.trial023.stderr:min_mon_release 19 (squid) 2026-02-22T21:35:24.226 INFO:tasks.workunit.client.0.trial023.stderr:election_strategy: 3 2026-02-22T21:35:24.226 INFO:tasks.workunit.client.0.trial023.stderr:0: v1:10.20.193.23:6789/0 mon.a 2026-02-22T21:35:24.226 INFO:tasks.workunit.client.0.trial023.stderr: 2026-02-22T21:35:24.226 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 5 monclient: authenticate success, global_id 4248 2026-02-22T21:35:24.227 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 1 -- 10.20.193.23:0/1276585121 <== mon.0 v1:10.20.193.23:6789/0 4 ==== config(1 keys) ==== 25+0+0 (unknown 1514702568 0 0) 0x7f00900030a0 con 0x7f00a01574a0 2026-02-22T21:35:24.227 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 10 monclient: handle_config config(1 keys) 2026-02-22T21:35:24.227 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 10 monclient: get_monmap_and_config success 2026-02-22T21:35:24.227 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 4 set_mon_vals no callback set 2026-02-22T21:35:24.227 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 1 -- 10.20.193.23:0/1276585121 <== mon.0 v1:10.20.193.23:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7f0090003510 con 0x7f00a01574a0 2026-02-22T21:35:24.227 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:35:24.227 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T21:35:24.227 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a7ef1640 10 set_mon_vals mgr_pool = false 2026-02-22T21:35:24.227 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 10 monclient: dump: 2026-02-22T21:35:24.227 INFO:tasks.workunit.client.0.trial023.stderr:epoch 1 2026-02-22T21:35:24.227 INFO:tasks.workunit.client.0.trial023.stderr:fsid e2dd7ed3-13e8-4519-aab8-5d5a54f80255 2026-02-22T21:35:24.227 INFO:tasks.workunit.client.0.trial023.stderr:last_changed 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:24.227 INFO:tasks.workunit.client.0.trial023.stderr:created 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:24.227 INFO:tasks.workunit.client.0.trial023.stderr:min_mon_release 19 (squid) 2026-02-22T21:35:24.227 INFO:tasks.workunit.client.0.trial023.stderr:election_strategy: 3 2026-02-22T21:35:24.227 INFO:tasks.workunit.client.0.trial023.stderr:0: v1:10.20.193.23:6789/0 mon.a 2026-02-22T21:35:24.227 INFO:tasks.workunit.client.0.trial023.stderr: 2026-02-22T21:35:24.227 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 1 -- 10.20.193.23:0/1276585121 <== mon.0 v1:10.20.193.23:6789/0 6 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (unknown 3485261281 0 0) 0x7f00a00bfd30 con 0x7f00a01574a0 2026-02-22T21:35:24.227 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 10 cephx client: 0x7f0088003550 handle_response ret = 0 2026-02-22T21:35:24.227 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 10 cephx client: get_rotating_key 2026-02-22T21:35:24.227 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 10 auth: dump_rotating: 2026-02-22T21:35:24.227 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 10 auth: id 1 AQBddptpfYjTLhAAXh1N3uFywlax+2y6vwZmsw== expires 2026-02-22T21:38:21.785614+0000 2026-02-22T21:35:24.228 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 10 auth: id 2 AQBddptpiI/TLhAAdz7mEzTpWi2a8fttyDShuw== expires 2026-02-22T21:42:21.785614+0000 2026-02-22T21:35:24.228 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 10 auth: id 3 AQBddptpNJfTLhAA8yUoZRot9tLYY9D+lZZAdA== expires 2026-02-22T21:46:21.785614+0000 2026-02-22T21:35:24.228 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 10 monclient: _finish_auth 0 2026-02-22T21:35:24.228 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 10 monclient: _check_auth_tickets 2026-02-22T21:35:24.228 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 10 cephx: validate_tickets want 32 have 32 need 0 2026-02-22T21:35:24.228 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 20 cephx client: need_tickets: want=32 have=32 need=0 2026-02-22T21:35:24.228 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2026-02-22T21:34:54.216044+0000) 2026-02-22T21:35:24.228 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 10 auth: dump_rotating: 2026-02-22T21:35:24.228 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 10 auth: id 1 AQBddptpfYjTLhAAXh1N3uFywlax+2y6vwZmsw== expires 2026-02-22T21:38:21.785614+0000 2026-02-22T21:35:24.228 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 10 auth: id 2 AQBddptpiI/TLhAAdz7mEzTpWi2a8fttyDShuw== expires 2026-02-22T21:42:21.785614+0000 2026-02-22T21:35:24.228 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.208+0000 7f00a4c64640 10 auth: id 3 AQBddptpNJfTLhAA8yUoZRot9tLYY9D+lZZAdA== expires 2026-02-22T21:46:21.785614+0000 2026-02-22T21:35:24.228 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 10 monclient: shutdown 2026-02-22T21:35:24.228 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 1 -- 10.20.193.23:0/1276585121 >> v1:10.20.193.23:6789/0 conn(0x7f00a01574a0 legacy=0x7f00a00bf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:35:24.228 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 1 -- 10.20.193.23:0/1276585121 shutdown_connections 2026-02-22T21:35:24.228 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 1 -- 10.20.193.23:0/1276585121 >> 10.20.193.23:0/1276585121 conn(0x7f00a006e5f0 msgr2=0x7f00a006e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:35:24.228 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 1 -- 10.20.193.23:0/1276585121 shutdown_connections 2026-02-22T21:35:24.228 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 1 -- 10.20.193.23:0/1276585121 wait complete. 2026-02-22T21:35:24.228 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding auth protocol: cephx 2026-02-22T21:35:24.228 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a0067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.228 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding auth protocol: cephx 2026-02-22T21:35:24.228 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a0067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.228 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding auth protocol: cephx 2026-02-22T21:35:24.229 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a0067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.229 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding con mode: secure 2026-02-22T21:35:24.229 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding con mode: crc 2026-02-22T21:35:24.229 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a0067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.229 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding con mode: secure 2026-02-22T21:35:24.229 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding con mode: crc 2026-02-22T21:35:24.229 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a0067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.229 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding con mode: secure 2026-02-22T21:35:24.229 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding con mode: crc 2026-02-22T21:35:24.229 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a0067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.229 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding con mode: crc 2026-02-22T21:35:24.229 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding con mode: secure 2026-02-22T21:35:24.229 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a0067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.229 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding con mode: crc 2026-02-22T21:35:24.229 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding con mode: secure 2026-02-22T21:35:24.229 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a0067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.229 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding con mode: crc 2026-02-22T21:35:24.229 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding con mode: secure 2026-02-22T21:35:24.229 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a0067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.229 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 10 AuthRegistry(0x7f00a0067010) _refresh_config cluster_methods [2] service_methods [2] client_methods [2] 2026-02-22T21:35:24.229 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 10 AuthRegistry(0x7f00a0067010) _refresh_config mon_cluster_modes [2,1] mon_service_modes [2,1] mon_client_modes [2,1]; cluster_modes [1,2] service_modes [1,2] client_modes [1,2] 2026-02-22T21:35:24.229 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:24.229 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 10 monclient: build_initial_monmap 2026-02-22T21:35:24.230 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 10 monclient: monmap: 2026-02-22T21:35:24.230 INFO:tasks.workunit.client.0.trial023.stderr:epoch 0 2026-02-22T21:35:24.230 INFO:tasks.workunit.client.0.trial023.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T21:35:24.230 INFO:tasks.workunit.client.0.trial023.stderr:last_changed 0.000000 2026-02-22T21:35:24.230 INFO:tasks.workunit.client.0.trial023.stderr:created 0.000000 2026-02-22T21:35:24.230 INFO:tasks.workunit.client.0.trial023.stderr:min_mon_release 0 (unknown) 2026-02-22T21:35:24.230 INFO:tasks.workunit.client.0.trial023.stderr:election_strategy: 1 2026-02-22T21:35:24.230 INFO:tasks.workunit.client.0.trial023.stderr:0: v1:10.20.193.23:6789/0 mon.noname-a 2026-02-22T21:35:24.230 INFO:tasks.workunit.client.0.trial023.stderr: 2026-02-22T21:35:24.230 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a014f920) adding auth protocol: cephx 2026-02-22T21:35:24.230 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a014f920) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.230 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a014f920) adding auth protocol: cephx 2026-02-22T21:35:24.230 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a014f920) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.230 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a014f920) adding auth protocol: cephx 2026-02-22T21:35:24.230 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a014f920) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.230 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a014f920) adding con mode: secure 2026-02-22T21:35:24.230 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a014f920) adding con mode: crc 2026-02-22T21:35:24.230 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a014f920) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.230 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a014f920) adding con mode: secure 2026-02-22T21:35:24.230 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a014f920) adding con mode: crc 2026-02-22T21:35:24.230 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a014f920) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.230 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a014f920) adding con mode: secure 2026-02-22T21:35:24.230 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a014f920) adding con mode: crc 2026-02-22T21:35:24.230 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a014f920) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.231 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a014f920) adding con mode: crc 2026-02-22T21:35:24.231 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a014f920) adding con mode: secure 2026-02-22T21:35:24.231 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a014f920) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.231 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a014f920) adding con mode: crc 2026-02-22T21:35:24.231 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a014f920) adding con mode: secure 2026-02-22T21:35:24.231 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a014f920) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.231 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a014f920) adding con mode: crc 2026-02-22T21:35:24.231 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a014f920) adding con mode: secure 2026-02-22T21:35:24.231 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a014f920) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.231 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 10 AuthRegistry(0x7f00a014f920) _refresh_config cluster_methods [2] service_methods [2] client_methods [2] 2026-02-22T21:35:24.231 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 10 AuthRegistry(0x7f00a014f920) _refresh_config mon_cluster_modes [2,1] mon_service_modes [2,1] mon_client_modes [2,1]; cluster_modes [1,2] service_modes [1,2] client_modes [1,2] 2026-02-22T21:35:24.231 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:24.231 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 1 Processor -- start 2026-02-22T21:35:24.231 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 1 -- start start 2026-02-22T21:35:24.231 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 10 monclient: init 2026-02-22T21:35:24.231 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding auth protocol: cephx 2026-02-22T21:35:24.231 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a0067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.231 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding auth protocol: cephx 2026-02-22T21:35:24.231 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a0067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.231 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding auth protocol: cephx 2026-02-22T21:35:24.231 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a0067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.231 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding con mode: secure 2026-02-22T21:35:24.231 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding con mode: crc 2026-02-22T21:35:24.232 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a0067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.232 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding con mode: secure 2026-02-22T21:35:24.232 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding con mode: crc 2026-02-22T21:35:24.232 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a0067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.232 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding con mode: secure 2026-02-22T21:35:24.232 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding con mode: crc 2026-02-22T21:35:24.232 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a0067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.232 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding con mode: crc 2026-02-22T21:35:24.232 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding con mode: secure 2026-02-22T21:35:24.232 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a0067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.232 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding con mode: crc 2026-02-22T21:35:24.232 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding con mode: secure 2026-02-22T21:35:24.232 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a0067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.232 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding con mode: crc 2026-02-22T21:35:24.232 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 5 AuthRegistry(0x7f00a0067010) adding con mode: secure 2026-02-22T21:35:24.232 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 20 AuthRegistry(0x7f00a0067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.232 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 10 AuthRegistry(0x7f00a0067010) _refresh_config cluster_methods [2] service_methods [2] client_methods [2] 2026-02-22T21:35:24.232 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 10 AuthRegistry(0x7f00a0067010) _refresh_config mon_cluster_modes [2,1] mon_service_modes [2,1] mon_client_modes [2,1]; cluster_modes [1,2] service_modes [1,2] client_modes [1,2] 2026-02-22T21:35:24.232 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:24.232 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:24.232 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 10 monclient: _reopen_session rank -1 2026-02-22T21:35:24.232 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 10 monclient: _add_conns ranks=[0] 2026-02-22T21:35:24.232 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 10 monclient(hunting): picked mon.noname-a con 0x7f00a01574a0 addr v1:10.20.193.23:6789/0 2026-02-22T21:35:24.233 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 1 -- --> v1:10.20.193.23:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x7f00a0145e30 con 0x7f00a01574a0 2026-02-22T21:35:24.233 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 10 monclient(hunting): _renew_subs 2026-02-22T21:35:24.233 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 10 monclient(hunting): authenticate will time out at 596.434186s 2026-02-22T21:35:24.233 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a5c66640 1 --1- >> v1:10.20.193.23:6789/0 conn(0x7f00a01574a0 0x7f00a01ed380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.23:6789/0 says I am v1:10.20.193.23:43332/0 (socket says 10.20.193.23:43332) 2026-02-22T21:35:24.233 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a5c66640 1 -- 10.20.193.23:0/1803287744 learned_addr learned my addr 10.20.193.23:0/1803287744 (peer_addr_for_me v1:10.20.193.23:0/0) 2026-02-22T21:35:24.233 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 1 -- 10.20.193.23:0/1803287744 <== mon.0 v1:10.20.193.23:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3702856326 0 0) 0x7f00a0145e30 con 0x7f00a01574a0 2026-02-22T21:35:24.233 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 monclient(hunting): _negotiate 2026-02-22T21:35:24.233 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:35:24.233 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:35:24.233 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx client: reset 2026-02-22T21:35:24.233 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx: set_have_need_key no handler for service mon 2026-02-22T21:35:24.233 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx: set_have_need_key no handler for service osd 2026-02-22T21:35:24.233 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx: set_have_need_key no handler for service mgr 2026-02-22T21:35:24.233 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx: set_have_need_key no handler for service auth 2026-02-22T21:35:24.233 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx: validate_tickets want 53 have 0 need 53 2026-02-22T21:35:24.233 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx client: reset 2026-02-22T21:35:24.233 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 monclient(hunting): my global_id is 4249 2026-02-22T21:35:24.233 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx client: 0x7f007c003550 handle_response ret = 0 2026-02-22T21:35:24.233 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx client: got initial server challenge 55c950b3d07ecea0 2026-02-22T21:35:24.233 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx client: validate_tickets: want=53 need=53 have=0 2026-02-22T21:35:24.233 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx: set_have_need_key no handler for service mon 2026-02-22T21:35:24.233 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx: set_have_need_key no handler for service osd 2026-02-22T21:35:24.234 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx: set_have_need_key no handler for service mgr 2026-02-22T21:35:24.234 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx: set_have_need_key no handler for service auth 2026-02-22T21:35:24.234 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx: validate_tickets want 53 have 0 need 53 2026-02-22T21:35:24.234 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx client: want=53 need=53 have=0 2026-02-22T21:35:24.234 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx client: build_request 2026-02-22T21:35:24.234 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx client: get auth session key: client_challenge 2f69e007623f4c99 2026-02-22T21:35:24.234 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 1 -- 10.20.193.23:0/1803287744 --> v1:10.20.193.23:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f007c003630 con 0x7f00a01574a0 2026-02-22T21:35:24.234 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 1 -- 10.20.193.23:0/1803287744 <== mon.0 v1:10.20.193.23:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 732+0+0 (unknown 2674019820 0 0) 0x7f007c003630 con 0x7f00a01574a0 2026-02-22T21:35:24.234 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx client: 0x7f007c003550 handle_response ret = 0 2026-02-22T21:35:24.234 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx client: get_auth_session_key 2026-02-22T21:35:24.234 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx: verify_service_ticket_reply got 1 keys 2026-02-22T21:35:24.234 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx: got key for service_id auth 2026-02-22T21:35:24.234 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx: verify_service_ticket_reply ticket.secret_id=2 2026-02-22T21:35:24.234 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx: verify_service_ticket_reply service auth secret_id 2 session_key AQCcdptpoNgGDRAAQyiUsraDuGxE+60YfMOcGg== validity=660.000000 2026-02-22T21:35:24.234 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx: verify_service_ticket_reply ticket expires=2026-02-22T21:46:24.218655+0000 renew_after=2026-02-22T21:43:39.218655+0000 2026-02-22T21:35:24.234 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx client: want=53 need=53 have=0 2026-02-22T21:35:24.234 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx client: got connection bl 0 and extra tickets 518 2026-02-22T21:35:24.234 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx: set_have_need_key no handler for service mon 2026-02-22T21:35:24.234 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx: set_have_need_key no handler for service osd 2026-02-22T21:35:24.234 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx: set_have_need_key no handler for service mgr 2026-02-22T21:35:24.234 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx: validate_tickets want 53 have 32 need 21 2026-02-22T21:35:24.234 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx client: validate_tickets: want=53 need=21 have=32 2026-02-22T21:35:24.234 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx: set_have_need_key no handler for service mon 2026-02-22T21:35:24.234 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx: set_have_need_key no handler for service osd 2026-02-22T21:35:24.235 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx: set_have_need_key no handler for service mgr 2026-02-22T21:35:24.235 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx: validate_tickets want 53 have 32 need 21 2026-02-22T21:35:24.235 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx client: want=53 need=21 have=32 2026-02-22T21:35:24.235 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx client: build_request 2026-02-22T21:35:24.235 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx client: get service keys: want=53 need=21 have=32 2026-02-22T21:35:24.235 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 1 -- 10.20.193.23:0/1803287744 --> v1:10.20.193.23:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f00a0145e30 con 0x7f00a01574a0 2026-02-22T21:35:24.235 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 1 -- 10.20.193.23:0/1803287744 <== mon.0 v1:10.20.193.23:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7f0090003250 con 0x7f00a01574a0 2026-02-22T21:35:24.235 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T21:35:24.235 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T21:35:24.235 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 monclient(hunting): dump: 2026-02-22T21:35:24.235 INFO:tasks.workunit.client.0.trial023.stderr:epoch 1 2026-02-22T21:35:24.235 INFO:tasks.workunit.client.0.trial023.stderr:fsid e2dd7ed3-13e8-4519-aab8-5d5a54f80255 2026-02-22T21:35:24.235 INFO:tasks.workunit.client.0.trial023.stderr:last_changed 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:24.235 INFO:tasks.workunit.client.0.trial023.stderr:created 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:24.235 INFO:tasks.workunit.client.0.trial023.stderr:min_mon_release 19 (squid) 2026-02-22T21:35:24.235 INFO:tasks.workunit.client.0.trial023.stderr:election_strategy: 3 2026-02-22T21:35:24.235 INFO:tasks.workunit.client.0.trial023.stderr:0: v1:10.20.193.23:6789/0 mon.a 2026-02-22T21:35:24.235 INFO:tasks.workunit.client.0.trial023.stderr: 2026-02-22T21:35:24.235 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 monclient(hunting): _finish_auth 0 2026-02-22T21:35:24.235 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 1 -- 10.20.193.23:0/1803287744 <== mon.0 v1:10.20.193.23:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 548+0+0 (unknown 3406602950 0 0) 0x7f00a0145e30 con 0x7f00a01574a0 2026-02-22T21:35:24.235 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx client: 0x7f007c003550 handle_response ret = 0 2026-02-22T21:35:24.235 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx client: get_principal_session_key session_key AQCcdptpoNgGDRAAQyiUsraDuGxE+60YfMOcGg== 2026-02-22T21:35:24.235 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx: verify_service_ticket_reply got 3 keys 2026-02-22T21:35:24.235 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx: got key for service_id mon 2026-02-22T21:35:24.236 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx: verify_service_ticket_reply ticket.secret_id=2 2026-02-22T21:35:24.236 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx: verify_service_ticket_reply service mon secret_id 2 session_key AQCcdptppr0JDRAAqvjEUwd5bURh1qlH+w/GkA== validity=240.000000 2026-02-22T21:35:24.236 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx: verify_service_ticket_reply ticket expires=2026-02-22T21:39:24.218807+0000 renew_after=2026-02-22T21:38:24.218807+0000 2026-02-22T21:35:24.236 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx: got key for service_id osd 2026-02-22T21:35:24.236 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx: verify_service_ticket_reply ticket.secret_id=2 2026-02-22T21:35:24.236 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx: verify_service_ticket_reply service osd secret_id 2 session_key AQCcdptpiMYJDRAAr90UxccMo5TGM1S3sBFyZA== validity=240.000000 2026-02-22T21:35:24.236 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx: verify_service_ticket_reply ticket expires=2026-02-22T21:39:24.218815+0000 renew_after=2026-02-22T21:38:24.218815+0000 2026-02-22T21:35:24.236 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx: got key for service_id mgr 2026-02-22T21:35:24.236 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx: verify_service_ticket_reply ticket.secret_id=2 2026-02-22T21:35:24.236 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx: verify_service_ticket_reply service mgr secret_id 2 session_key AQCcdptpN9EJDRAAkjktmCUvMA/YCv+/0CSNOQ== validity=240.000000 2026-02-22T21:35:24.236 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx: verify_service_ticket_reply ticket expires=2026-02-22T21:39:24.218820+0000 renew_after=2026-02-22T21:38:24.218820+0000 2026-02-22T21:35:24.236 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx: validate_tickets want 53 have 53 need 0 2026-02-22T21:35:24.236 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 monclient: _finish_hunting 0 2026-02-22T21:35:24.236 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 1 monclient: found mon.a 2026-02-22T21:35:24.236 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.23:6789/0 2026-02-22T21:35:24.236 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 1 -- 10.20.193.23:0/1803287744 --> v1:10.20.193.23:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00a0146bc0 con 0x7f00a01574a0 2026-02-22T21:35:24.236 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 monclient: _finish_auth 0 2026-02-22T21:35:24.236 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 monclient: _check_auth_tickets 2026-02-22T21:35:24.236 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx: validate_tickets want 53 have 53 need 0 2026-02-22T21:35:24.236 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 20 cephx client: need_tickets: want=53 have=53 need=0 2026-02-22T21:35:24.236 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 monclient: _check_auth_rotating renewing rotating keys (they expired before 2026-02-22T21:34:54.218835+0000) 2026-02-22T21:35:24.236 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx client: build_rotating_request 2026-02-22T21:35:24.237 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.23:6789/0 2026-02-22T21:35:24.237 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 1 -- 10.20.193.23:0/1803287744 --> v1:10.20.193.23:6789/0 -- auth(proto 2 2 bytes epoch 0) -- 0x7f007c003630 con 0x7f00a01574a0 2026-02-22T21:35:24.237 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 5 monclient: authenticate success, global_id 4249 2026-02-22T21:35:24.237 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 10 monclient: _renew_subs 2026-02-22T21:35:24.237 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.23:6789/0 2026-02-22T21:35:24.237 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 1 -- 10.20.193.23:0/1803287744 --> v1:10.20.193.23:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f00a00c3110 con 0x7f00a01574a0 2026-02-22T21:35:24.237 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 10 monclient: _renew_subs 2026-02-22T21:35:24.237 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.23:6789/0 2026-02-22T21:35:24.237 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 1 -- 10.20.193.23:0/1803287744 --> v1:10.20.193.23:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f00a00c2920 con 0x7f00a01574a0 2026-02-22T21:35:24.237 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 1 -- 10.20.193.23:0/1803287744 <== mon.0 v1:10.20.193.23:6789/0 5 ==== config(1 keys) ==== 25+0+0 (unknown 1514702568 0 0) 0x7f00900034b0 con 0x7f00a01574a0 2026-02-22T21:35:24.237 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 monclient: handle_config config(1 keys) 2026-02-22T21:35:24.237 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 1 -- 10.20.193.23:0/1803287744 <== mon.0 v1:10.20.193.23:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7f00900030a0 con 0x7f00a01574a0 2026-02-22T21:35:24.237 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:35:24.237 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T21:35:24.237 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 monclient: dump: 2026-02-22T21:35:24.237 INFO:tasks.workunit.client.0.trial023.stderr:epoch 1 2026-02-22T21:35:24.237 INFO:tasks.workunit.client.0.trial023.stderr:fsid e2dd7ed3-13e8-4519-aab8-5d5a54f80255 2026-02-22T21:35:24.237 INFO:tasks.workunit.client.0.trial023.stderr:last_changed 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:24.237 INFO:tasks.workunit.client.0.trial023.stderr:created 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:24.237 INFO:tasks.workunit.client.0.trial023.stderr:min_mon_release 19 (squid) 2026-02-22T21:35:24.237 INFO:tasks.workunit.client.0.trial023.stderr:election_strategy: 3 2026-02-22T21:35:24.237 INFO:tasks.workunit.client.0.trial023.stderr:0: v1:10.20.193.23:6789/0 mon.a 2026-02-22T21:35:24.237 INFO:tasks.workunit.client.0.trial023.stderr: 2026-02-22T21:35:24.238 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008ffff640 4 set_mon_vals no callback set 2026-02-22T21:35:24.238 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 1 -- 10.20.193.23:0/1803287744 <== mon.0 v1:10.20.193.23:6789/0 7 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (unknown 2803578270 0 0) 0x7f00a00c2920 con 0x7f00a01574a0 2026-02-22T21:35:24.238 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx client: 0x7f007c003550 handle_response ret = 0 2026-02-22T21:35:24.238 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx client: get_rotating_key 2026-02-22T21:35:24.238 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 auth: dump_rotating: 2026-02-22T21:35:24.238 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 auth: id 1 AQBddptpfYjTLhAAXh1N3uFywlax+2y6vwZmsw== expires 2026-02-22T21:38:21.785614+0000 2026-02-22T21:35:24.238 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 auth: id 2 AQBddptpiI/TLhAAdz7mEzTpWi2a8fttyDShuw== expires 2026-02-22T21:42:21.785614+0000 2026-02-22T21:35:24.238 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 auth: id 3 AQBddptpNJfTLhAA8yUoZRot9tLYY9D+lZZAdA== expires 2026-02-22T21:46:21.785614+0000 2026-02-22T21:35:24.238 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 monclient: _finish_auth 0 2026-02-22T21:35:24.238 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 monclient: _check_auth_tickets 2026-02-22T21:35:24.238 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 cephx: validate_tickets want 53 have 53 need 0 2026-02-22T21:35:24.238 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 20 cephx client: need_tickets: want=53 have=53 need=0 2026-02-22T21:35:24.238 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2026-02-22T21:34:54.218980+0000) 2026-02-22T21:35:24.238 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 auth: dump_rotating: 2026-02-22T21:35:24.238 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 auth: id 1 AQBddptpfYjTLhAAXh1N3uFywlax+2y6vwZmsw== expires 2026-02-22T21:38:21.785614+0000 2026-02-22T21:35:24.238 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 auth: id 2 AQBddptpiI/TLhAAdz7mEzTpWi2a8fttyDShuw== expires 2026-02-22T21:42:21.785614+0000 2026-02-22T21:35:24.238 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 10 auth: id 3 AQBddptpNJfTLhAA8yUoZRot9tLYY9D+lZZAdA== expires 2026-02-22T21:46:21.785614+0000 2026-02-22T21:35:24.238 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T21:35:24.238 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:35:24.238 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.23:6789/0 2026-02-22T21:35:24.238 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a7ef1640 1 -- 10.20.193.23:0/1803287744 --> v1:10.20.193.23:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00a00008e0 con 0x7f00a01574a0 2026-02-22T21:35:24.238 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 1 -- 10.20.193.23:0/1803287744 <== mon.0 v1:10.20.193.23:6789/0 8 ==== mgrmap(e 4) ==== 47400+0+0 (unknown 1603120368 0 0) 0x7f0090010a70 con 0x7f00a01574a0 2026-02-22T21:35:24.238 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f008effd640 1 -- 10.20.193.23:0/1803287744 <== mon.0 v1:10.20.193.23:6789/0 9 ==== osd_map(14..14 src has 1..14) ==== 2160+0+0 (unknown 946035718 0 0) 0x7f0090048fe0 con 0x7f00a01574a0 2026-02-22T21:35:24.239 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a5465640 10 monclient: get_auth_request con 0x7f007c03ba20 auth_method 0 2026-02-22T21:35:24.239 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a5465640 10 cephx client: build_authorizer for service mgr 2026-02-22T21:35:24.239 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.212+0000 7f00a5465640 10 In get_auth_session_handler for protocol 2 2026-02-22T21:35:24.239 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.216+0000 7f008effd640 1 -- 10.20.193.23:0/1803287744 <== mon.0 v1:10.20.193.23:6789/0 10 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (unknown 1092875540 0 3570997608) 0x7f0090016c70 con 0x7f00a01574a0 2026-02-22T21:35:24.239 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.216+0000 7f008effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:35:24.239 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.216+0000 7f008effd640 10 monclient: _finish_command 1 = system:0 2026-02-22T21:35:24.332 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.324+0000 7f00a7ef1640 10 start_mon_command cmd=[{"prefix": "config-key get", "key": "device/test-foo"}] 2026-02-22T21:35:24.333 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.324+0000 7f00a7ef1640 10 monclient: _send_command 2 [{"prefix": "config-key get", "key": "device/test-foo"}] 2026-02-22T21:35:24.333 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.324+0000 7f00a7ef1640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.23:6789/0 2026-02-22T21:35:24.333 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.324+0000 7f00a7ef1640 1 -- 10.20.193.23:0/1803287744 --> v1:10.20.193.23:6789/0 -- mon_command({"prefix": "config-key get", "key": "device/test-foo"} v 0) -- 0x7f00a00c1aa0 con 0x7f00a01574a0 2026-02-22T21:35:24.333 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.328+0000 7f008effd640 1 -- 10.20.193.23:0/1803287744 <== mon.0 v1:10.20.193.23:6789/0 11 ==== mon_command_ack([{"prefix": "config-key get", "key": "device/test-foo"}]=0 v13) ==== 88+0+0 (unknown 1708176172 0 0) 0x7f0090016570 con 0x7f00a01574a0 2026-02-22T21:35:24.333 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.328+0000 7f008effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config-key get", "key": "device/test-foo"}] 2026-02-22T21:35:24.333 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.328+0000 7f008effd640 10 monclient: _finish_command 2 = system:0 2026-02-22T21:35:24.410 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.404+0000 7f00a7ef1640 10 start_mon_command cmd=[{"prefix": "config-key get", "key": "device/test-foo"}] 2026-02-22T21:35:24.410 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.404+0000 7f00a7ef1640 10 monclient: _send_command 3 [{"prefix": "config-key get", "key": "device/test-foo"}] 2026-02-22T21:35:24.411 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.404+0000 7f00a7ef1640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.23:6789/0 2026-02-22T21:35:24.411 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.404+0000 7f00a7ef1640 1 -- 10.20.193.23:0/1803287744 --> v1:10.20.193.23:6789/0 -- mon_command({"prefix": "config-key get", "key": "device/test-foo"} v 0) -- 0x7f00a0165c20 con 0x7f00a01574a0 2026-02-22T21:35:24.411 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.404+0000 7f008effd640 1 -- 10.20.193.23:0/1803287744 <== mon.0 v1:10.20.193.23:6789/0 12 ==== mon_command_ack([{"prefix": "config-key get", "key": "device/test-foo"}]=0 v13) ==== 88+0+0 (unknown 1708176172 0 0) 0x7f0090047440 con 0x7f00a01574a0 2026-02-22T21:35:24.411 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.404+0000 7f008effd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "config-key get", "key": "device/test-foo"}] 2026-02-22T21:35:24.411 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.404+0000 7f008effd640 10 monclient: _finish_command 3 = system:0 2026-02-22T21:35:24.412 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.404+0000 7f00a7ef1640 1 -- 10.20.193.23:0/1803287744 >> v1:10.20.193.23:6800/2834055528 conn(0x7f007c03ba20 legacy=0x7f007c03dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:35:24.412 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.404+0000 7f00a7ef1640 10 monclient: shutdown 2026-02-22T21:35:24.412 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.404+0000 7f00a7ef1640 1 -- 10.20.193.23:0/1803287744 >> v1:10.20.193.23:6789/0 conn(0x7f00a01574a0 legacy=0x7f00a01ed380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:35:24.412 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.404+0000 7f00a7ef1640 1 -- 10.20.193.23:0/1803287744 shutdown_connections 2026-02-22T21:35:24.412 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.404+0000 7f00a7ef1640 1 -- 10.20.193.23:0/1803287744 >> 10.20.193.23:0/1803287744 conn(0x7f00a006e5f0 msgr2=0x7f00a0162c90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:35:24.412 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.404+0000 7f00a7ef1640 1 -- 10.20.193.23:0/1803287744 shutdown_connections 2026-02-22T21:35:24.412 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.404+0000 7f00a7ef1640 1 -- 10.20.193.23:0/1803287744 wait complete. 2026-02-22T21:35:24.419 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name mgr.a config-key get test/foo 2026-02-22T21:35:24.503 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.480+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding auth protocol: cephx 2026-02-22T21:35:24.504 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.480+0000 7f5a912d5640 20 AuthRegistry(0x7f5a8c067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.504 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.480+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding auth protocol: cephx 2026-02-22T21:35:24.504 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.480+0000 7f5a912d5640 20 AuthRegistry(0x7f5a8c067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.504 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.480+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding auth protocol: cephx 2026-02-22T21:35:24.504 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.480+0000 7f5a912d5640 20 AuthRegistry(0x7f5a8c067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.504 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.480+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding con mode: secure 2026-02-22T21:35:24.504 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.480+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding con mode: crc 2026-02-22T21:35:24.504 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.480+0000 7f5a912d5640 20 AuthRegistry(0x7f5a8c067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.504 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.480+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding con mode: secure 2026-02-22T21:35:24.504 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.480+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding con mode: crc 2026-02-22T21:35:24.504 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.480+0000 7f5a912d5640 20 AuthRegistry(0x7f5a8c067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.504 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.480+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding con mode: secure 2026-02-22T21:35:24.504 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.480+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding con mode: crc 2026-02-22T21:35:24.504 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.480+0000 7f5a912d5640 20 AuthRegistry(0x7f5a8c067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.505 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.480+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding con mode: crc 2026-02-22T21:35:24.505 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.480+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding con mode: secure 2026-02-22T21:35:24.505 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.480+0000 7f5a912d5640 20 AuthRegistry(0x7f5a8c067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.505 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.480+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding con mode: crc 2026-02-22T21:35:24.505 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.480+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding con mode: secure 2026-02-22T21:35:24.505 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.480+0000 7f5a912d5640 20 AuthRegistry(0x7f5a8c067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.505 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.480+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding con mode: crc 2026-02-22T21:35:24.505 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.480+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding con mode: secure 2026-02-22T21:35:24.505 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.480+0000 7f5a912d5640 20 AuthRegistry(0x7f5a8c067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.505 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.480+0000 7f5a912d5640 10 AuthRegistry(0x7f5a8c067010) _refresh_config cluster_methods [2] service_methods [2] client_methods [2] 2026-02-22T21:35:24.505 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.480+0000 7f5a912d5640 10 AuthRegistry(0x7f5a8c067010) _refresh_config mon_cluster_modes [2,1] mon_service_modes [2,1] mon_client_modes [2,1]; cluster_modes [1,2] service_modes [1,2] client_modes [1,2] 2026-02-22T21:35:24.505 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.480+0000 7f5a912d5640 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2026-02-22T21:35:24.505 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding auth protocol: cephx 2026-02-22T21:35:24.505 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 20 AuthRegistry(0x7f5a8c067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.506 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding auth protocol: cephx 2026-02-22T21:35:24.506 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 20 AuthRegistry(0x7f5a8c067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.506 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding auth protocol: cephx 2026-02-22T21:35:24.506 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 20 AuthRegistry(0x7f5a8c067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.506 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding con mode: secure 2026-02-22T21:35:24.506 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding con mode: crc 2026-02-22T21:35:24.506 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 20 AuthRegistry(0x7f5a8c067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.506 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding con mode: secure 2026-02-22T21:35:24.506 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding con mode: crc 2026-02-22T21:35:24.506 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 20 AuthRegistry(0x7f5a8c067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.506 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding con mode: secure 2026-02-22T21:35:24.506 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding con mode: crc 2026-02-22T21:35:24.506 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 20 AuthRegistry(0x7f5a8c067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.506 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding con mode: crc 2026-02-22T21:35:24.506 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding con mode: secure 2026-02-22T21:35:24.506 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 20 AuthRegistry(0x7f5a8c067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.507 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding con mode: crc 2026-02-22T21:35:24.507 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding con mode: secure 2026-02-22T21:35:24.507 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 20 AuthRegistry(0x7f5a8c067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.507 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding con mode: crc 2026-02-22T21:35:24.507 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding con mode: secure 2026-02-22T21:35:24.507 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 20 AuthRegistry(0x7f5a8c067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.507 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 10 AuthRegistry(0x7f5a8c067010) _refresh_config cluster_methods [2] service_methods [2] client_methods [2] 2026-02-22T21:35:24.507 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 10 AuthRegistry(0x7f5a8c067010) _refresh_config mon_cluster_modes [2,1] mon_service_modes [2,1] mon_client_modes [2,1]; cluster_modes [1,2] service_modes [1,2] client_modes [1,2] 2026-02-22T21:35:24.507 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:24.507 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 10 monclient: get_monmap_and_config 2026-02-22T21:35:24.507 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 10 monclient: build_initial_monmap 2026-02-22T21:35:24.507 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 10 monclient: monmap: 2026-02-22T21:35:24.507 INFO:tasks.workunit.client.0.trial023.stderr:epoch 0 2026-02-22T21:35:24.507 INFO:tasks.workunit.client.0.trial023.stderr:fsid e2dd7ed3-13e8-4519-aab8-5d5a54f80255 2026-02-22T21:35:24.507 INFO:tasks.workunit.client.0.trial023.stderr:last_changed 2026-02-22T21:35:24.488841+0000 2026-02-22T21:35:24.507 INFO:tasks.workunit.client.0.trial023.stderr:created 2026-02-22T21:35:24.488841+0000 2026-02-22T21:35:24.508 INFO:tasks.workunit.client.0.trial023.stderr:min_mon_release 0 (unknown) 2026-02-22T21:35:24.508 INFO:tasks.workunit.client.0.trial023.stderr:election_strategy: 3 2026-02-22T21:35:24.508 INFO:tasks.workunit.client.0.trial023.stderr:0: v1:10.20.193.23:6789/0 mon.noname-a 2026-02-22T21:35:24.508 INFO:tasks.workunit.client.0.trial023.stderr: 2026-02-22T21:35:24.508 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c068a80) adding auth protocol: cephx 2026-02-22T21:35:24.508 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 20 AuthRegistry(0x7f5a8c068a80) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.508 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c068a80) adding auth protocol: cephx 2026-02-22T21:35:24.508 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 20 AuthRegistry(0x7f5a8c068a80) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.508 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c068a80) adding auth protocol: cephx 2026-02-22T21:35:24.508 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 20 AuthRegistry(0x7f5a8c068a80) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.508 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c068a80) adding con mode: secure 2026-02-22T21:35:24.508 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c068a80) adding con mode: crc 2026-02-22T21:35:24.508 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 20 AuthRegistry(0x7f5a8c068a80) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.508 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c068a80) adding con mode: secure 2026-02-22T21:35:24.508 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c068a80) adding con mode: crc 2026-02-22T21:35:24.509 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 20 AuthRegistry(0x7f5a8c068a80) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.509 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c068a80) adding con mode: secure 2026-02-22T21:35:24.509 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c068a80) adding con mode: crc 2026-02-22T21:35:24.509 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 20 AuthRegistry(0x7f5a8c068a80) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.509 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c068a80) adding con mode: crc 2026-02-22T21:35:24.509 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c068a80) adding con mode: secure 2026-02-22T21:35:24.509 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 20 AuthRegistry(0x7f5a8c068a80) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.509 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c068a80) adding con mode: crc 2026-02-22T21:35:24.509 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c068a80) adding con mode: secure 2026-02-22T21:35:24.509 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 20 AuthRegistry(0x7f5a8c068a80) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.509 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c068a80) adding con mode: crc 2026-02-22T21:35:24.509 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c068a80) adding con mode: secure 2026-02-22T21:35:24.509 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 20 AuthRegistry(0x7f5a8c068a80) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.509 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 10 AuthRegistry(0x7f5a8c068a80) _refresh_config cluster_methods [2] service_methods [2] client_methods [2] 2026-02-22T21:35:24.510 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 10 AuthRegistry(0x7f5a8c068a80) _refresh_config mon_cluster_modes [2,1] mon_service_modes [2,1] mon_client_modes [2,1]; cluster_modes [1,2] service_modes [1,2] client_modes [1,2] 2026-02-22T21:35:24.510 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:24.510 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 1 Processor -- start 2026-02-22T21:35:24.510 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 1 -- start start 2026-02-22T21:35:24.510 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 10 monclient: init 2026-02-22T21:35:24.510 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a912d3f50) adding auth protocol: cephx 2026-02-22T21:35:24.510 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 20 AuthRegistry(0x7f5a912d3f50) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.510 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a912d3f50) adding auth protocol: cephx 2026-02-22T21:35:24.510 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 20 AuthRegistry(0x7f5a912d3f50) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.510 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a912d3f50) adding auth protocol: cephx 2026-02-22T21:35:24.510 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 20 AuthRegistry(0x7f5a912d3f50) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.510 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a912d3f50) adding con mode: secure 2026-02-22T21:35:24.510 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a912d3f50) adding con mode: crc 2026-02-22T21:35:24.510 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 20 AuthRegistry(0x7f5a912d3f50) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.510 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a912d3f50) adding con mode: secure 2026-02-22T21:35:24.510 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a912d3f50) adding con mode: crc 2026-02-22T21:35:24.511 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 20 AuthRegistry(0x7f5a912d3f50) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.511 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a912d3f50) adding con mode: secure 2026-02-22T21:35:24.511 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a912d3f50) adding con mode: crc 2026-02-22T21:35:24.511 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 20 AuthRegistry(0x7f5a912d3f50) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.511 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a912d3f50) adding con mode: crc 2026-02-22T21:35:24.511 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a912d3f50) adding con mode: secure 2026-02-22T21:35:24.511 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 20 AuthRegistry(0x7f5a912d3f50) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.511 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a912d3f50) adding con mode: crc 2026-02-22T21:35:24.511 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a912d3f50) adding con mode: secure 2026-02-22T21:35:24.511 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 20 AuthRegistry(0x7f5a912d3f50) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.511 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a912d3f50) adding con mode: crc 2026-02-22T21:35:24.511 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a912d3f50) adding con mode: secure 2026-02-22T21:35:24.511 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 20 AuthRegistry(0x7f5a912d3f50) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.511 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 10 AuthRegistry(0x7f5a912d3f50) _refresh_config cluster_methods [2] service_methods [2] client_methods [2] 2026-02-22T21:35:24.511 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 10 AuthRegistry(0x7f5a912d3f50) _refresh_config mon_cluster_modes [2,1] mon_service_modes [2,1] mon_client_modes [2,1]; cluster_modes [1,2] service_modes [1,2] client_modes [1,2] 2026-02-22T21:35:24.511 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:24.512 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:24.512 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 10 monclient: _reopen_session rank -1 2026-02-22T21:35:24.512 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 10 monclient: _add_conns ranks=[0] 2026-02-22T21:35:24.512 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 10 monclient(hunting): picked mon.noname-a con 0x7f5a8c14d580 addr v1:10.20.193.23:6789/0 2026-02-22T21:35:24.512 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 1 -- --> v1:10.20.193.23:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x7f5a8c1656c0 con 0x7f5a8c14d580 2026-02-22T21:35:24.512 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 10 monclient(hunting): _renew_subs 2026-02-22T21:35:24.512 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 10 monclient(hunting): authenticate will time out at 596.706395s 2026-02-22T21:35:24.512 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a8affd640 1 --1- >> v1:10.20.193.23:6789/0 conn(0x7f5a8c14d580 0x7f5a8c164bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.23:6789/0 says I am v1:10.20.193.23:43336/0 (socket says 10.20.193.23:43336) 2026-02-22T21:35:24.512 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a8affd640 1 -- 10.20.193.23:0/275867995 learned_addr learned my addr 10.20.193.23:0/275867995 (peer_addr_for_me v1:10.20.193.23:0/0) 2026-02-22T21:35:24.512 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 1 -- 10.20.193.23:0/275867995 <== mon.0 v1:10.20.193.23:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1770819535 0 0) 0x7f5a8c1656c0 con 0x7f5a8c14d580 2026-02-22T21:35:24.512 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 10 monclient(hunting): _negotiate 2026-02-22T21:35:24.512 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:35:24.512 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:35:24.512 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 10 cephx client: reset 2026-02-22T21:35:24.512 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 10 cephx: set_have_need_key no handler for service auth 2026-02-22T21:35:24.513 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 10 cephx: validate_tickets want 32 have 0 need 32 2026-02-22T21:35:24.513 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 10 cephx client: reset 2026-02-22T21:35:24.513 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 10 monclient(hunting): my global_id is 4250 2026-02-22T21:35:24.513 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 10 cephx client: 0x7f5a78003550 handle_response ret = 0 2026-02-22T21:35:24.513 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 10 cephx client: got initial server challenge 2ccbc8773a7d88a5 2026-02-22T21:35:24.513 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 10 cephx client: validate_tickets: want=32 need=32 have=0 2026-02-22T21:35:24.513 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 10 cephx: set_have_need_key no handler for service auth 2026-02-22T21:35:24.513 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 10 cephx: validate_tickets want 32 have 0 need 32 2026-02-22T21:35:24.513 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 10 cephx client: want=32 need=32 have=0 2026-02-22T21:35:24.513 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 10 cephx client: build_request 2026-02-22T21:35:24.513 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 10 cephx client: get auth session key: client_challenge b50fa240d68ef0b3 2026-02-22T21:35:24.513 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 1 -- 10.20.193.23:0/275867995 --> v1:10.20.193.23:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a78003630 con 0x7f5a8c14d580 2026-02-22T21:35:24.513 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 1 -- 10.20.193.23:0/275867995 <== mon.0 v1:10.20.193.23:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2261196358 0 0) 0x7f5a78003630 con 0x7f5a8c14d580 2026-02-22T21:35:24.513 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 10 cephx client: 0x7f5a78003550 handle_response ret = 0 2026-02-22T21:35:24.513 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 10 cephx client: get_auth_session_key 2026-02-22T21:35:24.513 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 10 cephx: verify_service_ticket_reply got 1 keys 2026-02-22T21:35:24.514 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 10 cephx: got key for service_id auth 2026-02-22T21:35:24.514 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 10 cephx: verify_service_ticket_reply ticket.secret_id=2 2026-02-22T21:35:24.514 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 10 cephx: verify_service_ticket_reply service auth secret_id 2 session_key AQCcdptpwb1BHRAAmXzqNCSRFk/3Rvi9RQkYUw== validity=660.000000 2026-02-22T21:35:24.514 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 10 cephx: verify_service_ticket_reply ticket expires=2026-02-22T21:46:24.490921+0000 renew_after=2026-02-22T21:43:39.490921+0000 2026-02-22T21:35:24.514 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 10 cephx client: want=32 need=32 have=0 2026-02-22T21:35:24.514 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 10 cephx client: got connection bl 0 and extra tickets 0 2026-02-22T21:35:24.514 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 10 cephx: validate_tickets want 32 have 32 need 0 2026-02-22T21:35:24.514 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 10 monclient: _finish_hunting 0 2026-02-22T21:35:24.514 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 1 monclient: found mon.noname-a 2026-02-22T21:35:24.514 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.23:6789/0 2026-02-22T21:35:24.514 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 1 -- 10.20.193.23:0/275867995 --> v1:10.20.193.23:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a8c1652d0 con 0x7f5a8c14d580 2026-02-22T21:35:24.514 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 10 monclient: _finish_auth 0 2026-02-22T21:35:24.514 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 10 monclient: _check_auth_tickets 2026-02-22T21:35:24.514 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 10 cephx: validate_tickets want 32 have 32 need 0 2026-02-22T21:35:24.514 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 20 cephx client: need_tickets: want=32 have=32 need=0 2026-02-22T21:35:24.515 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 10 monclient: _check_auth_rotating renewing rotating keys (they expired before 2026-02-22T21:34:54.490933+0000) 2026-02-22T21:35:24.515 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 10 cephx client: build_rotating_request 2026-02-22T21:35:24.515 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.23:6789/0 2026-02-22T21:35:24.515 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 1 -- 10.20.193.23:0/275867995 --> v1:10.20.193.23:6789/0 -- auth(proto 2 2 bytes epoch 0) -- 0x7f5a8c1656c0 con 0x7f5a8c14d580 2026-02-22T21:35:24.515 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 1 -- 10.20.193.23:0/275867995 <== mon.0 v1:10.20.193.23:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7f5a80002e20 con 0x7f5a8c14d580 2026-02-22T21:35:24.515 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:35:24.515 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T21:35:24.515 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 10 monclient: dump: 2026-02-22T21:35:24.515 INFO:tasks.workunit.client.0.trial023.stderr:epoch 1 2026-02-22T21:35:24.515 INFO:tasks.workunit.client.0.trial023.stderr:fsid e2dd7ed3-13e8-4519-aab8-5d5a54f80255 2026-02-22T21:35:24.515 INFO:tasks.workunit.client.0.trial023.stderr:last_changed 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:24.515 INFO:tasks.workunit.client.0.trial023.stderr:created 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:24.515 INFO:tasks.workunit.client.0.trial023.stderr:min_mon_release 19 (squid) 2026-02-22T21:35:24.515 INFO:tasks.workunit.client.0.trial023.stderr:election_strategy: 3 2026-02-22T21:35:24.515 INFO:tasks.workunit.client.0.trial023.stderr:0: v1:10.20.193.23:6789/0 mon.a 2026-02-22T21:35:24.515 INFO:tasks.workunit.client.0.trial023.stderr: 2026-02-22T21:35:24.516 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 monclient: authenticate success, global_id 4250 2026-02-22T21:35:24.516 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 1 -- 10.20.193.23:0/275867995 <== mon.0 v1:10.20.193.23:6789/0 4 ==== config(1 keys) ==== 25+0+0 (unknown 1514702568 0 0) 0x7f5a80003080 con 0x7f5a8c14d580 2026-02-22T21:35:24.516 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 10 monclient: handle_config config(1 keys) 2026-02-22T21:35:24.516 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 1 -- 10.20.193.23:0/275867995 <== mon.0 v1:10.20.193.23:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7f5a800034f0 con 0x7f5a8c14d580 2026-02-22T21:35:24.516 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:35:24.516 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T21:35:24.516 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 10 monclient: dump: 2026-02-22T21:35:24.516 INFO:tasks.workunit.client.0.trial023.stderr:epoch 1 2026-02-22T21:35:24.516 INFO:tasks.workunit.client.0.trial023.stderr:fsid e2dd7ed3-13e8-4519-aab8-5d5a54f80255 2026-02-22T21:35:24.516 INFO:tasks.workunit.client.0.trial023.stderr:last_changed 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:24.516 INFO:tasks.workunit.client.0.trial023.stderr:created 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:24.516 INFO:tasks.workunit.client.0.trial023.stderr:min_mon_release 19 (squid) 2026-02-22T21:35:24.516 INFO:tasks.workunit.client.0.trial023.stderr:election_strategy: 3 2026-02-22T21:35:24.516 INFO:tasks.workunit.client.0.trial023.stderr:0: v1:10.20.193.23:6789/0 mon.a 2026-02-22T21:35:24.516 INFO:tasks.workunit.client.0.trial023.stderr: 2026-02-22T21:35:24.517 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 10 monclient: get_monmap_and_config success 2026-02-22T21:35:24.517 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 1 -- 10.20.193.23:0/275867995 <== mon.0 v1:10.20.193.23:6789/0 6 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (unknown 519245087 0 0) 0x7f5a8c1656c0 con 0x7f5a8c14d580 2026-02-22T21:35:24.517 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 10 cephx client: 0x7f5a78003550 handle_response ret = 0 2026-02-22T21:35:24.517 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 10 cephx client: get_rotating_key 2026-02-22T21:35:24.517 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 4 set_mon_vals no callback set 2026-02-22T21:35:24.517 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 10 auth: dump_rotating: 2026-02-22T21:35:24.517 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 10 auth: id 1 AQBddptpfYjTLhAAXh1N3uFywlax+2y6vwZmsw== expires 2026-02-22T21:38:21.785614+0000 2026-02-22T21:35:24.517 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 10 set_mon_vals mgr_pool = false 2026-02-22T21:35:24.517 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 10 auth: id 2 AQBddptpiI/TLhAAdz7mEzTpWi2a8fttyDShuw== expires 2026-02-22T21:42:21.785614+0000 2026-02-22T21:35:24.517 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 10 auth: id 3 AQBddptpNJfTLhAA8yUoZRot9tLYY9D+lZZAdA== expires 2026-02-22T21:46:21.785614+0000 2026-02-22T21:35:24.517 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 10 monclient: _finish_auth 0 2026-02-22T21:35:24.517 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 10 monclient: _check_auth_tickets 2026-02-22T21:35:24.517 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 10 cephx: validate_tickets want 32 have 32 need 0 2026-02-22T21:35:24.517 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 20 cephx client: need_tickets: want=32 have=32 need=0 2026-02-22T21:35:24.517 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2026-02-22T21:34:54.491037+0000) 2026-02-22T21:35:24.518 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 10 auth: dump_rotating: 2026-02-22T21:35:24.518 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 10 auth: id 1 AQBddptpfYjTLhAAXh1N3uFywlax+2y6vwZmsw== expires 2026-02-22T21:38:21.785614+0000 2026-02-22T21:35:24.518 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 10 auth: id 2 AQBddptpiI/TLhAAdz7mEzTpWi2a8fttyDShuw== expires 2026-02-22T21:42:21.785614+0000 2026-02-22T21:35:24.518 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a89ffb640 10 auth: id 3 AQBddptpNJfTLhAA8yUoZRot9tLYY9D+lZZAdA== expires 2026-02-22T21:46:21.785614+0000 2026-02-22T21:35:24.518 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 10 monclient: shutdown 2026-02-22T21:35:24.518 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 1 -- 10.20.193.23:0/275867995 >> v1:10.20.193.23:6789/0 conn(0x7f5a8c14d580 legacy=0x7f5a8c164bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:35:24.518 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 1 -- 10.20.193.23:0/275867995 shutdown_connections 2026-02-22T21:35:24.518 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 1 -- 10.20.193.23:0/275867995 >> 10.20.193.23:0/275867995 conn(0x7f5a8c06c860 msgr2=0x7f5a8c0bf590 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:35:24.518 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 1 -- 10.20.193.23:0/275867995 shutdown_connections 2026-02-22T21:35:24.518 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 1 -- 10.20.193.23:0/275867995 wait complete. 2026-02-22T21:35:24.518 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding auth protocol: cephx 2026-02-22T21:35:24.518 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 20 AuthRegistry(0x7f5a8c067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.518 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding auth protocol: cephx 2026-02-22T21:35:24.518 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 20 AuthRegistry(0x7f5a8c067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.518 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding auth protocol: cephx 2026-02-22T21:35:24.518 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 20 AuthRegistry(0x7f5a8c067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.519 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding con mode: secure 2026-02-22T21:35:24.519 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding con mode: crc 2026-02-22T21:35:24.519 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 20 AuthRegistry(0x7f5a8c067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.519 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding con mode: secure 2026-02-22T21:35:24.519 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding con mode: crc 2026-02-22T21:35:24.519 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 20 AuthRegistry(0x7f5a8c067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.519 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding con mode: secure 2026-02-22T21:35:24.519 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding con mode: crc 2026-02-22T21:35:24.519 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 20 AuthRegistry(0x7f5a8c067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.519 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding con mode: crc 2026-02-22T21:35:24.519 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding con mode: secure 2026-02-22T21:35:24.519 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 20 AuthRegistry(0x7f5a8c067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.519 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding con mode: crc 2026-02-22T21:35:24.519 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding con mode: secure 2026-02-22T21:35:24.519 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 20 AuthRegistry(0x7f5a8c067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.519 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding con mode: crc 2026-02-22T21:35:24.520 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding con mode: secure 2026-02-22T21:35:24.520 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 20 AuthRegistry(0x7f5a8c067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.520 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 10 AuthRegistry(0x7f5a8c067010) _refresh_config cluster_methods [2] service_methods [2] client_methods [2] 2026-02-22T21:35:24.520 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 10 AuthRegistry(0x7f5a8c067010) _refresh_config mon_cluster_modes [2,1] mon_service_modes [2,1] mon_client_modes [2,1]; cluster_modes [1,2] service_modes [1,2] client_modes [1,2] 2026-02-22T21:35:24.520 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.484+0000 7f5a912d5640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:24.520 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 10 monclient: build_initial_monmap 2026-02-22T21:35:24.520 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 10 monclient: monmap: 2026-02-22T21:35:24.520 INFO:tasks.workunit.client.0.trial023.stderr:epoch 0 2026-02-22T21:35:24.520 INFO:tasks.workunit.client.0.trial023.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T21:35:24.520 INFO:tasks.workunit.client.0.trial023.stderr:last_changed 0.000000 2026-02-22T21:35:24.520 INFO:tasks.workunit.client.0.trial023.stderr:created 0.000000 2026-02-22T21:35:24.520 INFO:tasks.workunit.client.0.trial023.stderr:min_mon_release 0 (unknown) 2026-02-22T21:35:24.520 INFO:tasks.workunit.client.0.trial023.stderr:election_strategy: 1 2026-02-22T21:35:24.520 INFO:tasks.workunit.client.0.trial023.stderr:0: v1:10.20.193.23:6789/0 mon.noname-a 2026-02-22T21:35:24.520 INFO:tasks.workunit.client.0.trial023.stderr: 2026-02-22T21:35:24.521 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c06e100) adding auth protocol: cephx 2026-02-22T21:35:24.521 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 20 AuthRegistry(0x7f5a8c06e100) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.521 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c06e100) adding auth protocol: cephx 2026-02-22T21:35:24.521 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 20 AuthRegistry(0x7f5a8c06e100) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.521 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c06e100) adding auth protocol: cephx 2026-02-22T21:35:24.521 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 20 AuthRegistry(0x7f5a8c06e100) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.521 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c06e100) adding con mode: secure 2026-02-22T21:35:24.521 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c06e100) adding con mode: crc 2026-02-22T21:35:24.521 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 20 AuthRegistry(0x7f5a8c06e100) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.521 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c06e100) adding con mode: secure 2026-02-22T21:35:24.521 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c06e100) adding con mode: crc 2026-02-22T21:35:24.521 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 20 AuthRegistry(0x7f5a8c06e100) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.521 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c06e100) adding con mode: secure 2026-02-22T21:35:24.521 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c06e100) adding con mode: crc 2026-02-22T21:35:24.521 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 20 AuthRegistry(0x7f5a8c06e100) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.521 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c06e100) adding con mode: crc 2026-02-22T21:35:24.522 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c06e100) adding con mode: secure 2026-02-22T21:35:24.522 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 20 AuthRegistry(0x7f5a8c06e100) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.522 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c06e100) adding con mode: crc 2026-02-22T21:35:24.522 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c06e100) adding con mode: secure 2026-02-22T21:35:24.522 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 20 AuthRegistry(0x7f5a8c06e100) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.522 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c06e100) adding con mode: crc 2026-02-22T21:35:24.522 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c06e100) adding con mode: secure 2026-02-22T21:35:24.522 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 20 AuthRegistry(0x7f5a8c06e100) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.522 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 10 AuthRegistry(0x7f5a8c06e100) _refresh_config cluster_methods [2] service_methods [2] client_methods [2] 2026-02-22T21:35:24.522 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 10 AuthRegistry(0x7f5a8c06e100) _refresh_config mon_cluster_modes [2,1] mon_service_modes [2,1] mon_client_modes [2,1]; cluster_modes [1,2] service_modes [1,2] client_modes [1,2] 2026-02-22T21:35:24.522 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:24.522 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 1 Processor -- start 2026-02-22T21:35:24.522 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 1 -- start start 2026-02-22T21:35:24.522 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 10 monclient: init 2026-02-22T21:35:24.522 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding auth protocol: cephx 2026-02-22T21:35:24.522 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 20 AuthRegistry(0x7f5a8c067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.523 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding auth protocol: cephx 2026-02-22T21:35:24.523 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 20 AuthRegistry(0x7f5a8c067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.523 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding auth protocol: cephx 2026-02-22T21:35:24.523 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 20 AuthRegistry(0x7f5a8c067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.523 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding con mode: secure 2026-02-22T21:35:24.523 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding con mode: crc 2026-02-22T21:35:24.523 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 20 AuthRegistry(0x7f5a8c067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.523 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding con mode: secure 2026-02-22T21:35:24.523 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding con mode: crc 2026-02-22T21:35:24.523 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 20 AuthRegistry(0x7f5a8c067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.523 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding con mode: secure 2026-02-22T21:35:24.523 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding con mode: crc 2026-02-22T21:35:24.523 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 20 AuthRegistry(0x7f5a8c067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.523 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding con mode: crc 2026-02-22T21:35:24.523 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding con mode: secure 2026-02-22T21:35:24.523 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 20 AuthRegistry(0x7f5a8c067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.523 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding con mode: crc 2026-02-22T21:35:24.524 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding con mode: secure 2026-02-22T21:35:24.524 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 20 AuthRegistry(0x7f5a8c067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.524 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding con mode: crc 2026-02-22T21:35:24.524 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 5 AuthRegistry(0x7f5a8c067010) adding con mode: secure 2026-02-22T21:35:24.524 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 20 AuthRegistry(0x7f5a8c067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.524 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 10 AuthRegistry(0x7f5a8c067010) _refresh_config cluster_methods [2] service_methods [2] client_methods [2] 2026-02-22T21:35:24.524 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 10 AuthRegistry(0x7f5a8c067010) _refresh_config mon_cluster_modes [2,1] mon_service_modes [2,1] mon_client_modes [2,1]; cluster_modes [1,2] service_modes [1,2] client_modes [1,2] 2026-02-22T21:35:24.524 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:24.524 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:24.524 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 10 monclient: _reopen_session rank -1 2026-02-22T21:35:24.524 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 10 monclient: _add_conns ranks=[0] 2026-02-22T21:35:24.524 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 10 monclient(hunting): picked mon.noname-a con 0x7f5a8c14d580 addr v1:10.20.193.23:6789/0 2026-02-22T21:35:24.524 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 1 -- --> v1:10.20.193.23:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x7f5a8c15c120 con 0x7f5a8c14d580 2026-02-22T21:35:24.524 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 10 monclient(hunting): _renew_subs 2026-02-22T21:35:24.524 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 10 monclient(hunting): authenticate will time out at 596.709195s 2026-02-22T21:35:24.525 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a8affd640 1 --1- >> v1:10.20.193.23:6789/0 conn(0x7f5a8c14d580 0x7f5a8c15b8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.23:6789/0 says I am v1:10.20.193.23:43348/0 (socket says 10.20.193.23:43348) 2026-02-22T21:35:24.525 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a8affd640 1 -- 10.20.193.23:0/3199036593 learned_addr learned my addr 10.20.193.23:0/3199036593 (peer_addr_for_me v1:10.20.193.23:0/0) 2026-02-22T21:35:24.525 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 1 -- 10.20.193.23:0/3199036593 <== mon.0 v1:10.20.193.23:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 148375634 0 0) 0x7f5a8c15c120 con 0x7f5a8c14d580 2026-02-22T21:35:24.525 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 monclient(hunting): _negotiate 2026-02-22T21:35:24.525 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:35:24.525 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:35:24.525 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx client: reset 2026-02-22T21:35:24.525 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx: set_have_need_key no handler for service mon 2026-02-22T21:35:24.525 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx: set_have_need_key no handler for service osd 2026-02-22T21:35:24.525 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx: set_have_need_key no handler for service mgr 2026-02-22T21:35:24.525 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx: set_have_need_key no handler for service auth 2026-02-22T21:35:24.525 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx: validate_tickets want 53 have 0 need 53 2026-02-22T21:35:24.525 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx client: reset 2026-02-22T21:35:24.525 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 monclient(hunting): my global_id is 4251 2026-02-22T21:35:24.525 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx client: 0x7f5a60003550 handle_response ret = 0 2026-02-22T21:35:24.525 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx client: got initial server challenge d30eabe20435be4f 2026-02-22T21:35:24.526 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx client: validate_tickets: want=53 need=53 have=0 2026-02-22T21:35:24.526 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx: set_have_need_key no handler for service mon 2026-02-22T21:35:24.526 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx: set_have_need_key no handler for service osd 2026-02-22T21:35:24.526 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx: set_have_need_key no handler for service mgr 2026-02-22T21:35:24.526 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx: set_have_need_key no handler for service auth 2026-02-22T21:35:24.526 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx: validate_tickets want 53 have 0 need 53 2026-02-22T21:35:24.526 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx client: want=53 need=53 have=0 2026-02-22T21:35:24.526 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx client: build_request 2026-02-22T21:35:24.526 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx client: get auth session key: client_challenge 98058142c2bf0dd8 2026-02-22T21:35:24.526 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 1 -- 10.20.193.23:0/3199036593 --> v1:10.20.193.23:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a60003630 con 0x7f5a8c14d580 2026-02-22T21:35:24.526 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 1 -- 10.20.193.23:0/3199036593 <== mon.0 v1:10.20.193.23:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 732+0+0 (unknown 336381140 0 0) 0x7f5a60003630 con 0x7f5a8c14d580 2026-02-22T21:35:24.526 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx client: 0x7f5a60003550 handle_response ret = 0 2026-02-22T21:35:24.526 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx client: get_auth_session_key 2026-02-22T21:35:24.526 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx: verify_service_ticket_reply got 1 keys 2026-02-22T21:35:24.526 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx: got key for service_id auth 2026-02-22T21:35:24.526 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx: verify_service_ticket_reply ticket.secret_id=2 2026-02-22T21:35:24.527 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx: verify_service_ticket_reply service auth secret_id 2 session_key AQCcdptp5vZqHRAAzT6I97a5a9igv0nBEqlaTA== validity=660.000000 2026-02-22T21:35:24.527 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx: verify_service_ticket_reply ticket expires=2026-02-22T21:46:24.493639+0000 renew_after=2026-02-22T21:43:39.493639+0000 2026-02-22T21:35:24.527 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx client: want=53 need=53 have=0 2026-02-22T21:35:24.527 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx client: got connection bl 0 and extra tickets 518 2026-02-22T21:35:24.527 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx: set_have_need_key no handler for service mon 2026-02-22T21:35:24.527 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx: set_have_need_key no handler for service osd 2026-02-22T21:35:24.527 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx: set_have_need_key no handler for service mgr 2026-02-22T21:35:24.527 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx: validate_tickets want 53 have 32 need 21 2026-02-22T21:35:24.527 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx client: validate_tickets: want=53 need=21 have=32 2026-02-22T21:35:24.527 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx: set_have_need_key no handler for service mon 2026-02-22T21:35:24.527 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx: set_have_need_key no handler for service osd 2026-02-22T21:35:24.527 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx: set_have_need_key no handler for service mgr 2026-02-22T21:35:24.527 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx: validate_tickets want 53 have 32 need 21 2026-02-22T21:35:24.527 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx client: want=53 need=21 have=32 2026-02-22T21:35:24.527 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx client: build_request 2026-02-22T21:35:24.527 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx client: get service keys: want=53 need=21 have=32 2026-02-22T21:35:24.527 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 1 -- 10.20.193.23:0/3199036593 --> v1:10.20.193.23:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5a8c15c120 con 0x7f5a8c14d580 2026-02-22T21:35:24.527 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 1 -- 10.20.193.23:0/3199036593 <== mon.0 v1:10.20.193.23:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7f5a80002bd0 con 0x7f5a8c14d580 2026-02-22T21:35:24.528 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T21:35:24.528 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T21:35:24.528 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 monclient(hunting): dump: 2026-02-22T21:35:24.528 INFO:tasks.workunit.client.0.trial023.stderr:epoch 1 2026-02-22T21:35:24.528 INFO:tasks.workunit.client.0.trial023.stderr:fsid e2dd7ed3-13e8-4519-aab8-5d5a54f80255 2026-02-22T21:35:24.528 INFO:tasks.workunit.client.0.trial023.stderr:last_changed 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:24.528 INFO:tasks.workunit.client.0.trial023.stderr:created 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:24.528 INFO:tasks.workunit.client.0.trial023.stderr:min_mon_release 19 (squid) 2026-02-22T21:35:24.528 INFO:tasks.workunit.client.0.trial023.stderr:election_strategy: 3 2026-02-22T21:35:24.528 INFO:tasks.workunit.client.0.trial023.stderr:0: v1:10.20.193.23:6789/0 mon.a 2026-02-22T21:35:24.528 INFO:tasks.workunit.client.0.trial023.stderr: 2026-02-22T21:35:24.528 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 monclient(hunting): _finish_auth 0 2026-02-22T21:35:24.528 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 1 -- 10.20.193.23:0/3199036593 <== mon.0 v1:10.20.193.23:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 548+0+0 (unknown 418044763 0 0) 0x7f5a8c15c120 con 0x7f5a8c14d580 2026-02-22T21:35:24.528 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx client: 0x7f5a60003550 handle_response ret = 0 2026-02-22T21:35:24.528 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx client: get_principal_session_key session_key AQCcdptp5vZqHRAAzT6I97a5a9igv0nBEqlaTA== 2026-02-22T21:35:24.528 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx: verify_service_ticket_reply got 3 keys 2026-02-22T21:35:24.528 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx: got key for service_id mon 2026-02-22T21:35:24.529 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx: verify_service_ticket_reply ticket.secret_id=2 2026-02-22T21:35:24.529 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx: verify_service_ticket_reply service mon secret_id 2 session_key AQCcdptpUz5tHRAAhyV/gj/3Gk08wjExB9WK6A== validity=240.000000 2026-02-22T21:35:24.529 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx: verify_service_ticket_reply ticket expires=2026-02-22T21:39:24.493753+0000 renew_after=2026-02-22T21:38:24.493753+0000 2026-02-22T21:35:24.529 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx: got key for service_id osd 2026-02-22T21:35:24.529 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx: verify_service_ticket_reply ticket.secret_id=2 2026-02-22T21:35:24.529 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx: verify_service_ticket_reply service osd secret_id 2 session_key AQCcdptpoUJtHRAAG9ik6y3mIRffoQAyLjNPEw== validity=240.000000 2026-02-22T21:35:24.529 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx: verify_service_ticket_reply ticket expires=2026-02-22T21:39:24.493757+0000 renew_after=2026-02-22T21:38:24.493757+0000 2026-02-22T21:35:24.529 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx: got key for service_id mgr 2026-02-22T21:35:24.529 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx: verify_service_ticket_reply ticket.secret_id=2 2026-02-22T21:35:24.529 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx: verify_service_ticket_reply service mgr secret_id 2 session_key AQCcdptpHEhtHRAAxAyU4lhYag8IGKDcP4Snjw== validity=240.000000 2026-02-22T21:35:24.529 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx: verify_service_ticket_reply ticket expires=2026-02-22T21:39:24.493760+0000 renew_after=2026-02-22T21:38:24.493760+0000 2026-02-22T21:35:24.529 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx: validate_tickets want 53 have 53 need 0 2026-02-22T21:35:24.529 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 monclient: _finish_hunting 0 2026-02-22T21:35:24.529 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 1 monclient: found mon.a 2026-02-22T21:35:24.529 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.23:6789/0 2026-02-22T21:35:24.529 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 1 -- 10.20.193.23:0/3199036593 --> v1:10.20.193.23:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a8c1494b0 con 0x7f5a8c14d580 2026-02-22T21:35:24.529 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 monclient: _finish_auth 0 2026-02-22T21:35:24.530 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 monclient: _check_auth_tickets 2026-02-22T21:35:24.530 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx: validate_tickets want 53 have 53 need 0 2026-02-22T21:35:24.530 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 20 cephx client: need_tickets: want=53 have=53 need=0 2026-02-22T21:35:24.530 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 monclient: _check_auth_rotating renewing rotating keys (they expired before 2026-02-22T21:34:54.493771+0000) 2026-02-22T21:35:24.530 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx client: build_rotating_request 2026-02-22T21:35:24.530 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.23:6789/0 2026-02-22T21:35:24.530 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 1 -- 10.20.193.23:0/3199036593 --> v1:10.20.193.23:6789/0 -- auth(proto 2 2 bytes epoch 0) -- 0x7f5a60003630 con 0x7f5a8c14d580 2026-02-22T21:35:24.530 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 5 monclient: authenticate success, global_id 4251 2026-02-22T21:35:24.530 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 10 monclient: _renew_subs 2026-02-22T21:35:24.530 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.23:6789/0 2026-02-22T21:35:24.530 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 1 -- 10.20.193.23:0/3199036593 --> v1:10.20.193.23:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5a8c093bb0 con 0x7f5a8c14d580 2026-02-22T21:35:24.530 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 10 monclient: _renew_subs 2026-02-22T21:35:24.530 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.23:6789/0 2026-02-22T21:35:24.530 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 1 -- 10.20.193.23:0/3199036593 --> v1:10.20.193.23:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f5a8c147ed0 con 0x7f5a8c14d580 2026-02-22T21:35:24.530 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 1 -- 10.20.193.23:0/3199036593 <== mon.0 v1:10.20.193.23:6789/0 5 ==== config(1 keys) ==== 25+0+0 (unknown 1514702568 0 0) 0x7f5a80004cc0 con 0x7f5a8c14d580 2026-02-22T21:35:24.530 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 monclient: handle_config config(1 keys) 2026-02-22T21:35:24.530 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 1 -- 10.20.193.23:0/3199036593 <== mon.0 v1:10.20.193.23:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7f5a80004fc0 con 0x7f5a8c14d580 2026-02-22T21:35:24.530 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:35:24.530 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T21:35:24.531 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 monclient: dump: 2026-02-22T21:35:24.531 INFO:tasks.workunit.client.0.trial023.stderr:epoch 1 2026-02-22T21:35:24.531 INFO:tasks.workunit.client.0.trial023.stderr:fsid e2dd7ed3-13e8-4519-aab8-5d5a54f80255 2026-02-22T21:35:24.531 INFO:tasks.workunit.client.0.trial023.stderr:last_changed 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:24.531 INFO:tasks.workunit.client.0.trial023.stderr:created 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:24.531 INFO:tasks.workunit.client.0.trial023.stderr:min_mon_release 19 (squid) 2026-02-22T21:35:24.531 INFO:tasks.workunit.client.0.trial023.stderr:election_strategy: 3 2026-02-22T21:35:24.531 INFO:tasks.workunit.client.0.trial023.stderr:0: v1:10.20.193.23:6789/0 mon.a 2026-02-22T21:35:24.531 INFO:tasks.workunit.client.0.trial023.stderr: 2026-02-22T21:35:24.531 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 1 -- 10.20.193.23:0/3199036593 <== mon.0 v1:10.20.193.23:6789/0 7 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (unknown 1985275232 0 0) 0x7f5a8c093bb0 con 0x7f5a8c14d580 2026-02-22T21:35:24.531 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx client: 0x7f5a60003550 handle_response ret = 0 2026-02-22T21:35:24.531 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx client: get_rotating_key 2026-02-22T21:35:24.531 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a897fa640 4 set_mon_vals no callback set 2026-02-22T21:35:24.531 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 auth: dump_rotating: 2026-02-22T21:35:24.531 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 auth: id 1 AQBddptpfYjTLhAAXh1N3uFywlax+2y6vwZmsw== expires 2026-02-22T21:38:21.785614+0000 2026-02-22T21:35:24.531 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 auth: id 2 AQBddptpiI/TLhAAdz7mEzTpWi2a8fttyDShuw== expires 2026-02-22T21:42:21.785614+0000 2026-02-22T21:35:24.531 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 auth: id 3 AQBddptpNJfTLhAA8yUoZRot9tLYY9D+lZZAdA== expires 2026-02-22T21:46:21.785614+0000 2026-02-22T21:35:24.531 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 monclient: _finish_auth 0 2026-02-22T21:35:24.531 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 monclient: _check_auth_tickets 2026-02-22T21:35:24.532 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 cephx: validate_tickets want 53 have 53 need 0 2026-02-22T21:35:24.532 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 20 cephx client: need_tickets: want=53 have=53 need=0 2026-02-22T21:35:24.532 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2026-02-22T21:34:54.493877+0000) 2026-02-22T21:35:24.532 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 auth: dump_rotating: 2026-02-22T21:35:24.532 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 auth: id 1 AQBddptpfYjTLhAAXh1N3uFywlax+2y6vwZmsw== expires 2026-02-22T21:38:21.785614+0000 2026-02-22T21:35:24.532 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 auth: id 2 AQBddptpiI/TLhAAdz7mEzTpWi2a8fttyDShuw== expires 2026-02-22T21:42:21.785614+0000 2026-02-22T21:35:24.532 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 10 auth: id 3 AQBddptpNJfTLhAA8yUoZRot9tLYY9D+lZZAdA== expires 2026-02-22T21:46:21.785614+0000 2026-02-22T21:35:24.532 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T21:35:24.532 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:35:24.532 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.23:6789/0 2026-02-22T21:35:24.532 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a912d5640 1 -- 10.20.193.23:0/3199036593 --> v1:10.20.193.23:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a8c162ea0 con 0x7f5a8c14d580 2026-02-22T21:35:24.532 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 1 -- 10.20.193.23:0/3199036593 <== mon.0 v1:10.20.193.23:6789/0 8 ==== mgrmap(e 4) ==== 47400+0+0 (unknown 1603120368 0 0) 0x7f5a80010c80 con 0x7f5a8c14d580 2026-02-22T21:35:24.532 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a6bfff640 1 -- 10.20.193.23:0/3199036593 <== mon.0 v1:10.20.193.23:6789/0 9 ==== osd_map(14..14 src has 1..14) ==== 2160+0+0 (unknown 946035718 0 0) 0x7f5a80048cc0 con 0x7f5a8c14d580 2026-02-22T21:35:24.532 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a8a7fc640 10 monclient: get_auth_request con 0x7f5a6003b9b0 auth_method 0 2026-02-22T21:35:24.532 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a8a7fc640 10 cephx client: build_authorizer for service mgr 2026-02-22T21:35:24.532 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.488+0000 7f5a8a7fc640 10 In get_auth_session_handler for protocol 2 2026-02-22T21:35:24.532 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.492+0000 7f5a6bfff640 1 -- 10.20.193.23:0/3199036593 <== mon.0 v1:10.20.193.23:6789/0 10 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (unknown 1092875540 0 3570997608) 0x7f5a80016950 con 0x7f5a8c14d580 2026-02-22T21:35:24.532 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.492+0000 7f5a6bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:35:24.532 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.492+0000 7f5a6bfff640 10 monclient: _finish_command 1 = system:0 2026-02-22T21:35:24.606 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.600+0000 7f5a912d5640 10 start_mon_command cmd=[{"prefix": "config-key get", "key": "test/foo"}] 2026-02-22T21:35:24.606 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.600+0000 7f5a912d5640 10 monclient: _send_command 2 [{"prefix": "config-key get", "key": "test/foo"}] 2026-02-22T21:35:24.606 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.600+0000 7f5a912d5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.23:6789/0 2026-02-22T21:35:24.606 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.600+0000 7f5a912d5640 1 -- 10.20.193.23:0/3199036593 --> v1:10.20.193.23:6789/0 -- mon_command({"prefix": "config-key get", "key": "test/foo"} v 0) -- 0x7f5a8c0c1dd0 con 0x7f5a8c14d580 2026-02-22T21:35:24.606 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.600+0000 7f5a6bfff640 1 -- 10.20.193.23:0/3199036593 <== mon.0 v1:10.20.193.23:6789/0 11 ==== mon_command_ack([{"prefix": "config-key get", "key": "test/foo"}]=0 v13) ==== 81+0+0 (unknown 1473705578 0 0) 0x7f5a80016250 con 0x7f5a8c14d580 2026-02-22T21:35:24.606 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.600+0000 7f5a6bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config-key get", "key": "test/foo"}] 2026-02-22T21:35:24.606 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.600+0000 7f5a6bfff640 10 monclient: _finish_command 2 = system:0 2026-02-22T21:35:24.683 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.676+0000 7f5a912d5640 10 start_mon_command cmd=[{"prefix": "config-key get", "key": "test/foo"}] 2026-02-22T21:35:24.683 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.676+0000 7f5a912d5640 10 monclient: _send_command 3 [{"prefix": "config-key get", "key": "test/foo"}] 2026-02-22T21:35:24.683 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.676+0000 7f5a912d5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.23:6789/0 2026-02-22T21:35:24.683 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.676+0000 7f5a912d5640 1 -- 10.20.193.23:0/3199036593 --> v1:10.20.193.23:6789/0 -- mon_command({"prefix": "config-key get", "key": "test/foo"} v 0) -- 0x7f5a8c15b6c0 con 0x7f5a8c14d580 2026-02-22T21:35:24.683 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.676+0000 7f5a6bfff640 1 -- 10.20.193.23:0/3199036593 <== mon.0 v1:10.20.193.23:6789/0 12 ==== mon_command_ack([{"prefix": "config-key get", "key": "test/foo"}]=0 v13) ==== 81+0+0 (unknown 1473705578 0 0) 0x7f5a80047120 con 0x7f5a8c14d580 2026-02-22T21:35:24.683 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.676+0000 7f5a6bfff640 10 monclient: handle_mon_command_ack 3 [{"prefix": "config-key get", "key": "test/foo"}] 2026-02-22T21:35:24.683 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.676+0000 7f5a6bfff640 10 monclient: _finish_command 3 = system:0 2026-02-22T21:35:24.683 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.676+0000 7f5a912d5640 1 -- 10.20.193.23:0/3199036593 >> v1:10.20.193.23:6800/2834055528 conn(0x7f5a6003b9b0 legacy=0x7f5a6003de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:35:24.683 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.676+0000 7f5a912d5640 10 monclient: shutdown 2026-02-22T21:35:24.683 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.676+0000 7f5a912d5640 1 -- 10.20.193.23:0/3199036593 >> v1:10.20.193.23:6789/0 conn(0x7f5a8c14d580 legacy=0x7f5a8c15b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:35:24.683 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.676+0000 7f5a912d5640 1 -- 10.20.193.23:0/3199036593 shutdown_connections 2026-02-22T21:35:24.683 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.676+0000 7f5a912d5640 1 -- 10.20.193.23:0/3199036593 >> 10.20.193.23:0/3199036593 conn(0x7f5a8c06c860 msgr2=0x7f5a8c0ccd20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:35:24.683 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.676+0000 7f5a912d5640 1 -- 10.20.193.23:0/3199036593 shutdown_connections 2026-02-22T21:35:24.683 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.676+0000 7f5a912d5640 1 -- 10.20.193.23:0/3199036593 wait complete. 2026-02-22T21:35:24.691 INFO:tasks.workunit.client.0.trial023.stderr:+ for c in $allow_aa $allow_bb $allow_cc $mgr_a $mgr_b 2026-02-22T21:35:24.691 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name mgr.b config-key get daemon-private/osd.123/test-foo 2026-02-22T21:35:24.769 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding auth protocol: cephx 2026-02-22T21:35:24.769 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce4067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.769 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding auth protocol: cephx 2026-02-22T21:35:24.769 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce4067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.769 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding auth protocol: cephx 2026-02-22T21:35:24.769 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce4067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.770 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding con mode: secure 2026-02-22T21:35:24.770 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding con mode: crc 2026-02-22T21:35:24.770 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce4067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.770 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding con mode: secure 2026-02-22T21:35:24.770 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding con mode: crc 2026-02-22T21:35:24.770 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce4067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.770 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding con mode: secure 2026-02-22T21:35:24.770 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding con mode: crc 2026-02-22T21:35:24.770 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce4067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.770 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding con mode: crc 2026-02-22T21:35:24.770 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding con mode: secure 2026-02-22T21:35:24.771 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce4067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.771 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding con mode: crc 2026-02-22T21:35:24.771 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding con mode: secure 2026-02-22T21:35:24.771 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce4067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.771 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding con mode: crc 2026-02-22T21:35:24.771 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding con mode: secure 2026-02-22T21:35:24.771 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce4067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.771 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 10 AuthRegistry(0x7f3ce4067010) _refresh_config cluster_methods [2] service_methods [2] client_methods [2] 2026-02-22T21:35:24.771 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 10 AuthRegistry(0x7f3ce4067010) _refresh_config mon_cluster_modes [2,1] mon_service_modes [2,1] mon_client_modes [2,1]; cluster_modes [1,2] service_modes [1,2] client_modes [1,2] 2026-02-22T21:35:24.771 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2026-02-22T21:35:24.771 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding auth protocol: cephx 2026-02-22T21:35:24.771 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce4067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.772 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding auth protocol: cephx 2026-02-22T21:35:24.772 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce4067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.772 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding auth protocol: cephx 2026-02-22T21:35:24.772 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce4067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.772 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding con mode: secure 2026-02-22T21:35:24.772 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding con mode: crc 2026-02-22T21:35:24.772 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce4067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.772 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding con mode: secure 2026-02-22T21:35:24.772 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding con mode: crc 2026-02-22T21:35:24.772 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce4067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.772 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding con mode: secure 2026-02-22T21:35:24.772 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding con mode: crc 2026-02-22T21:35:24.772 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce4067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.773 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding con mode: crc 2026-02-22T21:35:24.773 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding con mode: secure 2026-02-22T21:35:24.773 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce4067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.773 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding con mode: crc 2026-02-22T21:35:24.773 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding con mode: secure 2026-02-22T21:35:24.773 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce4067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.773 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding con mode: crc 2026-02-22T21:35:24.773 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding con mode: secure 2026-02-22T21:35:24.773 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce4067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.773 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 10 AuthRegistry(0x7f3ce4067010) _refresh_config cluster_methods [2] service_methods [2] client_methods [2] 2026-02-22T21:35:24.773 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 10 AuthRegistry(0x7f3ce4067010) _refresh_config mon_cluster_modes [2,1] mon_service_modes [2,1] mon_client_modes [2,1]; cluster_modes [1,2] service_modes [1,2] client_modes [1,2] 2026-02-22T21:35:24.773 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:24.773 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 10 monclient: get_monmap_and_config 2026-02-22T21:35:24.774 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 10 monclient: build_initial_monmap 2026-02-22T21:35:24.774 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 10 monclient: monmap: 2026-02-22T21:35:24.774 INFO:tasks.workunit.client.0.trial023.stderr:epoch 0 2026-02-22T21:35:24.774 INFO:tasks.workunit.client.0.trial023.stderr:fsid e2dd7ed3-13e8-4519-aab8-5d5a54f80255 2026-02-22T21:35:24.774 INFO:tasks.workunit.client.0.trial023.stderr:last_changed 2026-02-22T21:35:24.758029+0000 2026-02-22T21:35:24.774 INFO:tasks.workunit.client.0.trial023.stderr:created 2026-02-22T21:35:24.758029+0000 2026-02-22T21:35:24.774 INFO:tasks.workunit.client.0.trial023.stderr:min_mon_release 0 (unknown) 2026-02-22T21:35:24.774 INFO:tasks.workunit.client.0.trial023.stderr:election_strategy: 3 2026-02-22T21:35:24.774 INFO:tasks.workunit.client.0.trial023.stderr:0: v1:10.20.193.23:6789/0 mon.noname-a 2026-02-22T21:35:24.774 INFO:tasks.workunit.client.0.trial023.stderr: 2026-02-22T21:35:24.774 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4068a80) adding auth protocol: cephx 2026-02-22T21:35:24.775 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce4068a80) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.775 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4068a80) adding auth protocol: cephx 2026-02-22T21:35:24.775 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce4068a80) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.775 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4068a80) adding auth protocol: cephx 2026-02-22T21:35:24.775 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce4068a80) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.775 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4068a80) adding con mode: secure 2026-02-22T21:35:24.775 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4068a80) adding con mode: crc 2026-02-22T21:35:24.775 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce4068a80) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.775 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4068a80) adding con mode: secure 2026-02-22T21:35:24.775 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4068a80) adding con mode: crc 2026-02-22T21:35:24.775 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce4068a80) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.775 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4068a80) adding con mode: secure 2026-02-22T21:35:24.775 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4068a80) adding con mode: crc 2026-02-22T21:35:24.776 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce4068a80) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.776 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4068a80) adding con mode: crc 2026-02-22T21:35:24.776 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4068a80) adding con mode: secure 2026-02-22T21:35:24.776 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce4068a80) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.776 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4068a80) adding con mode: crc 2026-02-22T21:35:24.776 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4068a80) adding con mode: secure 2026-02-22T21:35:24.776 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce4068a80) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.776 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4068a80) adding con mode: crc 2026-02-22T21:35:24.776 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4068a80) adding con mode: secure 2026-02-22T21:35:24.776 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce4068a80) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.776 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 10 AuthRegistry(0x7f3ce4068a80) _refresh_config cluster_methods [2] service_methods [2] client_methods [2] 2026-02-22T21:35:24.776 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 10 AuthRegistry(0x7f3ce4068a80) _refresh_config mon_cluster_modes [2,1] mon_service_modes [2,1] mon_client_modes [2,1]; cluster_modes [1,2] service_modes [1,2] client_modes [1,2] 2026-02-22T21:35:24.777 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:24.777 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 1 Processor -- start 2026-02-22T21:35:24.777 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 1 -- start start 2026-02-22T21:35:24.777 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 10 monclient: init 2026-02-22T21:35:24.777 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce96edf50) adding auth protocol: cephx 2026-02-22T21:35:24.777 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce96edf50) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.777 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce96edf50) adding auth protocol: cephx 2026-02-22T21:35:24.777 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce96edf50) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.777 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce96edf50) adding auth protocol: cephx 2026-02-22T21:35:24.777 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce96edf50) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.777 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce96edf50) adding con mode: secure 2026-02-22T21:35:24.777 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce96edf50) adding con mode: crc 2026-02-22T21:35:24.778 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce96edf50) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.778 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce96edf50) adding con mode: secure 2026-02-22T21:35:24.778 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce96edf50) adding con mode: crc 2026-02-22T21:35:24.778 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce96edf50) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.778 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce96edf50) adding con mode: secure 2026-02-22T21:35:24.778 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce96edf50) adding con mode: crc 2026-02-22T21:35:24.778 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce96edf50) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.778 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce96edf50) adding con mode: crc 2026-02-22T21:35:24.778 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce96edf50) adding con mode: secure 2026-02-22T21:35:24.778 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce96edf50) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.778 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce96edf50) adding con mode: crc 2026-02-22T21:35:24.778 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce96edf50) adding con mode: secure 2026-02-22T21:35:24.778 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce96edf50) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.779 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce96edf50) adding con mode: crc 2026-02-22T21:35:24.779 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce96edf50) adding con mode: secure 2026-02-22T21:35:24.779 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce96edf50) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.779 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 10 AuthRegistry(0x7f3ce96edf50) _refresh_config cluster_methods [2] service_methods [2] client_methods [2] 2026-02-22T21:35:24.779 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 10 AuthRegistry(0x7f3ce96edf50) _refresh_config mon_cluster_modes [2,1] mon_service_modes [2,1] mon_client_modes [2,1]; cluster_modes [1,2] service_modes [1,2] client_modes [1,2] 2026-02-22T21:35:24.779 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:24.779 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:24.779 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 10 monclient: _reopen_session rank -1 2026-02-22T21:35:24.779 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 10 monclient: _add_conns ranks=[0] 2026-02-22T21:35:24.779 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 10 monclient(hunting): picked mon.noname-a con 0x7f3ce406e910 addr v1:10.20.193.23:6789/0 2026-02-22T21:35:24.779 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 1 -- --> v1:10.20.193.23:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x7f3ce40c2b60 con 0x7f3ce406e910 2026-02-22T21:35:24.779 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 10 monclient(hunting): _renew_subs 2026-02-22T21:35:24.779 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce96ef640 10 monclient(hunting): authenticate will time out at 596.975557s 2026-02-22T21:35:24.780 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce2ffd640 1 --1- >> v1:10.20.193.23:6789/0 conn(0x7f3ce406e910 0x7f3ce40c2260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.23:6789/0 says I am v1:10.20.193.23:43358/0 (socket says 10.20.193.23:43358) 2026-02-22T21:35:24.780 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce2ffd640 1 -- 10.20.193.23:0/3292536276 learned_addr learned my addr 10.20.193.23:0/3292536276 (peer_addr_for_me v1:10.20.193.23:0/0) 2026-02-22T21:35:24.780 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce1ffb640 1 -- 10.20.193.23:0/3292536276 <== mon.0 v1:10.20.193.23:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3643679056 0 0) 0x7f3ce40c2b60 con 0x7f3ce406e910 2026-02-22T21:35:24.780 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce1ffb640 10 monclient(hunting): _negotiate 2026-02-22T21:35:24.780 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:35:24.780 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:35:24.780 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce1ffb640 10 cephx client: reset 2026-02-22T21:35:24.780 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce1ffb640 10 cephx: set_have_need_key no handler for service auth 2026-02-22T21:35:24.780 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce1ffb640 10 cephx: validate_tickets want 32 have 0 need 32 2026-02-22T21:35:24.780 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce1ffb640 10 cephx client: reset 2026-02-22T21:35:24.780 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce1ffb640 10 monclient(hunting): my global_id is 4252 2026-02-22T21:35:24.780 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce1ffb640 10 cephx client: 0x7f3cd0003550 handle_response ret = 0 2026-02-22T21:35:24.781 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce1ffb640 10 cephx client: got initial server challenge 2489c7b791074a52 2026-02-22T21:35:24.781 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce1ffb640 10 cephx client: validate_tickets: want=32 need=32 have=0 2026-02-22T21:35:24.781 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce1ffb640 10 cephx: set_have_need_key no handler for service auth 2026-02-22T21:35:24.781 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce1ffb640 10 cephx: validate_tickets want 32 have 0 need 32 2026-02-22T21:35:24.781 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce1ffb640 10 cephx client: want=32 need=32 have=0 2026-02-22T21:35:24.781 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce1ffb640 10 cephx client: build_request 2026-02-22T21:35:24.781 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce1ffb640 10 cephx client: get auth session key: client_challenge cf99be07aeb22a19 2026-02-22T21:35:24.781 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.752+0000 7f3ce1ffb640 1 -- 10.20.193.23:0/3292536276 --> v1:10.20.193.23:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3cd0003630 con 0x7f3ce406e910 2026-02-22T21:35:24.781 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce1ffb640 1 -- 10.20.193.23:0/3292536276 <== mon.0 v1:10.20.193.23:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 600510886 0 0) 0x7f3cd0003630 con 0x7f3ce406e910 2026-02-22T21:35:24.781 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce1ffb640 10 cephx client: 0x7f3cd0003550 handle_response ret = 0 2026-02-22T21:35:24.781 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce1ffb640 10 cephx client: get_auth_session_key 2026-02-22T21:35:24.781 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce1ffb640 10 cephx: verify_service_ticket_reply got 1 keys 2026-02-22T21:35:24.781 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce1ffb640 10 cephx: got key for service_id auth 2026-02-22T21:35:24.782 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce1ffb640 10 cephx: verify_service_ticket_reply ticket.secret_id=2 2026-02-22T21:35:24.782 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce1ffb640 10 cephx: verify_service_ticket_reply service auth secret_id 2 session_key AQCcdptpkr9MLRAAk9PjGOZEkpqjO+53cRowKw== validity=660.000000 2026-02-22T21:35:24.782 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce1ffb640 10 cephx: verify_service_ticket_reply ticket expires=2026-02-22T21:46:24.760096+0000 renew_after=2026-02-22T21:43:39.760096+0000 2026-02-22T21:35:24.782 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce1ffb640 10 cephx client: want=32 need=32 have=0 2026-02-22T21:35:24.782 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce1ffb640 10 cephx client: got connection bl 0 and extra tickets 0 2026-02-22T21:35:24.782 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce1ffb640 10 cephx: validate_tickets want 32 have 32 need 0 2026-02-22T21:35:24.782 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce1ffb640 10 monclient: _finish_hunting 0 2026-02-22T21:35:24.782 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce1ffb640 1 monclient: found mon.noname-a 2026-02-22T21:35:24.782 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce1ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.23:6789/0 2026-02-22T21:35:24.782 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce1ffb640 1 -- 10.20.193.23:0/3292536276 --> v1:10.20.193.23:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ce40cdf20 con 0x7f3ce406e910 2026-02-22T21:35:24.782 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce1ffb640 10 monclient: _finish_auth 0 2026-02-22T21:35:24.782 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce1ffb640 10 monclient: _check_auth_tickets 2026-02-22T21:35:24.783 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce1ffb640 10 cephx: validate_tickets want 32 have 32 need 0 2026-02-22T21:35:24.783 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce1ffb640 20 cephx client: need_tickets: want=32 have=32 need=0 2026-02-22T21:35:24.783 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce1ffb640 10 monclient: _check_auth_rotating renewing rotating keys (they expired before 2026-02-22T21:34:54.760108+0000) 2026-02-22T21:35:24.783 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce1ffb640 10 cephx client: build_rotating_request 2026-02-22T21:35:24.783 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce1ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.23:6789/0 2026-02-22T21:35:24.783 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce1ffb640 1 -- 10.20.193.23:0/3292536276 --> v1:10.20.193.23:6789/0 -- auth(proto 2 2 bytes epoch 0) -- 0x7f3ce40c2b60 con 0x7f3ce406e910 2026-02-22T21:35:24.783 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce1ffb640 1 -- 10.20.193.23:0/3292536276 <== mon.0 v1:10.20.193.23:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7f3cd8002e20 con 0x7f3ce406e910 2026-02-22T21:35:24.783 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:35:24.783 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T21:35:24.783 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce1ffb640 10 monclient: dump: 2026-02-22T21:35:24.783 INFO:tasks.workunit.client.0.trial023.stderr:epoch 1 2026-02-22T21:35:24.783 INFO:tasks.workunit.client.0.trial023.stderr:fsid e2dd7ed3-13e8-4519-aab8-5d5a54f80255 2026-02-22T21:35:24.783 INFO:tasks.workunit.client.0.trial023.stderr:last_changed 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:24.784 INFO:tasks.workunit.client.0.trial023.stderr:created 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:24.784 INFO:tasks.workunit.client.0.trial023.stderr:min_mon_release 19 (squid) 2026-02-22T21:35:24.784 INFO:tasks.workunit.client.0.trial023.stderr:election_strategy: 3 2026-02-22T21:35:24.784 INFO:tasks.workunit.client.0.trial023.stderr:0: v1:10.20.193.23:6789/0 mon.a 2026-02-22T21:35:24.784 INFO:tasks.workunit.client.0.trial023.stderr: 2026-02-22T21:35:24.784 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 5 monclient: authenticate success, global_id 4252 2026-02-22T21:35:24.784 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce1ffb640 1 -- 10.20.193.23:0/3292536276 <== mon.0 v1:10.20.193.23:6789/0 4 ==== config(1 keys) ==== 25+0+0 (unknown 1514702568 0 0) 0x7f3cd8003140 con 0x7f3ce406e910 2026-02-22T21:35:24.784 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce1ffb640 10 monclient: handle_config config(1 keys) 2026-02-22T21:35:24.784 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce1ffb640 1 -- 10.20.193.23:0/3292536276 <== mon.0 v1:10.20.193.23:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7f3cd80049b0 con 0x7f3ce406e910 2026-02-22T21:35:24.784 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:35:24.784 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T21:35:24.784 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce1ffb640 10 monclient: dump: 2026-02-22T21:35:24.785 INFO:tasks.workunit.client.0.trial023.stderr:epoch 1 2026-02-22T21:35:24.785 INFO:tasks.workunit.client.0.trial023.stderr:fsid e2dd7ed3-13e8-4519-aab8-5d5a54f80255 2026-02-22T21:35:24.785 INFO:tasks.workunit.client.0.trial023.stderr:last_changed 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:24.785 INFO:tasks.workunit.client.0.trial023.stderr:created 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:24.785 INFO:tasks.workunit.client.0.trial023.stderr:min_mon_release 19 (squid) 2026-02-22T21:35:24.785 INFO:tasks.workunit.client.0.trial023.stderr:election_strategy: 3 2026-02-22T21:35:24.785 INFO:tasks.workunit.client.0.trial023.stderr:0: v1:10.20.193.23:6789/0 mon.a 2026-02-22T21:35:24.785 INFO:tasks.workunit.client.0.trial023.stderr: 2026-02-22T21:35:24.785 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 10 monclient: get_monmap_and_config success 2026-02-22T21:35:24.785 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 4 set_mon_vals no callback set 2026-02-22T21:35:24.785 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 10 set_mon_vals mgr_pool = false 2026-02-22T21:35:24.785 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce1ffb640 1 -- 10.20.193.23:0/3292536276 <== mon.0 v1:10.20.193.23:6789/0 6 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (unknown 2491866313 0 0) 0x7f3ce40c2b60 con 0x7f3ce406e910 2026-02-22T21:35:24.786 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce1ffb640 10 cephx client: 0x7f3cd0003550 handle_response ret = 0 2026-02-22T21:35:24.786 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce1ffb640 10 cephx client: get_rotating_key 2026-02-22T21:35:24.786 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce1ffb640 10 auth: dump_rotating: 2026-02-22T21:35:24.786 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce1ffb640 10 auth: id 1 AQBddptpfYjTLhAAXh1N3uFywlax+2y6vwZmsw== expires 2026-02-22T21:38:21.785614+0000 2026-02-22T21:35:24.786 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce1ffb640 10 auth: id 2 AQBddptpiI/TLhAAdz7mEzTpWi2a8fttyDShuw== expires 2026-02-22T21:42:21.785614+0000 2026-02-22T21:35:24.786 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce1ffb640 10 auth: id 3 AQBddptpNJfTLhAA8yUoZRot9tLYY9D+lZZAdA== expires 2026-02-22T21:46:21.785614+0000 2026-02-22T21:35:24.786 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce1ffb640 10 monclient: _finish_auth 0 2026-02-22T21:35:24.786 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce1ffb640 10 monclient: _check_auth_tickets 2026-02-22T21:35:24.786 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce1ffb640 10 cephx: validate_tickets want 32 have 32 need 0 2026-02-22T21:35:24.786 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce1ffb640 20 cephx client: need_tickets: want=32 have=32 need=0 2026-02-22T21:35:24.786 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce1ffb640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2026-02-22T21:34:54.760229+0000) 2026-02-22T21:35:24.786 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce1ffb640 10 auth: dump_rotating: 2026-02-22T21:35:24.786 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce1ffb640 10 auth: id 1 AQBddptpfYjTLhAAXh1N3uFywlax+2y6vwZmsw== expires 2026-02-22T21:38:21.785614+0000 2026-02-22T21:35:24.787 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce1ffb640 10 auth: id 2 AQBddptpiI/TLhAAdz7mEzTpWi2a8fttyDShuw== expires 2026-02-22T21:42:21.785614+0000 2026-02-22T21:35:24.787 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce1ffb640 10 auth: id 3 AQBddptpNJfTLhAA8yUoZRot9tLYY9D+lZZAdA== expires 2026-02-22T21:46:21.785614+0000 2026-02-22T21:35:24.787 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 10 monclient: shutdown 2026-02-22T21:35:24.787 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 1 -- 10.20.193.23:0/3292536276 >> v1:10.20.193.23:6789/0 conn(0x7f3ce406e910 legacy=0x7f3ce40c2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:35:24.787 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 1 -- 10.20.193.23:0/3292536276 shutdown_connections 2026-02-22T21:35:24.787 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 1 -- 10.20.193.23:0/3292536276 >> 10.20.193.23:0/3292536276 conn(0x7f3ce406e330 msgr2=0x7f3ce40bf590 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:35:24.787 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 1 -- 10.20.193.23:0/3292536276 shutdown_connections 2026-02-22T21:35:24.787 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 1 -- 10.20.193.23:0/3292536276 wait complete. 2026-02-22T21:35:24.787 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding auth protocol: cephx 2026-02-22T21:35:24.787 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce4067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.787 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding auth protocol: cephx 2026-02-22T21:35:24.787 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce4067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.788 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding auth protocol: cephx 2026-02-22T21:35:24.788 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce4067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.788 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding con mode: secure 2026-02-22T21:35:24.788 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding con mode: crc 2026-02-22T21:35:24.788 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce4067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.788 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding con mode: secure 2026-02-22T21:35:24.788 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding con mode: crc 2026-02-22T21:35:24.788 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce4067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.788 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding con mode: secure 2026-02-22T21:35:24.788 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding con mode: crc 2026-02-22T21:35:24.788 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce4067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.788 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding con mode: crc 2026-02-22T21:35:24.788 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding con mode: secure 2026-02-22T21:35:24.788 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce4067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.789 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding con mode: crc 2026-02-22T21:35:24.789 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding con mode: secure 2026-02-22T21:35:24.789 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce4067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.789 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding con mode: crc 2026-02-22T21:35:24.789 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding con mode: secure 2026-02-22T21:35:24.789 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce4067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.789 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 10 AuthRegistry(0x7f3ce4067010) _refresh_config cluster_methods [2] service_methods [2] client_methods [2] 2026-02-22T21:35:24.789 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 10 AuthRegistry(0x7f3ce4067010) _refresh_config mon_cluster_modes [2,1] mon_service_modes [2,1] mon_client_modes [2,1]; cluster_modes [1,2] service_modes [1,2] client_modes [1,2] 2026-02-22T21:35:24.789 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:24.789 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 10 monclient: build_initial_monmap 2026-02-22T21:35:24.789 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 10 monclient: monmap: 2026-02-22T21:35:24.790 INFO:tasks.workunit.client.0.trial023.stderr:epoch 0 2026-02-22T21:35:24.790 INFO:tasks.workunit.client.0.trial023.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T21:35:24.790 INFO:tasks.workunit.client.0.trial023.stderr:last_changed 0.000000 2026-02-22T21:35:24.790 INFO:tasks.workunit.client.0.trial023.stderr:created 0.000000 2026-02-22T21:35:24.790 INFO:tasks.workunit.client.0.trial023.stderr:min_mon_release 0 (unknown) 2026-02-22T21:35:24.790 INFO:tasks.workunit.client.0.trial023.stderr:election_strategy: 1 2026-02-22T21:35:24.790 INFO:tasks.workunit.client.0.trial023.stderr:0: v1:10.20.193.23:6789/0 mon.noname-a 2026-02-22T21:35:24.790 INFO:tasks.workunit.client.0.trial023.stderr: 2026-02-22T21:35:24.790 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce40c2c30) adding auth protocol: cephx 2026-02-22T21:35:24.790 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce40c2c30) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.790 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce40c2c30) adding auth protocol: cephx 2026-02-22T21:35:24.790 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce40c2c30) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.791 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce40c2c30) adding auth protocol: cephx 2026-02-22T21:35:24.791 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce40c2c30) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.791 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce40c2c30) adding con mode: secure 2026-02-22T21:35:24.791 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce40c2c30) adding con mode: crc 2026-02-22T21:35:24.791 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce40c2c30) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.791 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce40c2c30) adding con mode: secure 2026-02-22T21:35:24.791 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce40c2c30) adding con mode: crc 2026-02-22T21:35:24.791 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce40c2c30) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.791 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce40c2c30) adding con mode: secure 2026-02-22T21:35:24.791 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce40c2c30) adding con mode: crc 2026-02-22T21:35:24.791 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce40c2c30) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.791 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce40c2c30) adding con mode: crc 2026-02-22T21:35:24.791 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce40c2c30) adding con mode: secure 2026-02-22T21:35:24.791 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce40c2c30) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.792 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce40c2c30) adding con mode: crc 2026-02-22T21:35:24.792 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce40c2c30) adding con mode: secure 2026-02-22T21:35:24.792 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce40c2c30) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.792 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce40c2c30) adding con mode: crc 2026-02-22T21:35:24.792 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce40c2c30) adding con mode: secure 2026-02-22T21:35:24.792 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce40c2c30) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.792 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 10 AuthRegistry(0x7f3ce40c2c30) _refresh_config cluster_methods [2] service_methods [2] client_methods [2] 2026-02-22T21:35:24.792 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 10 AuthRegistry(0x7f3ce40c2c30) _refresh_config mon_cluster_modes [2,1] mon_service_modes [2,1] mon_client_modes [2,1]; cluster_modes [1,2] service_modes [1,2] client_modes [1,2] 2026-02-22T21:35:24.792 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:24.792 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 1 Processor -- start 2026-02-22T21:35:24.792 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 1 -- start start 2026-02-22T21:35:24.792 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 10 monclient: init 2026-02-22T21:35:24.792 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding auth protocol: cephx 2026-02-22T21:35:24.792 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce4067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.792 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding auth protocol: cephx 2026-02-22T21:35:24.793 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce4067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.793 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding auth protocol: cephx 2026-02-22T21:35:24.793 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce4067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:24.793 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding con mode: secure 2026-02-22T21:35:24.793 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding con mode: crc 2026-02-22T21:35:24.793 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce4067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.793 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding con mode: secure 2026-02-22T21:35:24.793 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding con mode: crc 2026-02-22T21:35:24.793 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce4067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.793 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding con mode: secure 2026-02-22T21:35:24.793 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding con mode: crc 2026-02-22T21:35:24.793 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce4067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:24.793 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding con mode: crc 2026-02-22T21:35:24.793 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding con mode: secure 2026-02-22T21:35:24.794 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce4067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.794 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding con mode: crc 2026-02-22T21:35:24.794 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding con mode: secure 2026-02-22T21:35:24.794 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce4067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.794 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding con mode: crc 2026-02-22T21:35:24.794 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 5 AuthRegistry(0x7f3ce4067010) adding con mode: secure 2026-02-22T21:35:24.794 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 20 AuthRegistry(0x7f3ce4067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:24.794 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 10 AuthRegistry(0x7f3ce4067010) _refresh_config cluster_methods [2] service_methods [2] client_methods [2] 2026-02-22T21:35:24.794 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 10 AuthRegistry(0x7f3ce4067010) _refresh_config mon_cluster_modes [2,1] mon_service_modes [2,1] mon_client_modes [2,1]; cluster_modes [1,2] service_modes [1,2] client_modes [1,2] 2026-02-22T21:35:24.794 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:24.794 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:24.794 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 10 monclient: _reopen_session rank -1 2026-02-22T21:35:24.794 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 10 monclient: _add_conns ranks=[0] 2026-02-22T21:35:24.794 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 10 monclient(hunting): picked mon.noname-a con 0x7f3ce406e910 addr v1:10.20.193.23:6789/0 2026-02-22T21:35:24.795 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 1 -- --> v1:10.20.193.23:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x7f3ce4098f50 con 0x7f3ce406e910 2026-02-22T21:35:24.795 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 10 monclient(hunting): _renew_subs 2026-02-22T21:35:24.795 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 10 monclient(hunting): authenticate will time out at 596.978429s 2026-02-22T21:35:24.795 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce2ffd640 1 --1- >> v1:10.20.193.23:6789/0 conn(0x7f3ce406e910 0x7f3ce41e3a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.23:6789/0 says I am v1:10.20.193.23:43366/0 (socket says 10.20.193.23:43366) 2026-02-22T21:35:24.795 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce2ffd640 1 -- 10.20.193.23:0/2908028528 learned_addr learned my addr 10.20.193.23:0/2908028528 (peer_addr_for_me v1:10.20.193.23:0/0) 2026-02-22T21:35:24.795 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 1 -- 10.20.193.23:0/2908028528 <== mon.0 v1:10.20.193.23:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3600131097 0 0) 0x7f3ce4098f50 con 0x7f3ce406e910 2026-02-22T21:35:24.795 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 monclient(hunting): _negotiate 2026-02-22T21:35:24.795 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:35:24.795 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:35:24.795 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx client: reset 2026-02-22T21:35:24.795 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx: set_have_need_key no handler for service mon 2026-02-22T21:35:24.795 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx: set_have_need_key no handler for service osd 2026-02-22T21:35:24.795 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx: set_have_need_key no handler for service mgr 2026-02-22T21:35:24.795 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx: set_have_need_key no handler for service auth 2026-02-22T21:35:24.796 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx: validate_tickets want 53 have 0 need 53 2026-02-22T21:35:24.796 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx client: reset 2026-02-22T21:35:24.796 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 monclient(hunting): my global_id is 4253 2026-02-22T21:35:24.796 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx client: 0x7f3cb8003550 handle_response ret = 0 2026-02-22T21:35:24.796 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx client: got initial server challenge 9b79857ca071f828 2026-02-22T21:35:24.796 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx client: validate_tickets: want=53 need=53 have=0 2026-02-22T21:35:24.796 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx: set_have_need_key no handler for service mon 2026-02-22T21:35:24.796 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx: set_have_need_key no handler for service osd 2026-02-22T21:35:24.796 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx: set_have_need_key no handler for service mgr 2026-02-22T21:35:24.796 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx: set_have_need_key no handler for service auth 2026-02-22T21:35:24.796 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx: validate_tickets want 53 have 0 need 53 2026-02-22T21:35:24.796 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx client: want=53 need=53 have=0 2026-02-22T21:35:24.796 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx client: build_request 2026-02-22T21:35:24.796 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx client: get auth session key: client_challenge 1023616cc51542b6 2026-02-22T21:35:24.796 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 1 -- 10.20.193.23:0/2908028528 --> v1:10.20.193.23:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3cb8003630 con 0x7f3ce406e910 2026-02-22T21:35:24.796 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 1 -- 10.20.193.23:0/2908028528 <== mon.0 v1:10.20.193.23:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 732+0+0 (unknown 2208198772 0 0) 0x7f3cb8003630 con 0x7f3ce406e910 2026-02-22T21:35:24.796 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx client: 0x7f3cb8003550 handle_response ret = 0 2026-02-22T21:35:24.797 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx client: get_auth_session_key 2026-02-22T21:35:24.797 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx: verify_service_ticket_reply got 1 keys 2026-02-22T21:35:24.797 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx: got key for service_id auth 2026-02-22T21:35:24.797 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx: verify_service_ticket_reply ticket.secret_id=2 2026-02-22T21:35:24.797 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx: verify_service_ticket_reply service auth secret_id 2 session_key AQCcdptpAOp3LRAAlp6b7rqQaMJ0YIGLZdqAeA== validity=660.000000 2026-02-22T21:35:24.797 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx: verify_service_ticket_reply ticket expires=2026-02-22T21:46:24.762937+0000 renew_after=2026-02-22T21:43:39.762937+0000 2026-02-22T21:35:24.797 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx client: want=53 need=53 have=0 2026-02-22T21:35:24.797 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx client: got connection bl 0 and extra tickets 518 2026-02-22T21:35:24.797 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx: set_have_need_key no handler for service mon 2026-02-22T21:35:24.797 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx: set_have_need_key no handler for service osd 2026-02-22T21:35:24.797 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx: set_have_need_key no handler for service mgr 2026-02-22T21:35:24.797 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx: validate_tickets want 53 have 32 need 21 2026-02-22T21:35:24.797 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx client: validate_tickets: want=53 need=21 have=32 2026-02-22T21:35:24.797 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx: set_have_need_key no handler for service mon 2026-02-22T21:35:24.797 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx: set_have_need_key no handler for service osd 2026-02-22T21:35:24.798 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx: set_have_need_key no handler for service mgr 2026-02-22T21:35:24.798 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx: validate_tickets want 53 have 32 need 21 2026-02-22T21:35:24.798 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx client: want=53 need=21 have=32 2026-02-22T21:35:24.798 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx client: build_request 2026-02-22T21:35:24.798 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx client: get service keys: want=53 need=21 have=32 2026-02-22T21:35:24.798 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 1 -- 10.20.193.23:0/2908028528 --> v1:10.20.193.23:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3ce4098f50 con 0x7f3ce406e910 2026-02-22T21:35:24.798 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 1 -- 10.20.193.23:0/2908028528 <== mon.0 v1:10.20.193.23:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7f3cd80048f0 con 0x7f3ce406e910 2026-02-22T21:35:24.798 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T21:35:24.798 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T21:35:24.798 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 monclient(hunting): dump: 2026-02-22T21:35:24.798 INFO:tasks.workunit.client.0.trial023.stderr:epoch 1 2026-02-22T21:35:24.798 INFO:tasks.workunit.client.0.trial023.stderr:fsid e2dd7ed3-13e8-4519-aab8-5d5a54f80255 2026-02-22T21:35:24.798 INFO:tasks.workunit.client.0.trial023.stderr:last_changed 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:24.798 INFO:tasks.workunit.client.0.trial023.stderr:created 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:24.798 INFO:tasks.workunit.client.0.trial023.stderr:min_mon_release 19 (squid) 2026-02-22T21:35:24.798 INFO:tasks.workunit.client.0.trial023.stderr:election_strategy: 3 2026-02-22T21:35:24.799 INFO:tasks.workunit.client.0.trial023.stderr:0: v1:10.20.193.23:6789/0 mon.a 2026-02-22T21:35:24.799 INFO:tasks.workunit.client.0.trial023.stderr: 2026-02-22T21:35:24.799 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 monclient(hunting): _finish_auth 0 2026-02-22T21:35:24.799 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 1 -- 10.20.193.23:0/2908028528 <== mon.0 v1:10.20.193.23:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 548+0+0 (unknown 1992367925 0 0) 0x7f3ce4098f50 con 0x7f3ce406e910 2026-02-22T21:35:24.799 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx client: 0x7f3cb8003550 handle_response ret = 0 2026-02-22T21:35:24.799 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx client: get_principal_session_key session_key AQCcdptpAOp3LRAAlp6b7rqQaMJ0YIGLZdqAeA== 2026-02-22T21:35:24.799 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx: verify_service_ticket_reply got 3 keys 2026-02-22T21:35:24.799 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx: got key for service_id mon 2026-02-22T21:35:24.799 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx: verify_service_ticket_reply ticket.secret_id=2 2026-02-22T21:35:24.799 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx: verify_service_ticket_reply service mon secret_id 2 session_key AQCcdptp9ux6LRAAJYTUoPcVTHe+6VCStwRU2w== validity=240.000000 2026-02-22T21:35:24.799 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx: verify_service_ticket_reply ticket expires=2026-02-22T21:39:24.763100+0000 renew_after=2026-02-22T21:38:24.763100+0000 2026-02-22T21:35:24.799 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx: got key for service_id osd 2026-02-22T21:35:24.799 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx: verify_service_ticket_reply ticket.secret_id=2 2026-02-22T21:35:24.799 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx: verify_service_ticket_reply service osd secret_id 2 session_key AQCcdptpLvV6LRAAJZRTpMbvrPw8S8uoFzBoQQ== validity=240.000000 2026-02-22T21:35:24.799 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx: verify_service_ticket_reply ticket expires=2026-02-22T21:39:24.763107+0000 renew_after=2026-02-22T21:38:24.763107+0000 2026-02-22T21:35:24.799 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx: got key for service_id mgr 2026-02-22T21:35:24.800 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx: verify_service_ticket_reply ticket.secret_id=2 2026-02-22T21:35:24.800 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx: verify_service_ticket_reply service mgr secret_id 2 session_key AQCcdptpef96LRAAyTIq15I7mbV3cGoJQBKNnw== validity=240.000000 2026-02-22T21:35:24.800 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx: verify_service_ticket_reply ticket expires=2026-02-22T21:39:24.763113+0000 renew_after=2026-02-22T21:38:24.763113+0000 2026-02-22T21:35:24.800 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx: validate_tickets want 53 have 53 need 0 2026-02-22T21:35:24.800 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 monclient: _finish_hunting 0 2026-02-22T21:35:24.800 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 1 monclient: found mon.a 2026-02-22T21:35:24.800 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.23:6789/0 2026-02-22T21:35:24.800 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 1 -- 10.20.193.23:0/2908028528 --> v1:10.20.193.23:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ce4095970 con 0x7f3ce406e910 2026-02-22T21:35:24.800 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 monclient: _finish_auth 0 2026-02-22T21:35:24.800 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 monclient: _check_auth_tickets 2026-02-22T21:35:24.800 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx: validate_tickets want 53 have 53 need 0 2026-02-22T21:35:24.800 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 20 cephx client: need_tickets: want=53 have=53 need=0 2026-02-22T21:35:24.800 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 monclient: _check_auth_rotating renewing rotating keys (they expired before 2026-02-22T21:34:54.763124+0000) 2026-02-22T21:35:24.800 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx client: build_rotating_request 2026-02-22T21:35:24.800 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.23:6789/0 2026-02-22T21:35:24.801 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 1 -- 10.20.193.23:0/2908028528 --> v1:10.20.193.23:6789/0 -- auth(proto 2 2 bytes epoch 0) -- 0x7f3cb8003630 con 0x7f3ce406e910 2026-02-22T21:35:24.801 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 5 monclient: authenticate success, global_id 4253 2026-02-22T21:35:24.801 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 10 monclient: _renew_subs 2026-02-22T21:35:24.801 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.23:6789/0 2026-02-22T21:35:24.801 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 1 -- 10.20.193.23:0/2908028528 --> v1:10.20.193.23:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3ce40c0070 con 0x7f3ce406e910 2026-02-22T21:35:24.801 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 10 monclient: _renew_subs 2026-02-22T21:35:24.801 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.23:6789/0 2026-02-22T21:35:24.801 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 1 -- 10.20.193.23:0/2908028528 --> v1:10.20.193.23:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3ce4094030 con 0x7f3ce406e910 2026-02-22T21:35:24.801 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 1 -- 10.20.193.23:0/2908028528 <== mon.0 v1:10.20.193.23:6789/0 5 ==== config(1 keys) ==== 25+0+0 (unknown 1514702568 0 0) 0x7f3cd8003140 con 0x7f3ce406e910 2026-02-22T21:35:24.801 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 monclient: handle_config config(1 keys) 2026-02-22T21:35:24.801 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 1 -- 10.20.193.23:0/2908028528 <== mon.0 v1:10.20.193.23:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7f3cd8004e60 con 0x7f3ce406e910 2026-02-22T21:35:24.801 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:35:24.801 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T21:35:24.801 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 monclient: dump: 2026-02-22T21:35:24.801 INFO:tasks.workunit.client.0.trial023.stderr:epoch 1 2026-02-22T21:35:24.801 INFO:tasks.workunit.client.0.trial023.stderr:fsid e2dd7ed3-13e8-4519-aab8-5d5a54f80255 2026-02-22T21:35:24.802 INFO:tasks.workunit.client.0.trial023.stderr:last_changed 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:24.802 INFO:tasks.workunit.client.0.trial023.stderr:created 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:24.802 INFO:tasks.workunit.client.0.trial023.stderr:min_mon_release 19 (squid) 2026-02-22T21:35:24.802 INFO:tasks.workunit.client.0.trial023.stderr:election_strategy: 3 2026-02-22T21:35:24.802 INFO:tasks.workunit.client.0.trial023.stderr:0: v1:10.20.193.23:6789/0 mon.a 2026-02-22T21:35:24.802 INFO:tasks.workunit.client.0.trial023.stderr: 2026-02-22T21:35:24.802 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce17fa640 4 set_mon_vals no callback set 2026-02-22T21:35:24.802 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 1 -- 10.20.193.23:0/2908028528 <== mon.0 v1:10.20.193.23:6789/0 7 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (unknown 4230034614 0 0) 0x7f3ce4094030 con 0x7f3ce406e910 2026-02-22T21:35:24.802 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx client: 0x7f3cb8003550 handle_response ret = 0 2026-02-22T21:35:24.802 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx client: get_rotating_key 2026-02-22T21:35:24.802 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 auth: dump_rotating: 2026-02-22T21:35:24.802 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 auth: id 1 AQBddptpfYjTLhAAXh1N3uFywlax+2y6vwZmsw== expires 2026-02-22T21:38:21.785614+0000 2026-02-22T21:35:24.802 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 auth: id 2 AQBddptpiI/TLhAAdz7mEzTpWi2a8fttyDShuw== expires 2026-02-22T21:42:21.785614+0000 2026-02-22T21:35:24.802 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 auth: id 3 AQBddptpNJfTLhAA8yUoZRot9tLYY9D+lZZAdA== expires 2026-02-22T21:46:21.785614+0000 2026-02-22T21:35:24.802 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 monclient: _finish_auth 0 2026-02-22T21:35:24.802 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 monclient: _check_auth_tickets 2026-02-22T21:35:24.802 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 cephx: validate_tickets want 53 have 53 need 0 2026-02-22T21:35:24.803 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 20 cephx client: need_tickets: want=53 have=53 need=0 2026-02-22T21:35:24.803 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2026-02-22T21:34:54.763258+0000) 2026-02-22T21:35:24.803 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 auth: dump_rotating: 2026-02-22T21:35:24.803 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 auth: id 1 AQBddptpfYjTLhAAXh1N3uFywlax+2y6vwZmsw== expires 2026-02-22T21:38:21.785614+0000 2026-02-22T21:35:24.803 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 auth: id 2 AQBddptpiI/TLhAAdz7mEzTpWi2a8fttyDShuw== expires 2026-02-22T21:42:21.785614+0000 2026-02-22T21:35:24.803 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 10 auth: id 3 AQBddptpNJfTLhAA8yUoZRot9tLYY9D+lZZAdA== expires 2026-02-22T21:46:21.785614+0000 2026-02-22T21:35:24.803 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T21:35:24.803 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:35:24.803 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.23:6789/0 2026-02-22T21:35:24.803 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce96ef640 1 -- 10.20.193.23:0/2908028528 --> v1:10.20.193.23:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ce40cc4f0 con 0x7f3ce406e910 2026-02-22T21:35:24.803 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 1 -- 10.20.193.23:0/2908028528 <== mon.0 v1:10.20.193.23:6789/0 8 ==== mgrmap(e 4) ==== 47400+0+0 (unknown 1603120368 0 0) 0x7f3cd8010ae0 con 0x7f3ce406e910 2026-02-22T21:35:24.803 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3cc3fff640 1 -- 10.20.193.23:0/2908028528 <== mon.0 v1:10.20.193.23:6789/0 9 ==== osd_map(14..14 src has 1..14) ==== 2160+0+0 (unknown 946035718 0 0) 0x7f3cd8048f10 con 0x7f3ce406e910 2026-02-22T21:35:24.803 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce27fc640 10 monclient: get_auth_request con 0x7f3cb803b960 auth_method 0 2026-02-22T21:35:24.803 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce27fc640 10 cephx client: build_authorizer for service mgr 2026-02-22T21:35:24.803 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.756+0000 7f3ce27fc640 10 In get_auth_session_handler for protocol 2 2026-02-22T21:35:24.803 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.760+0000 7f3cc3fff640 1 -- 10.20.193.23:0/2908028528 <== mon.0 v1:10.20.193.23:6789/0 10 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (unknown 1092875540 0 3570997608) 0x7f3cd8016ba0 con 0x7f3ce406e910 2026-02-22T21:35:24.803 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.760+0000 7f3cc3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:35:24.803 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.760+0000 7f3cc3fff640 10 monclient: _finish_command 1 = system:0 2026-02-22T21:35:24.879 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.872+0000 7f3ce96ef640 10 start_mon_command cmd=[{"prefix": "config-key get", "key": "daemon-private/osd.123/test-foo"}] 2026-02-22T21:35:24.879 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.872+0000 7f3ce96ef640 10 monclient: _send_command 2 [{"prefix": "config-key get", "key": "daemon-private/osd.123/test-foo"}] 2026-02-22T21:35:24.879 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.872+0000 7f3ce96ef640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.23:6789/0 2026-02-22T21:35:24.879 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.872+0000 7f3ce96ef640 1 -- 10.20.193.23:0/2908028528 --> v1:10.20.193.23:6789/0 -- mon_command({"prefix": "config-key get", "key": "daemon-private/osd.123/test-foo"} v 0) -- 0x7f3ce4069a10 con 0x7f3ce406e910 2026-02-22T21:35:24.879 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.872+0000 7f3cc3fff640 1 -- 10.20.193.23:0/2908028528 <== mon.0 v1:10.20.193.23:6789/0 11 ==== mon_command_ack([{"prefix": "config-key get", "key": "daemon-private/osd.123/test-foo"}]=0 v13) ==== 104+0+0 (unknown 3728622630 0 0) 0x7f3cd80164a0 con 0x7f3ce406e910 2026-02-22T21:35:24.879 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.872+0000 7f3cc3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config-key get", "key": "daemon-private/osd.123/test-foo"}] 2026-02-22T21:35:24.879 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.872+0000 7f3cc3fff640 10 monclient: _finish_command 2 = system:0 2026-02-22T21:35:24.957 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.952+0000 7f3ce96ef640 10 start_mon_command cmd=[{"prefix": "config-key get", "key": "daemon-private/osd.123/test-foo"}] 2026-02-22T21:35:24.958 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.952+0000 7f3ce96ef640 10 monclient: _send_command 3 [{"prefix": "config-key get", "key": "daemon-private/osd.123/test-foo"}] 2026-02-22T21:35:24.958 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.952+0000 7f3ce96ef640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.23:6789/0 2026-02-22T21:35:24.958 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.952+0000 7f3ce96ef640 1 -- 10.20.193.23:0/2908028528 --> v1:10.20.193.23:6789/0 -- mon_command({"prefix": "config-key get", "key": "daemon-private/osd.123/test-foo"} v 0) -- 0x7f3ce4094320 con 0x7f3ce406e910 2026-02-22T21:35:24.958 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.952+0000 7f3cc3fff640 1 -- 10.20.193.23:0/2908028528 <== mon.0 v1:10.20.193.23:6789/0 12 ==== mon_command_ack([{"prefix": "config-key get", "key": "daemon-private/osd.123/test-foo"}]=0 v13) ==== 104+0+0 (unknown 3728622630 0 0) 0x7f3cd8047370 con 0x7f3ce406e910 2026-02-22T21:35:24.958 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.952+0000 7f3cc3fff640 10 monclient: handle_mon_command_ack 3 [{"prefix": "config-key get", "key": "daemon-private/osd.123/test-foo"}] 2026-02-22T21:35:24.958 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.952+0000 7f3cc3fff640 10 monclient: _finish_command 3 = system:0 2026-02-22T21:35:24.958 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.952+0000 7f3ce96ef640 1 -- 10.20.193.23:0/2908028528 >> v1:10.20.193.23:6800/2834055528 conn(0x7f3cb803b960 legacy=0x7f3cb803de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:35:24.958 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.952+0000 7f3ce96ef640 10 monclient: shutdown 2026-02-22T21:35:24.958 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.952+0000 7f3ce96ef640 1 -- 10.20.193.23:0/2908028528 >> v1:10.20.193.23:6789/0 conn(0x7f3ce406e910 legacy=0x7f3ce41e3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:35:24.958 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.952+0000 7f3ce96ef640 1 -- 10.20.193.23:0/2908028528 shutdown_connections 2026-02-22T21:35:24.958 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.952+0000 7f3ce96ef640 1 -- 10.20.193.23:0/2908028528 >> 10.20.193.23:0/2908028528 conn(0x7f3ce406e330 msgr2=0x7f3ce414d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:35:24.958 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.952+0000 7f3ce96ef640 1 -- 10.20.193.23:0/2908028528 shutdown_connections 2026-02-22T21:35:24.958 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:24.952+0000 7f3ce96ef640 1 -- 10.20.193.23:0/2908028528 wait complete. 2026-02-22T21:35:24.966 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name mgr.b config-key get mgr/test-foo 2026-02-22T21:35:25.045 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.024+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding auth protocol: cephx 2026-02-22T21:35:25.045 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.024+0000 7f72f716e640 20 AuthRegistry(0x7f72f0067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.045 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.024+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding auth protocol: cephx 2026-02-22T21:35:25.045 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.024+0000 7f72f716e640 20 AuthRegistry(0x7f72f0067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.045 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.024+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding auth protocol: cephx 2026-02-22T21:35:25.045 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.024+0000 7f72f716e640 20 AuthRegistry(0x7f72f0067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.046 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.024+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding con mode: secure 2026-02-22T21:35:25.046 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.024+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding con mode: crc 2026-02-22T21:35:25.046 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.024+0000 7f72f716e640 20 AuthRegistry(0x7f72f0067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.046 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.024+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding con mode: secure 2026-02-22T21:35:25.046 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.024+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding con mode: crc 2026-02-22T21:35:25.046 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.024+0000 7f72f716e640 20 AuthRegistry(0x7f72f0067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.046 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.024+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding con mode: secure 2026-02-22T21:35:25.046 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.024+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding con mode: crc 2026-02-22T21:35:25.046 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.024+0000 7f72f716e640 20 AuthRegistry(0x7f72f0067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.046 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.024+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding con mode: crc 2026-02-22T21:35:25.047 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.024+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding con mode: secure 2026-02-22T21:35:25.047 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.024+0000 7f72f716e640 20 AuthRegistry(0x7f72f0067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.047 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.024+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding con mode: crc 2026-02-22T21:35:25.047 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.024+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding con mode: secure 2026-02-22T21:35:25.047 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.024+0000 7f72f716e640 20 AuthRegistry(0x7f72f0067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.047 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.024+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding con mode: crc 2026-02-22T21:35:25.047 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.024+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding con mode: secure 2026-02-22T21:35:25.047 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.024+0000 7f72f716e640 20 AuthRegistry(0x7f72f0067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.047 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.024+0000 7f72f716e640 10 AuthRegistry(0x7f72f0067010) _refresh_config cluster_methods [2] service_methods [2] client_methods [2] 2026-02-22T21:35:25.047 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.024+0000 7f72f716e640 10 AuthRegistry(0x7f72f0067010) _refresh_config mon_cluster_modes [2,1] mon_service_modes [2,1] mon_client_modes [2,1]; cluster_modes [1,2] service_modes [1,2] client_modes [1,2] 2026-02-22T21:35:25.047 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.024+0000 7f72f716e640 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2026-02-22T21:35:25.048 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding auth protocol: cephx 2026-02-22T21:35:25.048 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 20 AuthRegistry(0x7f72f0067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.048 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding auth protocol: cephx 2026-02-22T21:35:25.048 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 20 AuthRegistry(0x7f72f0067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.048 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding auth protocol: cephx 2026-02-22T21:35:25.048 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 20 AuthRegistry(0x7f72f0067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.048 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding con mode: secure 2026-02-22T21:35:25.048 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding con mode: crc 2026-02-22T21:35:25.048 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 20 AuthRegistry(0x7f72f0067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.048 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding con mode: secure 2026-02-22T21:35:25.049 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding con mode: crc 2026-02-22T21:35:25.049 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 20 AuthRegistry(0x7f72f0067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.049 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding con mode: secure 2026-02-22T21:35:25.049 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding con mode: crc 2026-02-22T21:35:25.049 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 20 AuthRegistry(0x7f72f0067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.049 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding con mode: crc 2026-02-22T21:35:25.049 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding con mode: secure 2026-02-22T21:35:25.049 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 20 AuthRegistry(0x7f72f0067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.049 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding con mode: crc 2026-02-22T21:35:25.049 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding con mode: secure 2026-02-22T21:35:25.049 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 20 AuthRegistry(0x7f72f0067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.050 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding con mode: crc 2026-02-22T21:35:25.050 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding con mode: secure 2026-02-22T21:35:25.050 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 20 AuthRegistry(0x7f72f0067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.050 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 10 AuthRegistry(0x7f72f0067010) _refresh_config cluster_methods [2] service_methods [2] client_methods [2] 2026-02-22T21:35:25.050 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 10 AuthRegistry(0x7f72f0067010) _refresh_config mon_cluster_modes [2,1] mon_service_modes [2,1] mon_client_modes [2,1]; cluster_modes [1,2] service_modes [1,2] client_modes [1,2] 2026-02-22T21:35:25.050 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:25.050 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 10 monclient: get_monmap_and_config 2026-02-22T21:35:25.050 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 10 monclient: build_initial_monmap 2026-02-22T21:35:25.050 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 10 monclient: monmap: 2026-02-22T21:35:25.050 INFO:tasks.workunit.client.0.trial023.stderr:epoch 0 2026-02-22T21:35:25.050 INFO:tasks.workunit.client.0.trial023.stderr:fsid e2dd7ed3-13e8-4519-aab8-5d5a54f80255 2026-02-22T21:35:25.051 INFO:tasks.workunit.client.0.trial023.stderr:last_changed 2026-02-22T21:35:25.034020+0000 2026-02-22T21:35:25.051 INFO:tasks.workunit.client.0.trial023.stderr:created 2026-02-22T21:35:25.034020+0000 2026-02-22T21:35:25.051 INFO:tasks.workunit.client.0.trial023.stderr:min_mon_release 0 (unknown) 2026-02-22T21:35:25.051 INFO:tasks.workunit.client.0.trial023.stderr:election_strategy: 3 2026-02-22T21:35:25.051 INFO:tasks.workunit.client.0.trial023.stderr:0: v1:10.20.193.23:6789/0 mon.noname-a 2026-02-22T21:35:25.051 INFO:tasks.workunit.client.0.trial023.stderr: 2026-02-22T21:35:25.051 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 5 AuthRegistry(0x7f72f0068a80) adding auth protocol: cephx 2026-02-22T21:35:25.051 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 20 AuthRegistry(0x7f72f0068a80) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.051 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 5 AuthRegistry(0x7f72f0068a80) adding auth protocol: cephx 2026-02-22T21:35:25.052 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 20 AuthRegistry(0x7f72f0068a80) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.052 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 5 AuthRegistry(0x7f72f0068a80) adding auth protocol: cephx 2026-02-22T21:35:25.052 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 20 AuthRegistry(0x7f72f0068a80) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.052 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 5 AuthRegistry(0x7f72f0068a80) adding con mode: secure 2026-02-22T21:35:25.052 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 5 AuthRegistry(0x7f72f0068a80) adding con mode: crc 2026-02-22T21:35:25.052 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 20 AuthRegistry(0x7f72f0068a80) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.052 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 5 AuthRegistry(0x7f72f0068a80) adding con mode: secure 2026-02-22T21:35:25.052 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 5 AuthRegistry(0x7f72f0068a80) adding con mode: crc 2026-02-22T21:35:25.052 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 20 AuthRegistry(0x7f72f0068a80) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.052 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 5 AuthRegistry(0x7f72f0068a80) adding con mode: secure 2026-02-22T21:35:25.052 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 5 AuthRegistry(0x7f72f0068a80) adding con mode: crc 2026-02-22T21:35:25.052 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 20 AuthRegistry(0x7f72f0068a80) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.053 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 5 AuthRegistry(0x7f72f0068a80) adding con mode: crc 2026-02-22T21:35:25.053 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 5 AuthRegistry(0x7f72f0068a80) adding con mode: secure 2026-02-22T21:35:25.053 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 20 AuthRegistry(0x7f72f0068a80) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.053 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 5 AuthRegistry(0x7f72f0068a80) adding con mode: crc 2026-02-22T21:35:25.053 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 5 AuthRegistry(0x7f72f0068a80) adding con mode: secure 2026-02-22T21:35:25.053 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 20 AuthRegistry(0x7f72f0068a80) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.053 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 5 AuthRegistry(0x7f72f0068a80) adding con mode: crc 2026-02-22T21:35:25.053 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 5 AuthRegistry(0x7f72f0068a80) adding con mode: secure 2026-02-22T21:35:25.053 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 20 AuthRegistry(0x7f72f0068a80) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.053 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 10 AuthRegistry(0x7f72f0068a80) _refresh_config cluster_methods [2] service_methods [2] client_methods [2] 2026-02-22T21:35:25.053 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 10 AuthRegistry(0x7f72f0068a80) _refresh_config mon_cluster_modes [2,1] mon_service_modes [2,1] mon_client_modes [2,1]; cluster_modes [1,2] service_modes [1,2] client_modes [1,2] 2026-02-22T21:35:25.054 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:25.054 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 1 Processor -- start 2026-02-22T21:35:25.054 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 1 -- start start 2026-02-22T21:35:25.054 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 10 monclient: init 2026-02-22T21:35:25.054 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 5 AuthRegistry(0x7f72f716cf50) adding auth protocol: cephx 2026-02-22T21:35:25.054 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 20 AuthRegistry(0x7f72f716cf50) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.054 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 5 AuthRegistry(0x7f72f716cf50) adding auth protocol: cephx 2026-02-22T21:35:25.054 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 20 AuthRegistry(0x7f72f716cf50) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.054 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 5 AuthRegistry(0x7f72f716cf50) adding auth protocol: cephx 2026-02-22T21:35:25.054 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 20 AuthRegistry(0x7f72f716cf50) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.054 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 5 AuthRegistry(0x7f72f716cf50) adding con mode: secure 2026-02-22T21:35:25.054 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 5 AuthRegistry(0x7f72f716cf50) adding con mode: crc 2026-02-22T21:35:25.055 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 20 AuthRegistry(0x7f72f716cf50) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.055 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 5 AuthRegistry(0x7f72f716cf50) adding con mode: secure 2026-02-22T21:35:25.055 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 5 AuthRegistry(0x7f72f716cf50) adding con mode: crc 2026-02-22T21:35:25.055 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 20 AuthRegistry(0x7f72f716cf50) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.055 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 5 AuthRegistry(0x7f72f716cf50) adding con mode: secure 2026-02-22T21:35:25.055 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 5 AuthRegistry(0x7f72f716cf50) adding con mode: crc 2026-02-22T21:35:25.055 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 20 AuthRegistry(0x7f72f716cf50) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.055 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 5 AuthRegistry(0x7f72f716cf50) adding con mode: crc 2026-02-22T21:35:25.055 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 5 AuthRegistry(0x7f72f716cf50) adding con mode: secure 2026-02-22T21:35:25.055 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 20 AuthRegistry(0x7f72f716cf50) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.055 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 5 AuthRegistry(0x7f72f716cf50) adding con mode: crc 2026-02-22T21:35:25.055 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 5 AuthRegistry(0x7f72f716cf50) adding con mode: secure 2026-02-22T21:35:25.055 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 20 AuthRegistry(0x7f72f716cf50) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.056 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 5 AuthRegistry(0x7f72f716cf50) adding con mode: crc 2026-02-22T21:35:25.056 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 5 AuthRegistry(0x7f72f716cf50) adding con mode: secure 2026-02-22T21:35:25.056 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 20 AuthRegistry(0x7f72f716cf50) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.056 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 10 AuthRegistry(0x7f72f716cf50) _refresh_config cluster_methods [2] service_methods [2] client_methods [2] 2026-02-22T21:35:25.056 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 10 AuthRegistry(0x7f72f716cf50) _refresh_config mon_cluster_modes [2,1] mon_service_modes [2,1] mon_client_modes [2,1]; cluster_modes [1,2] service_modes [1,2] client_modes [1,2] 2026-02-22T21:35:25.056 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:25.056 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:25.056 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 10 monclient: _reopen_session rank -1 2026-02-22T21:35:25.056 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 10 monclient: _add_conns ranks=[0] 2026-02-22T21:35:25.056 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 10 monclient(hunting): picked mon.noname-a con 0x7f72f01574a0 addr v1:10.20.193.23:6789/0 2026-02-22T21:35:25.057 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 1 -- --> v1:10.20.193.23:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x7f72f00bfd30 con 0x7f72f01574a0 2026-02-22T21:35:25.057 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 10 monclient(hunting): _renew_subs 2026-02-22T21:35:25.057 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f716e640 10 monclient(hunting): authenticate will time out at 597.251570s 2026-02-22T21:35:25.057 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f4ee3640 1 --1- >> v1:10.20.193.23:6789/0 conn(0x7f72f01574a0 0x7f72f00bf620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.23:6789/0 says I am v1:10.20.193.23:43378/0 (socket says 10.20.193.23:43378) 2026-02-22T21:35:25.057 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72f4ee3640 1 -- 10.20.193.23:0/870263787 learned_addr learned my addr 10.20.193.23:0/870263787 (peer_addr_for_me v1:10.20.193.23:0/0) 2026-02-22T21:35:25.057 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72e77fe640 1 -- 10.20.193.23:0/870263787 <== mon.0 v1:10.20.193.23:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3401560422 0 0) 0x7f72f00bfd30 con 0x7f72f01574a0 2026-02-22T21:35:25.057 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72e77fe640 10 monclient(hunting): _negotiate 2026-02-22T21:35:25.057 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72e77fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:35:25.057 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72e77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:35:25.057 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72e77fe640 10 cephx client: reset 2026-02-22T21:35:25.058 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72e77fe640 10 cephx: set_have_need_key no handler for service auth 2026-02-22T21:35:25.058 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72e77fe640 10 cephx: validate_tickets want 32 have 0 need 32 2026-02-22T21:35:25.058 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72e77fe640 10 cephx client: reset 2026-02-22T21:35:25.058 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72e77fe640 10 monclient(hunting): my global_id is 4254 2026-02-22T21:35:25.058 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72e77fe640 10 cephx client: 0x7f72dc003550 handle_response ret = 0 2026-02-22T21:35:25.058 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72e77fe640 10 cephx client: got initial server challenge 840a3db9688dd575 2026-02-22T21:35:25.058 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72e77fe640 10 cephx client: validate_tickets: want=32 need=32 have=0 2026-02-22T21:35:25.058 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72e77fe640 10 cephx: set_have_need_key no handler for service auth 2026-02-22T21:35:25.058 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72e77fe640 10 cephx: validate_tickets want 32 have 0 need 32 2026-02-22T21:35:25.058 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72e77fe640 10 cephx client: want=32 need=32 have=0 2026-02-22T21:35:25.058 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72e77fe640 10 cephx client: build_request 2026-02-22T21:35:25.058 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72e77fe640 10 cephx client: get auth session key: client_challenge d39280019fdd2e70 2026-02-22T21:35:25.059 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72e77fe640 1 -- 10.20.193.23:0/870263787 --> v1:10.20.193.23:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f72dc003630 con 0x7f72f01574a0 2026-02-22T21:35:25.059 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72e77fe640 1 -- 10.20.193.23:0/870263787 <== mon.0 v1:10.20.193.23:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1508256379 0 0) 0x7f72dc003630 con 0x7f72f01574a0 2026-02-22T21:35:25.059 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72e77fe640 10 cephx client: 0x7f72dc003550 handle_response ret = 0 2026-02-22T21:35:25.059 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72e77fe640 10 cephx client: get_auth_session_key 2026-02-22T21:35:25.059 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72e77fe640 10 cephx: verify_service_ticket_reply got 1 keys 2026-02-22T21:35:25.059 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.028+0000 7f72e77fe640 10 cephx: got key for service_id auth 2026-02-22T21:35:25.059 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e77fe640 10 cephx: verify_service_ticket_reply ticket.secret_id=2 2026-02-22T21:35:25.059 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e77fe640 10 cephx: verify_service_ticket_reply service auth secret_id 2 session_key AQCddptpFnslAhAA//s4YnE8Vk96W4o9qT9AZA== validity=660.000000 2026-02-22T21:35:25.059 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e77fe640 10 cephx: verify_service_ticket_reply ticket expires=2026-02-22T21:46:25.036089+0000 renew_after=2026-02-22T21:43:40.036089+0000 2026-02-22T21:35:25.059 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e77fe640 10 cephx client: want=32 need=32 have=0 2026-02-22T21:35:25.060 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e77fe640 10 cephx client: got connection bl 0 and extra tickets 0 2026-02-22T21:35:25.060 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e77fe640 10 cephx: validate_tickets want 32 have 32 need 0 2026-02-22T21:35:25.060 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e77fe640 10 monclient: _finish_hunting 0 2026-02-22T21:35:25.060 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e77fe640 1 monclient: found mon.noname-a 2026-02-22T21:35:25.060 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e77fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.23:6789/0 2026-02-22T21:35:25.060 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e77fe640 1 -- 10.20.193.23:0/870263787 --> v1:10.20.193.23:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72f0166390 con 0x7f72f01574a0 2026-02-22T21:35:25.060 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e77fe640 10 monclient: _finish_auth 0 2026-02-22T21:35:25.060 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e77fe640 10 monclient: _check_auth_tickets 2026-02-22T21:35:25.060 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e77fe640 10 cephx: validate_tickets want 32 have 32 need 0 2026-02-22T21:35:25.060 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e77fe640 20 cephx client: need_tickets: want=32 have=32 need=0 2026-02-22T21:35:25.061 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e77fe640 10 monclient: _check_auth_rotating renewing rotating keys (they expired before 2026-02-22T21:34:55.036101+0000) 2026-02-22T21:35:25.061 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e77fe640 10 cephx client: build_rotating_request 2026-02-22T21:35:25.061 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e77fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.23:6789/0 2026-02-22T21:35:25.061 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e77fe640 1 -- 10.20.193.23:0/870263787 --> v1:10.20.193.23:6789/0 -- auth(proto 2 2 bytes epoch 0) -- 0x7f72f00bfd30 con 0x7f72f01574a0 2026-02-22T21:35:25.061 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e77fe640 1 -- 10.20.193.23:0/870263787 <== mon.0 v1:10.20.193.23:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7f72e0002e20 con 0x7f72f01574a0 2026-02-22T21:35:25.061 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:35:25.061 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e77fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T21:35:25.061 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e77fe640 10 monclient: dump: 2026-02-22T21:35:25.061 INFO:tasks.workunit.client.0.trial023.stderr:epoch 1 2026-02-22T21:35:25.061 INFO:tasks.workunit.client.0.trial023.stderr:fsid e2dd7ed3-13e8-4519-aab8-5d5a54f80255 2026-02-22T21:35:25.061 INFO:tasks.workunit.client.0.trial023.stderr:last_changed 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:25.062 INFO:tasks.workunit.client.0.trial023.stderr:created 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:25.062 INFO:tasks.workunit.client.0.trial023.stderr:min_mon_release 19 (squid) 2026-02-22T21:35:25.062 INFO:tasks.workunit.client.0.trial023.stderr:election_strategy: 3 2026-02-22T21:35:25.062 INFO:tasks.workunit.client.0.trial023.stderr:0: v1:10.20.193.23:6789/0 mon.a 2026-02-22T21:35:25.062 INFO:tasks.workunit.client.0.trial023.stderr: 2026-02-22T21:35:25.062 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 5 monclient: authenticate success, global_id 4254 2026-02-22T21:35:25.062 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e77fe640 1 -- 10.20.193.23:0/870263787 <== mon.0 v1:10.20.193.23:6789/0 4 ==== config(1 keys) ==== 25+0+0 (unknown 1514702568 0 0) 0x7f72e0003140 con 0x7f72f01574a0 2026-02-22T21:35:25.062 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e77fe640 10 monclient: handle_config config(1 keys) 2026-02-22T21:35:25.062 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e77fe640 1 -- 10.20.193.23:0/870263787 <== mon.0 v1:10.20.193.23:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7f72e00049b0 con 0x7f72f01574a0 2026-02-22T21:35:25.062 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:35:25.063 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T21:35:25.063 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e77fe640 10 monclient: dump: 2026-02-22T21:35:25.063 INFO:tasks.workunit.client.0.trial023.stderr:epoch 1 2026-02-22T21:35:25.063 INFO:tasks.workunit.client.0.trial023.stderr:fsid e2dd7ed3-13e8-4519-aab8-5d5a54f80255 2026-02-22T21:35:25.063 INFO:tasks.workunit.client.0.trial023.stderr:last_changed 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:25.063 INFO:tasks.workunit.client.0.trial023.stderr:created 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:25.063 INFO:tasks.workunit.client.0.trial023.stderr:min_mon_release 19 (squid) 2026-02-22T21:35:25.063 INFO:tasks.workunit.client.0.trial023.stderr:election_strategy: 3 2026-02-22T21:35:25.063 INFO:tasks.workunit.client.0.trial023.stderr:0: v1:10.20.193.23:6789/0 mon.a 2026-02-22T21:35:25.063 INFO:tasks.workunit.client.0.trial023.stderr: 2026-02-22T21:35:25.064 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e77fe640 1 -- 10.20.193.23:0/870263787 <== mon.0 v1:10.20.193.23:6789/0 6 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (unknown 1170803767 0 0) 0x7f72f00bfd30 con 0x7f72f01574a0 2026-02-22T21:35:25.064 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e77fe640 10 cephx client: 0x7f72dc003550 handle_response ret = 0 2026-02-22T21:35:25.064 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e77fe640 10 cephx client: get_rotating_key 2026-02-22T21:35:25.064 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e77fe640 10 auth: dump_rotating: 2026-02-22T21:35:25.064 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e77fe640 10 auth: id 1 AQBddptpfYjTLhAAXh1N3uFywlax+2y6vwZmsw== expires 2026-02-22T21:38:21.785614+0000 2026-02-22T21:35:25.064 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e77fe640 10 auth: id 2 AQBddptpiI/TLhAAdz7mEzTpWi2a8fttyDShuw== expires 2026-02-22T21:42:21.785614+0000 2026-02-22T21:35:25.064 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e77fe640 10 auth: id 3 AQBddptpNJfTLhAA8yUoZRot9tLYY9D+lZZAdA== expires 2026-02-22T21:46:21.785614+0000 2026-02-22T21:35:25.064 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e77fe640 10 monclient: _finish_auth 0 2026-02-22T21:35:25.064 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e77fe640 10 monclient: _check_auth_tickets 2026-02-22T21:35:25.064 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e77fe640 10 cephx: validate_tickets want 32 have 32 need 0 2026-02-22T21:35:25.065 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e77fe640 20 cephx client: need_tickets: want=32 have=32 need=0 2026-02-22T21:35:25.065 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e77fe640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2026-02-22T21:34:55.036194+0000) 2026-02-22T21:35:25.065 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e77fe640 10 auth: dump_rotating: 2026-02-22T21:35:25.065 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e77fe640 10 auth: id 1 AQBddptpfYjTLhAAXh1N3uFywlax+2y6vwZmsw== expires 2026-02-22T21:38:21.785614+0000 2026-02-22T21:35:25.065 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e77fe640 10 auth: id 2 AQBddptpiI/TLhAAdz7mEzTpWi2a8fttyDShuw== expires 2026-02-22T21:42:21.785614+0000 2026-02-22T21:35:25.065 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e77fe640 10 auth: id 3 AQBddptpNJfTLhAA8yUoZRot9tLYY9D+lZZAdA== expires 2026-02-22T21:46:21.785614+0000 2026-02-22T21:35:25.065 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 10 monclient: get_monmap_and_config success 2026-02-22T21:35:25.065 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 4 set_mon_vals no callback set 2026-02-22T21:35:25.065 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 10 set_mon_vals mgr_pool = false 2026-02-22T21:35:25.065 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 10 monclient: shutdown 2026-02-22T21:35:25.065 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 1 -- 10.20.193.23:0/870263787 >> v1:10.20.193.23:6789/0 conn(0x7f72f01574a0 legacy=0x7f72f00bf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:35:25.066 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 1 -- 10.20.193.23:0/870263787 shutdown_connections 2026-02-22T21:35:25.066 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 1 -- 10.20.193.23:0/870263787 >> 10.20.193.23:0/870263787 conn(0x7f72f006e5f0 msgr2=0x7f72f006e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:35:25.066 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 1 -- 10.20.193.23:0/870263787 shutdown_connections 2026-02-22T21:35:25.066 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 1 -- 10.20.193.23:0/870263787 wait complete. 2026-02-22T21:35:25.066 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding auth protocol: cephx 2026-02-22T21:35:25.066 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 20 AuthRegistry(0x7f72f0067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.066 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding auth protocol: cephx 2026-02-22T21:35:25.066 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 20 AuthRegistry(0x7f72f0067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.066 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding auth protocol: cephx 2026-02-22T21:35:25.067 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 20 AuthRegistry(0x7f72f0067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.067 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding con mode: secure 2026-02-22T21:35:25.067 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding con mode: crc 2026-02-22T21:35:25.067 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 20 AuthRegistry(0x7f72f0067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.067 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding con mode: secure 2026-02-22T21:35:25.067 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding con mode: crc 2026-02-22T21:35:25.067 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 20 AuthRegistry(0x7f72f0067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.067 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding con mode: secure 2026-02-22T21:35:25.067 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding con mode: crc 2026-02-22T21:35:25.067 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 20 AuthRegistry(0x7f72f0067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.067 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding con mode: crc 2026-02-22T21:35:25.067 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding con mode: secure 2026-02-22T21:35:25.068 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 20 AuthRegistry(0x7f72f0067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.068 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding con mode: crc 2026-02-22T21:35:25.068 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding con mode: secure 2026-02-22T21:35:25.068 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 20 AuthRegistry(0x7f72f0067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.068 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding con mode: crc 2026-02-22T21:35:25.068 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding con mode: secure 2026-02-22T21:35:25.068 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 20 AuthRegistry(0x7f72f0067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.068 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 10 AuthRegistry(0x7f72f0067010) _refresh_config cluster_methods [2] service_methods [2] client_methods [2] 2026-02-22T21:35:25.068 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 10 AuthRegistry(0x7f72f0067010) _refresh_config mon_cluster_modes [2,1] mon_service_modes [2,1] mon_client_modes [2,1]; cluster_modes [1,2] service_modes [1,2] client_modes [1,2] 2026-02-22T21:35:25.068 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:25.068 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 10 monclient: build_initial_monmap 2026-02-22T21:35:25.069 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 10 monclient: monmap: 2026-02-22T21:35:25.069 INFO:tasks.workunit.client.0.trial023.stderr:epoch 0 2026-02-22T21:35:25.069 INFO:tasks.workunit.client.0.trial023.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T21:35:25.069 INFO:tasks.workunit.client.0.trial023.stderr:last_changed 0.000000 2026-02-22T21:35:25.069 INFO:tasks.workunit.client.0.trial023.stderr:created 0.000000 2026-02-22T21:35:25.069 INFO:tasks.workunit.client.0.trial023.stderr:min_mon_release 0 (unknown) 2026-02-22T21:35:25.069 INFO:tasks.workunit.client.0.trial023.stderr:election_strategy: 1 2026-02-22T21:35:25.069 INFO:tasks.workunit.client.0.trial023.stderr:0: v1:10.20.193.23:6789/0 mon.noname-a 2026-02-22T21:35:25.069 INFO:tasks.workunit.client.0.trial023.stderr: 2026-02-22T21:35:25.069 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 5 AuthRegistry(0x7f72f014faf0) adding auth protocol: cephx 2026-02-22T21:35:25.069 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 20 AuthRegistry(0x7f72f014faf0) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.069 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 5 AuthRegistry(0x7f72f014faf0) adding auth protocol: cephx 2026-02-22T21:35:25.070 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 20 AuthRegistry(0x7f72f014faf0) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.070 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 5 AuthRegistry(0x7f72f014faf0) adding auth protocol: cephx 2026-02-22T21:35:25.070 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 20 AuthRegistry(0x7f72f014faf0) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.070 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 5 AuthRegistry(0x7f72f014faf0) adding con mode: secure 2026-02-22T21:35:25.070 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 5 AuthRegistry(0x7f72f014faf0) adding con mode: crc 2026-02-22T21:35:25.070 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 20 AuthRegistry(0x7f72f014faf0) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.070 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 5 AuthRegistry(0x7f72f014faf0) adding con mode: secure 2026-02-22T21:35:25.070 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 5 AuthRegistry(0x7f72f014faf0) adding con mode: crc 2026-02-22T21:35:25.070 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 20 AuthRegistry(0x7f72f014faf0) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.070 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 5 AuthRegistry(0x7f72f014faf0) adding con mode: secure 2026-02-22T21:35:25.070 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 5 AuthRegistry(0x7f72f014faf0) adding con mode: crc 2026-02-22T21:35:25.070 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 20 AuthRegistry(0x7f72f014faf0) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.071 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 5 AuthRegistry(0x7f72f014faf0) adding con mode: crc 2026-02-22T21:35:25.071 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 5 AuthRegistry(0x7f72f014faf0) adding con mode: secure 2026-02-22T21:35:25.071 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 20 AuthRegistry(0x7f72f014faf0) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.071 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 5 AuthRegistry(0x7f72f014faf0) adding con mode: crc 2026-02-22T21:35:25.071 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 5 AuthRegistry(0x7f72f014faf0) adding con mode: secure 2026-02-22T21:35:25.071 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 20 AuthRegistry(0x7f72f014faf0) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.071 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 5 AuthRegistry(0x7f72f014faf0) adding con mode: crc 2026-02-22T21:35:25.071 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 5 AuthRegistry(0x7f72f014faf0) adding con mode: secure 2026-02-22T21:35:25.071 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 20 AuthRegistry(0x7f72f014faf0) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.071 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 10 AuthRegistry(0x7f72f014faf0) _refresh_config cluster_methods [2] service_methods [2] client_methods [2] 2026-02-22T21:35:25.071 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 10 AuthRegistry(0x7f72f014faf0) _refresh_config mon_cluster_modes [2,1] mon_service_modes [2,1] mon_client_modes [2,1]; cluster_modes [1,2] service_modes [1,2] client_modes [1,2] 2026-02-22T21:35:25.071 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:25.071 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 1 Processor -- start 2026-02-22T21:35:25.072 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 1 -- start start 2026-02-22T21:35:25.072 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 10 monclient: init 2026-02-22T21:35:25.072 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding auth protocol: cephx 2026-02-22T21:35:25.072 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 20 AuthRegistry(0x7f72f0067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.072 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding auth protocol: cephx 2026-02-22T21:35:25.072 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 20 AuthRegistry(0x7f72f0067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.072 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding auth protocol: cephx 2026-02-22T21:35:25.072 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 20 AuthRegistry(0x7f72f0067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.072 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding con mode: secure 2026-02-22T21:35:25.072 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding con mode: crc 2026-02-22T21:35:25.072 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 20 AuthRegistry(0x7f72f0067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.072 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding con mode: secure 2026-02-22T21:35:25.072 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding con mode: crc 2026-02-22T21:35:25.072 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 20 AuthRegistry(0x7f72f0067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.073 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding con mode: secure 2026-02-22T21:35:25.073 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding con mode: crc 2026-02-22T21:35:25.073 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 20 AuthRegistry(0x7f72f0067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.073 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding con mode: crc 2026-02-22T21:35:25.073 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding con mode: secure 2026-02-22T21:35:25.073 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 20 AuthRegistry(0x7f72f0067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.073 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding con mode: crc 2026-02-22T21:35:25.073 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding con mode: secure 2026-02-22T21:35:25.073 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 20 AuthRegistry(0x7f72f0067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.073 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding con mode: crc 2026-02-22T21:35:25.073 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 5 AuthRegistry(0x7f72f0067010) adding con mode: secure 2026-02-22T21:35:25.073 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 20 AuthRegistry(0x7f72f0067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.073 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 10 AuthRegistry(0x7f72f0067010) _refresh_config cluster_methods [2] service_methods [2] client_methods [2] 2026-02-22T21:35:25.073 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 10 AuthRegistry(0x7f72f0067010) _refresh_config mon_cluster_modes [2,1] mon_service_modes [2,1] mon_client_modes [2,1]; cluster_modes [1,2] service_modes [1,2] client_modes [1,2] 2026-02-22T21:35:25.074 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:25.074 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:25.074 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 10 monclient: _reopen_session rank -1 2026-02-22T21:35:25.074 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 10 monclient: _add_conns ranks=[0] 2026-02-22T21:35:25.074 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 10 monclient(hunting): picked mon.noname-a con 0x7f72f01574a0 addr v1:10.20.193.23:6789/0 2026-02-22T21:35:25.074 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 1 -- --> v1:10.20.193.23:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x7f72f00c6920 con 0x7f72f01574a0 2026-02-22T21:35:25.074 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 10 monclient(hunting): _renew_subs 2026-02-22T21:35:25.074 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 10 monclient(hunting): authenticate will time out at 597.254392s 2026-02-22T21:35:25.074 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f4ee3640 1 --1- >> v1:10.20.193.23:6789/0 conn(0x7f72f01574a0 0x7f72f00c8930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.23:6789/0 says I am v1:10.20.193.23:43388/0 (socket says 10.20.193.23:43388) 2026-02-22T21:35:25.074 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f4ee3640 1 -- 10.20.193.23:0/1368318251 learned_addr learned my addr 10.20.193.23:0/1368318251 (peer_addr_for_me v1:10.20.193.23:0/0) 2026-02-22T21:35:25.074 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 1 -- 10.20.193.23:0/1368318251 <== mon.0 v1:10.20.193.23:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3674554148 0 0) 0x7f72f00c6920 con 0x7f72f01574a0 2026-02-22T21:35:25.074 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 monclient(hunting): _negotiate 2026-02-22T21:35:25.074 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:35:25.074 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:35:25.075 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx client: reset 2026-02-22T21:35:25.075 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx: set_have_need_key no handler for service mon 2026-02-22T21:35:25.075 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx: set_have_need_key no handler for service osd 2026-02-22T21:35:25.075 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx: set_have_need_key no handler for service mgr 2026-02-22T21:35:25.075 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx: set_have_need_key no handler for service auth 2026-02-22T21:35:25.075 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx: validate_tickets want 53 have 0 need 53 2026-02-22T21:35:25.075 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx client: reset 2026-02-22T21:35:25.075 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 monclient(hunting): my global_id is 4255 2026-02-22T21:35:25.075 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx client: 0x7f72cc003550 handle_response ret = 0 2026-02-22T21:35:25.075 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx client: got initial server challenge 43ada2066a1b33c0 2026-02-22T21:35:25.075 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx client: validate_tickets: want=53 need=53 have=0 2026-02-22T21:35:25.075 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx: set_have_need_key no handler for service mon 2026-02-22T21:35:25.075 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx: set_have_need_key no handler for service osd 2026-02-22T21:35:25.075 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx: set_have_need_key no handler for service mgr 2026-02-22T21:35:25.076 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx: set_have_need_key no handler for service auth 2026-02-22T21:35:25.076 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx: validate_tickets want 53 have 0 need 53 2026-02-22T21:35:25.076 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx client: want=53 need=53 have=0 2026-02-22T21:35:25.076 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx client: build_request 2026-02-22T21:35:25.076 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx client: get auth session key: client_challenge d58ae26a4c055dd0 2026-02-22T21:35:25.076 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 1 -- 10.20.193.23:0/1368318251 --> v1:10.20.193.23:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f72cc003630 con 0x7f72f01574a0 2026-02-22T21:35:25.076 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 1 -- 10.20.193.23:0/1368318251 <== mon.0 v1:10.20.193.23:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 732+0+0 (unknown 3850566182 0 0) 0x7f72cc003630 con 0x7f72f01574a0 2026-02-22T21:35:25.076 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx client: 0x7f72cc003550 handle_response ret = 0 2026-02-22T21:35:25.076 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx client: get_auth_session_key 2026-02-22T21:35:25.076 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx: verify_service_ticket_reply got 1 keys 2026-02-22T21:35:25.076 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx: got key for service_id auth 2026-02-22T21:35:25.076 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx: verify_service_ticket_reply ticket.secret_id=2 2026-02-22T21:35:25.076 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx: verify_service_ticket_reply service auth secret_id 2 session_key AQCddptpqoJPAhAAggLElDhP3BhjMFRGzogqdw== validity=660.000000 2026-02-22T21:35:25.076 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx: verify_service_ticket_reply ticket expires=2026-02-22T21:46:25.038863+0000 renew_after=2026-02-22T21:43:40.038863+0000 2026-02-22T21:35:25.077 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx client: want=53 need=53 have=0 2026-02-22T21:35:25.077 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx client: got connection bl 0 and extra tickets 518 2026-02-22T21:35:25.077 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx: set_have_need_key no handler for service mon 2026-02-22T21:35:25.077 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx: set_have_need_key no handler for service osd 2026-02-22T21:35:25.077 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx: set_have_need_key no handler for service mgr 2026-02-22T21:35:25.077 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx: validate_tickets want 53 have 32 need 21 2026-02-22T21:35:25.077 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx client: validate_tickets: want=53 need=21 have=32 2026-02-22T21:35:25.077 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx: set_have_need_key no handler for service mon 2026-02-22T21:35:25.077 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx: set_have_need_key no handler for service osd 2026-02-22T21:35:25.077 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx: set_have_need_key no handler for service mgr 2026-02-22T21:35:25.077 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx: validate_tickets want 53 have 32 need 21 2026-02-22T21:35:25.077 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx client: want=53 need=21 have=32 2026-02-22T21:35:25.077 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx client: build_request 2026-02-22T21:35:25.077 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx client: get service keys: want=53 need=21 have=32 2026-02-22T21:35:25.077 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 1 -- 10.20.193.23:0/1368318251 --> v1:10.20.193.23:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f72f00c6920 con 0x7f72f01574a0 2026-02-22T21:35:25.078 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 1 -- 10.20.193.23:0/1368318251 <== mon.0 v1:10.20.193.23:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7f72e00048f0 con 0x7f72f01574a0 2026-02-22T21:35:25.078 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T21:35:25.078 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T21:35:25.078 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 monclient(hunting): dump: 2026-02-22T21:35:25.078 INFO:tasks.workunit.client.0.trial023.stderr:epoch 1 2026-02-22T21:35:25.078 INFO:tasks.workunit.client.0.trial023.stderr:fsid e2dd7ed3-13e8-4519-aab8-5d5a54f80255 2026-02-22T21:35:25.078 INFO:tasks.workunit.client.0.trial023.stderr:last_changed 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:25.078 INFO:tasks.workunit.client.0.trial023.stderr:created 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:25.078 INFO:tasks.workunit.client.0.trial023.stderr:min_mon_release 19 (squid) 2026-02-22T21:35:25.078 INFO:tasks.workunit.client.0.trial023.stderr:election_strategy: 3 2026-02-22T21:35:25.078 INFO:tasks.workunit.client.0.trial023.stderr:0: v1:10.20.193.23:6789/0 mon.a 2026-02-22T21:35:25.078 INFO:tasks.workunit.client.0.trial023.stderr: 2026-02-22T21:35:25.078 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 monclient(hunting): _finish_auth 0 2026-02-22T21:35:25.078 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 1 -- 10.20.193.23:0/1368318251 <== mon.0 v1:10.20.193.23:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 548+0+0 (unknown 372777901 0 0) 0x7f72f00c6920 con 0x7f72f01574a0 2026-02-22T21:35:25.078 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx client: 0x7f72cc003550 handle_response ret = 0 2026-02-22T21:35:25.078 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx client: get_principal_session_key session_key AQCddptpqoJPAhAAggLElDhP3BhjMFRGzogqdw== 2026-02-22T21:35:25.079 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx: verify_service_ticket_reply got 3 keys 2026-02-22T21:35:25.079 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx: got key for service_id mon 2026-02-22T21:35:25.079 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx: verify_service_ticket_reply ticket.secret_id=2 2026-02-22T21:35:25.079 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx: verify_service_ticket_reply service mon secret_id 2 session_key AQCddptpHClSAhAA0K6pgXTvVeheyPHSBjLpSg== validity=240.000000 2026-02-22T21:35:25.079 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx: verify_service_ticket_reply ticket expires=2026-02-22T21:39:25.038991+0000 renew_after=2026-02-22T21:38:25.038991+0000 2026-02-22T21:35:25.079 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx: got key for service_id osd 2026-02-22T21:35:25.079 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx: verify_service_ticket_reply ticket.secret_id=2 2026-02-22T21:35:25.079 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx: verify_service_ticket_reply service osd secret_id 2 session_key AQCddptpBDFSAhAA/CUj6nU1jrySmNUYmTy/6g== validity=240.000000 2026-02-22T21:35:25.079 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx: verify_service_ticket_reply ticket expires=2026-02-22T21:39:25.038994+0000 renew_after=2026-02-22T21:38:25.038994+0000 2026-02-22T21:35:25.079 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx: got key for service_id mgr 2026-02-22T21:35:25.079 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx: verify_service_ticket_reply ticket.secret_id=2 2026-02-22T21:35:25.079 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx: verify_service_ticket_reply service mgr secret_id 2 session_key AQCddptpsztSAhAAFiwDqdNtWJraeWhQ9MxVnA== validity=240.000000 2026-02-22T21:35:25.079 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx: verify_service_ticket_reply ticket expires=2026-02-22T21:39:25.038996+0000 renew_after=2026-02-22T21:38:25.038996+0000 2026-02-22T21:35:25.079 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx: validate_tickets want 53 have 53 need 0 2026-02-22T21:35:25.079 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 monclient: _finish_hunting 0 2026-02-22T21:35:25.080 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 1 monclient: found mon.a 2026-02-22T21:35:25.080 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.23:6789/0 2026-02-22T21:35:25.080 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 1 -- 10.20.193.23:0/1368318251 --> v1:10.20.193.23:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72f00c9040 con 0x7f72f01574a0 2026-02-22T21:35:25.080 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 monclient: _finish_auth 0 2026-02-22T21:35:25.080 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 monclient: _check_auth_tickets 2026-02-22T21:35:25.080 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx: validate_tickets want 53 have 53 need 0 2026-02-22T21:35:25.080 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 20 cephx client: need_tickets: want=53 have=53 need=0 2026-02-22T21:35:25.080 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 monclient: _check_auth_rotating renewing rotating keys (they expired before 2026-02-22T21:34:55.039004+0000) 2026-02-22T21:35:25.080 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx client: build_rotating_request 2026-02-22T21:35:25.080 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.23:6789/0 2026-02-22T21:35:25.080 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 1 -- 10.20.193.23:0/1368318251 --> v1:10.20.193.23:6789/0 -- auth(proto 2 2 bytes epoch 0) -- 0x7f72cc003630 con 0x7f72f01574a0 2026-02-22T21:35:25.080 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 5 monclient: authenticate success, global_id 4255 2026-02-22T21:35:25.080 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 10 monclient: _renew_subs 2026-02-22T21:35:25.080 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.23:6789/0 2026-02-22T21:35:25.080 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 1 -- 10.20.193.23:0/1368318251 --> v1:10.20.193.23:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f72f009a780 con 0x7f72f01574a0 2026-02-22T21:35:25.081 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 10 monclient: _renew_subs 2026-02-22T21:35:25.081 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.23:6789/0 2026-02-22T21:35:25.081 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 1 -- 10.20.193.23:0/1368318251 --> v1:10.20.193.23:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f72f0165d00 con 0x7f72f01574a0 2026-02-22T21:35:25.081 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 1 -- 10.20.193.23:0/1368318251 <== mon.0 v1:10.20.193.23:6789/0 5 ==== config(1 keys) ==== 25+0+0 (unknown 1514702568 0 0) 0x7f72e0004e60 con 0x7f72f01574a0 2026-02-22T21:35:25.081 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 monclient: handle_config config(1 keys) 2026-02-22T21:35:25.081 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 1 -- 10.20.193.23:0/1368318251 <== mon.0 v1:10.20.193.23:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7f72e0003140 con 0x7f72f01574a0 2026-02-22T21:35:25.081 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:35:25.081 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T21:35:25.081 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 monclient: dump: 2026-02-22T21:35:25.081 INFO:tasks.workunit.client.0.trial023.stderr:epoch 1 2026-02-22T21:35:25.081 INFO:tasks.workunit.client.0.trial023.stderr:fsid e2dd7ed3-13e8-4519-aab8-5d5a54f80255 2026-02-22T21:35:25.081 INFO:tasks.workunit.client.0.trial023.stderr:last_changed 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:25.081 INFO:tasks.workunit.client.0.trial023.stderr:created 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:25.081 INFO:tasks.workunit.client.0.trial023.stderr:min_mon_release 19 (squid) 2026-02-22T21:35:25.081 INFO:tasks.workunit.client.0.trial023.stderr:election_strategy: 3 2026-02-22T21:35:25.081 INFO:tasks.workunit.client.0.trial023.stderr:0: v1:10.20.193.23:6789/0 mon.a 2026-02-22T21:35:25.082 INFO:tasks.workunit.client.0.trial023.stderr: 2026-02-22T21:35:25.082 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e6ffd640 4 set_mon_vals no callback set 2026-02-22T21:35:25.082 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 1 -- 10.20.193.23:0/1368318251 <== mon.0 v1:10.20.193.23:6789/0 7 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (unknown 762242120 0 0) 0x7f72f0165d00 con 0x7f72f01574a0 2026-02-22T21:35:25.082 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx client: 0x7f72cc003550 handle_response ret = 0 2026-02-22T21:35:25.082 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx client: get_rotating_key 2026-02-22T21:35:25.082 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 auth: dump_rotating: 2026-02-22T21:35:25.082 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 auth: id 1 AQBddptpfYjTLhAAXh1N3uFywlax+2y6vwZmsw== expires 2026-02-22T21:38:21.785614+0000 2026-02-22T21:35:25.082 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 auth: id 2 AQBddptpiI/TLhAAdz7mEzTpWi2a8fttyDShuw== expires 2026-02-22T21:42:21.785614+0000 2026-02-22T21:35:25.082 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 auth: id 3 AQBddptpNJfTLhAA8yUoZRot9tLYY9D+lZZAdA== expires 2026-02-22T21:46:21.785614+0000 2026-02-22T21:35:25.082 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 monclient: _finish_auth 0 2026-02-22T21:35:25.082 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 monclient: _check_auth_tickets 2026-02-22T21:35:25.082 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 cephx: validate_tickets want 53 have 53 need 0 2026-02-22T21:35:25.082 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 20 cephx client: need_tickets: want=53 have=53 need=0 2026-02-22T21:35:25.082 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2026-02-22T21:34:55.039127+0000) 2026-02-22T21:35:25.082 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 auth: dump_rotating: 2026-02-22T21:35:25.083 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 auth: id 1 AQBddptpfYjTLhAAXh1N3uFywlax+2y6vwZmsw== expires 2026-02-22T21:38:21.785614+0000 2026-02-22T21:35:25.083 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 auth: id 2 AQBddptpiI/TLhAAdz7mEzTpWi2a8fttyDShuw== expires 2026-02-22T21:42:21.785614+0000 2026-02-22T21:35:25.083 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 10 auth: id 3 AQBddptpNJfTLhAA8yUoZRot9tLYY9D+lZZAdA== expires 2026-02-22T21:46:21.785614+0000 2026-02-22T21:35:25.083 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T21:35:25.083 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:35:25.083 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.23:6789/0 2026-02-22T21:35:25.083 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72f716e640 1 -- 10.20.193.23:0/1368318251 --> v1:10.20.193.23:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72f0163770 con 0x7f72f01574a0 2026-02-22T21:35:25.083 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 1 -- 10.20.193.23:0/1368318251 <== mon.0 v1:10.20.193.23:6789/0 8 ==== mgrmap(e 4) ==== 47400+0+0 (unknown 1603120368 0 0) 0x7f72e0010af0 con 0x7f72f01574a0 2026-02-22T21:35:25.083 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e5ffb640 1 -- 10.20.193.23:0/1368318251 <== mon.0 v1:10.20.193.23:6789/0 9 ==== osd_map(14..14 src has 1..14) ==== 2160+0+0 (unknown 946035718 0 0) 0x7f72e0048f40 con 0x7f72f01574a0 2026-02-22T21:35:25.083 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e7fff640 10 monclient: get_auth_request con 0x7f72cc03bb00 auth_method 0 2026-02-22T21:35:25.083 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.032+0000 7f72e7fff640 10 cephx client: build_authorizer for service mgr 2026-02-22T21:35:25.083 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.036+0000 7f72e7fff640 10 In get_auth_session_handler for protocol 2 2026-02-22T21:35:25.083 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.036+0000 7f72e5ffb640 1 -- 10.20.193.23:0/1368318251 <== mon.0 v1:10.20.193.23:6789/0 10 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (unknown 1092875540 0 3570997608) 0x7f72e0016bd0 con 0x7f72f01574a0 2026-02-22T21:35:25.083 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.036+0000 7f72e5ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:35:25.083 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.036+0000 7f72e5ffb640 10 monclient: _finish_command 1 = system:0 2026-02-22T21:35:25.154 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.148+0000 7f72f716e640 10 start_mon_command cmd=[{"prefix": "config-key get", "key": "mgr/test-foo"}] 2026-02-22T21:35:25.154 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.148+0000 7f72f716e640 10 monclient: _send_command 2 [{"prefix": "config-key get", "key": "mgr/test-foo"}] 2026-02-22T21:35:25.154 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.148+0000 7f72f716e640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.23:6789/0 2026-02-22T21:35:25.154 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.148+0000 7f72f716e640 1 -- 10.20.193.23:0/1368318251 --> v1:10.20.193.23:6789/0 -- mon_command({"prefix": "config-key get", "key": "mgr/test-foo"} v 0) -- 0x7f72f00691d0 con 0x7f72f01574a0 2026-02-22T21:35:25.154 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.148+0000 7f72e5ffb640 1 -- 10.20.193.23:0/1368318251 <== mon.0 v1:10.20.193.23:6789/0 11 ==== mon_command_ack([{"prefix": "config-key get", "key": "mgr/test-foo"}]=0 v13) ==== 85+0+0 (unknown 2685503681 0 0) 0x7f72e00164d0 con 0x7f72f01574a0 2026-02-22T21:35:25.154 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.148+0000 7f72e5ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config-key get", "key": "mgr/test-foo"}] 2026-02-22T21:35:25.154 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.148+0000 7f72e5ffb640 10 monclient: _finish_command 2 = system:0 2026-02-22T21:35:25.231 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.224+0000 7f72f716e640 10 start_mon_command cmd=[{"prefix": "config-key get", "key": "mgr/test-foo"}] 2026-02-22T21:35:25.231 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.224+0000 7f72f716e640 10 monclient: _send_command 3 [{"prefix": "config-key get", "key": "mgr/test-foo"}] 2026-02-22T21:35:25.231 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.224+0000 7f72f716e640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.23:6789/0 2026-02-22T21:35:25.231 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.224+0000 7f72f716e640 1 -- 10.20.193.23:0/1368318251 --> v1:10.20.193.23:6789/0 -- mon_command({"prefix": "config-key get", "key": "mgr/test-foo"} v 0) -- 0x7f72f00c1aa0 con 0x7f72f01574a0 2026-02-22T21:35:25.231 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.224+0000 7f72e5ffb640 1 -- 10.20.193.23:0/1368318251 <== mon.0 v1:10.20.193.23:6789/0 12 ==== mon_command_ack([{"prefix": "config-key get", "key": "mgr/test-foo"}]=0 v13) ==== 85+0+0 (unknown 2685503681 0 0) 0x7f72e00473a0 con 0x7f72f01574a0 2026-02-22T21:35:25.231 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.224+0000 7f72e5ffb640 10 monclient: handle_mon_command_ack 3 [{"prefix": "config-key get", "key": "mgr/test-foo"}] 2026-02-22T21:35:25.231 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.224+0000 7f72e5ffb640 10 monclient: _finish_command 3 = system:0 2026-02-22T21:35:25.231 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.224+0000 7f72f716e640 1 -- 10.20.193.23:0/1368318251 >> v1:10.20.193.23:6800/2834055528 conn(0x7f72cc03bb00 legacy=0x7f72cc03dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:35:25.231 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.224+0000 7f72f716e640 10 monclient: shutdown 2026-02-22T21:35:25.231 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.224+0000 7f72f716e640 1 -- 10.20.193.23:0/1368318251 >> v1:10.20.193.23:6789/0 conn(0x7f72f01574a0 legacy=0x7f72f00c8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:35:25.231 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.224+0000 7f72f716e640 1 -- 10.20.193.23:0/1368318251 shutdown_connections 2026-02-22T21:35:25.232 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.224+0000 7f72f716e640 1 -- 10.20.193.23:0/1368318251 >> 10.20.193.23:0/1368318251 conn(0x7f72f006e5f0 msgr2=0x7f72f00723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:35:25.232 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.224+0000 7f72f716e640 1 -- 10.20.193.23:0/1368318251 shutdown_connections 2026-02-22T21:35:25.232 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.224+0000 7f72f716e640 1 -- 10.20.193.23:0/1368318251 wait complete. 2026-02-22T21:35:25.239 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name mgr.b config-key get device/test-foo 2026-02-22T21:35:25.318 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding auth protocol: cephx 2026-02-22T21:35:25.318 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 20 AuthRegistry(0x7f5af4067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.318 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding auth protocol: cephx 2026-02-22T21:35:25.319 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 20 AuthRegistry(0x7f5af4067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.319 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding auth protocol: cephx 2026-02-22T21:35:25.319 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 20 AuthRegistry(0x7f5af4067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.319 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding con mode: secure 2026-02-22T21:35:25.319 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding con mode: crc 2026-02-22T21:35:25.319 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 20 AuthRegistry(0x7f5af4067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.319 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding con mode: secure 2026-02-22T21:35:25.319 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding con mode: crc 2026-02-22T21:35:25.319 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 20 AuthRegistry(0x7f5af4067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.319 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding con mode: secure 2026-02-22T21:35:25.319 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding con mode: crc 2026-02-22T21:35:25.319 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 20 AuthRegistry(0x7f5af4067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.319 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding con mode: crc 2026-02-22T21:35:25.319 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding con mode: secure 2026-02-22T21:35:25.319 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 20 AuthRegistry(0x7f5af4067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.320 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding con mode: crc 2026-02-22T21:35:25.320 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding con mode: secure 2026-02-22T21:35:25.320 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 20 AuthRegistry(0x7f5af4067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.320 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding con mode: crc 2026-02-22T21:35:25.320 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding con mode: secure 2026-02-22T21:35:25.320 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 20 AuthRegistry(0x7f5af4067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.320 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 10 AuthRegistry(0x7f5af4067010) _refresh_config cluster_methods [2] service_methods [2] client_methods [2] 2026-02-22T21:35:25.320 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 10 AuthRegistry(0x7f5af4067010) _refresh_config mon_cluster_modes [2,1] mon_service_modes [2,1] mon_client_modes [2,1]; cluster_modes [1,2] service_modes [1,2] client_modes [1,2] 2026-02-22T21:35:25.320 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2026-02-22T21:35:25.320 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding auth protocol: cephx 2026-02-22T21:35:25.320 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 20 AuthRegistry(0x7f5af4067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.320 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding auth protocol: cephx 2026-02-22T21:35:25.320 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 20 AuthRegistry(0x7f5af4067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.320 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding auth protocol: cephx 2026-02-22T21:35:25.321 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 20 AuthRegistry(0x7f5af4067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.321 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding con mode: secure 2026-02-22T21:35:25.321 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding con mode: crc 2026-02-22T21:35:25.321 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 20 AuthRegistry(0x7f5af4067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.321 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding con mode: secure 2026-02-22T21:35:25.321 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding con mode: crc 2026-02-22T21:35:25.321 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 20 AuthRegistry(0x7f5af4067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.321 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding con mode: secure 2026-02-22T21:35:25.321 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding con mode: crc 2026-02-22T21:35:25.321 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 20 AuthRegistry(0x7f5af4067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.321 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding con mode: crc 2026-02-22T21:35:25.321 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding con mode: secure 2026-02-22T21:35:25.321 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 20 AuthRegistry(0x7f5af4067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.321 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding con mode: crc 2026-02-22T21:35:25.321 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding con mode: secure 2026-02-22T21:35:25.322 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 20 AuthRegistry(0x7f5af4067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.322 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding con mode: crc 2026-02-22T21:35:25.322 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding con mode: secure 2026-02-22T21:35:25.322 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 20 AuthRegistry(0x7f5af4067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.322 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 10 AuthRegistry(0x7f5af4067010) _refresh_config cluster_methods [2] service_methods [2] client_methods [2] 2026-02-22T21:35:25.322 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 10 AuthRegistry(0x7f5af4067010) _refresh_config mon_cluster_modes [2,1] mon_service_modes [2,1] mon_client_modes [2,1]; cluster_modes [1,2] service_modes [1,2] client_modes [1,2] 2026-02-22T21:35:25.322 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:25.322 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 10 monclient: get_monmap_and_config 2026-02-22T21:35:25.322 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 10 monclient: build_initial_monmap 2026-02-22T21:35:25.322 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 10 monclient: monmap: 2026-02-22T21:35:25.322 INFO:tasks.workunit.client.0.trial023.stderr:epoch 0 2026-02-22T21:35:25.322 INFO:tasks.workunit.client.0.trial023.stderr:fsid e2dd7ed3-13e8-4519-aab8-5d5a54f80255 2026-02-22T21:35:25.322 INFO:tasks.workunit.client.0.trial023.stderr:last_changed 2026-02-22T21:35:25.308005+0000 2026-02-22T21:35:25.322 INFO:tasks.workunit.client.0.trial023.stderr:created 2026-02-22T21:35:25.308005+0000 2026-02-22T21:35:25.322 INFO:tasks.workunit.client.0.trial023.stderr:min_mon_release 0 (unknown) 2026-02-22T21:35:25.322 INFO:tasks.workunit.client.0.trial023.stderr:election_strategy: 3 2026-02-22T21:35:25.323 INFO:tasks.workunit.client.0.trial023.stderr:0: v1:10.20.193.23:6789/0 mon.noname-a 2026-02-22T21:35:25.323 INFO:tasks.workunit.client.0.trial023.stderr: 2026-02-22T21:35:25.323 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4068a80) adding auth protocol: cephx 2026-02-22T21:35:25.323 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 20 AuthRegistry(0x7f5af4068a80) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.323 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4068a80) adding auth protocol: cephx 2026-02-22T21:35:25.323 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 20 AuthRegistry(0x7f5af4068a80) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.323 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4068a80) adding auth protocol: cephx 2026-02-22T21:35:25.323 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 20 AuthRegistry(0x7f5af4068a80) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.323 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4068a80) adding con mode: secure 2026-02-22T21:35:25.323 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4068a80) adding con mode: crc 2026-02-22T21:35:25.323 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 20 AuthRegistry(0x7f5af4068a80) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.323 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4068a80) adding con mode: secure 2026-02-22T21:35:25.323 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4068a80) adding con mode: crc 2026-02-22T21:35:25.323 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 20 AuthRegistry(0x7f5af4068a80) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.323 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4068a80) adding con mode: secure 2026-02-22T21:35:25.324 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4068a80) adding con mode: crc 2026-02-22T21:35:25.324 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 20 AuthRegistry(0x7f5af4068a80) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.324 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4068a80) adding con mode: crc 2026-02-22T21:35:25.324 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4068a80) adding con mode: secure 2026-02-22T21:35:25.324 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 20 AuthRegistry(0x7f5af4068a80) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.324 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4068a80) adding con mode: crc 2026-02-22T21:35:25.324 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4068a80) adding con mode: secure 2026-02-22T21:35:25.324 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 20 AuthRegistry(0x7f5af4068a80) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.324 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4068a80) adding con mode: crc 2026-02-22T21:35:25.324 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4068a80) adding con mode: secure 2026-02-22T21:35:25.324 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 20 AuthRegistry(0x7f5af4068a80) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.324 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 10 AuthRegistry(0x7f5af4068a80) _refresh_config cluster_methods [2] service_methods [2] client_methods [2] 2026-02-22T21:35:25.324 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.300+0000 7f5af8c58640 10 AuthRegistry(0x7f5af4068a80) _refresh_config mon_cluster_modes [2,1] mon_service_modes [2,1] mon_client_modes [2,1]; cluster_modes [1,2] service_modes [1,2] client_modes [1,2] 2026-02-22T21:35:25.324 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:25.324 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 1 Processor -- start 2026-02-22T21:35:25.325 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 1 -- start start 2026-02-22T21:35:25.325 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 10 monclient: init 2026-02-22T21:35:25.325 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af8c56f50) adding auth protocol: cephx 2026-02-22T21:35:25.325 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 20 AuthRegistry(0x7f5af8c56f50) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.325 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af8c56f50) adding auth protocol: cephx 2026-02-22T21:35:25.325 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 20 AuthRegistry(0x7f5af8c56f50) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.325 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af8c56f50) adding auth protocol: cephx 2026-02-22T21:35:25.325 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 20 AuthRegistry(0x7f5af8c56f50) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.325 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af8c56f50) adding con mode: secure 2026-02-22T21:35:25.325 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af8c56f50) adding con mode: crc 2026-02-22T21:35:25.325 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 20 AuthRegistry(0x7f5af8c56f50) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.325 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af8c56f50) adding con mode: secure 2026-02-22T21:35:25.325 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af8c56f50) adding con mode: crc 2026-02-22T21:35:25.325 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 20 AuthRegistry(0x7f5af8c56f50) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.325 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af8c56f50) adding con mode: secure 2026-02-22T21:35:25.325 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af8c56f50) adding con mode: crc 2026-02-22T21:35:25.325 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 20 AuthRegistry(0x7f5af8c56f50) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.326 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af8c56f50) adding con mode: crc 2026-02-22T21:35:25.326 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af8c56f50) adding con mode: secure 2026-02-22T21:35:25.326 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 20 AuthRegistry(0x7f5af8c56f50) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.326 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af8c56f50) adding con mode: crc 2026-02-22T21:35:25.326 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af8c56f50) adding con mode: secure 2026-02-22T21:35:25.326 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 20 AuthRegistry(0x7f5af8c56f50) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.326 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af8c56f50) adding con mode: crc 2026-02-22T21:35:25.326 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af8c56f50) adding con mode: secure 2026-02-22T21:35:25.326 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 20 AuthRegistry(0x7f5af8c56f50) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.326 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 10 AuthRegistry(0x7f5af8c56f50) _refresh_config cluster_methods [2] service_methods [2] client_methods [2] 2026-02-22T21:35:25.326 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 10 AuthRegistry(0x7f5af8c56f50) _refresh_config mon_cluster_modes [2,1] mon_service_modes [2,1] mon_client_modes [2,1]; cluster_modes [1,2] service_modes [1,2] client_modes [1,2] 2026-02-22T21:35:25.326 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:25.326 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:25.326 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 10 monclient: _reopen_session rank -1 2026-02-22T21:35:25.326 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 10 monclient: _add_conns ranks=[0] 2026-02-22T21:35:25.326 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 10 monclient(hunting): picked mon.noname-a con 0x7f5af414d580 addr v1:10.20.193.23:6789/0 2026-02-22T21:35:25.326 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 1 -- --> v1:10.20.193.23:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x7f5af41656c0 con 0x7f5af414d580 2026-02-22T21:35:25.327 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 10 monclient(hunting): _renew_subs 2026-02-22T21:35:25.327 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 10 monclient(hunting): authenticate will time out at 597.525464s 2026-02-22T21:35:25.327 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af2575640 1 --1- >> v1:10.20.193.23:6789/0 conn(0x7f5af414d580 0x7f5af4164bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.23:6789/0 says I am v1:10.20.193.23:43398/0 (socket says 10.20.193.23:43398) 2026-02-22T21:35:25.327 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af2575640 1 -- 10.20.193.23:0/4278311981 learned_addr learned my addr 10.20.193.23:0/4278311981 (peer_addr_for_me v1:10.20.193.23:0/0) 2026-02-22T21:35:25.327 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 1 -- 10.20.193.23:0/4278311981 <== mon.0 v1:10.20.193.23:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3014091239 0 0) 0x7f5af41656c0 con 0x7f5af414d580 2026-02-22T21:35:25.327 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 10 monclient(hunting): _negotiate 2026-02-22T21:35:25.327 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:35:25.327 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:35:25.327 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 10 cephx client: reset 2026-02-22T21:35:25.327 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 10 cephx: set_have_need_key no handler for service auth 2026-02-22T21:35:25.327 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 10 cephx: validate_tickets want 32 have 0 need 32 2026-02-22T21:35:25.327 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 10 cephx client: reset 2026-02-22T21:35:25.327 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 10 monclient(hunting): my global_id is 4256 2026-02-22T21:35:25.327 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 10 cephx client: 0x7f5ae0003550 handle_response ret = 0 2026-02-22T21:35:25.327 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 10 cephx client: got initial server challenge de70fefc1f279a4 2026-02-22T21:35:25.327 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 10 cephx client: validate_tickets: want=32 need=32 have=0 2026-02-22T21:35:25.328 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 10 cephx: set_have_need_key no handler for service auth 2026-02-22T21:35:25.328 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 10 cephx: validate_tickets want 32 have 0 need 32 2026-02-22T21:35:25.328 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 10 cephx client: want=32 need=32 have=0 2026-02-22T21:35:25.328 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 10 cephx client: build_request 2026-02-22T21:35:25.328 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 10 cephx client: get auth session key: client_challenge 23fbf112d330cf0d 2026-02-22T21:35:25.328 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 1 -- 10.20.193.23:0/4278311981 --> v1:10.20.193.23:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ae0003630 con 0x7f5af414d580 2026-02-22T21:35:25.328 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 1 -- 10.20.193.23:0/4278311981 <== mon.0 v1:10.20.193.23:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1094050710 0 0) 0x7f5ae0003630 con 0x7f5af414d580 2026-02-22T21:35:25.328 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 10 cephx client: 0x7f5ae0003550 handle_response ret = 0 2026-02-22T21:35:25.328 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 10 cephx client: get_auth_session_key 2026-02-22T21:35:25.328 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 10 cephx: verify_service_ticket_reply got 1 keys 2026-02-22T21:35:25.328 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 10 cephx: got key for service_id auth 2026-02-22T21:35:25.328 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 10 cephx: verify_service_ticket_reply ticket.secret_id=2 2026-02-22T21:35:25.328 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 10 cephx: verify_service_ticket_reply service auth secret_id 2 session_key AQCddptpAz15EhAAxmg/ruJPpIXVgRvDcnpLqA== validity=660.000000 2026-02-22T21:35:25.328 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 10 cephx: verify_service_ticket_reply ticket expires=2026-02-22T21:46:25.310012+0000 renew_after=2026-02-22T21:43:40.310012+0000 2026-02-22T21:35:25.328 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 10 cephx client: want=32 need=32 have=0 2026-02-22T21:35:25.328 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 10 cephx client: got connection bl 0 and extra tickets 0 2026-02-22T21:35:25.328 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 10 cephx: validate_tickets want 32 have 32 need 0 2026-02-22T21:35:25.328 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 10 monclient: _finish_hunting 0 2026-02-22T21:35:25.329 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 1 monclient: found mon.noname-a 2026-02-22T21:35:25.329 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.23:6789/0 2026-02-22T21:35:25.329 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 1 -- 10.20.193.23:0/4278311981 --> v1:10.20.193.23:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5af41652d0 con 0x7f5af414d580 2026-02-22T21:35:25.329 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 10 monclient: _finish_auth 0 2026-02-22T21:35:25.329 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 10 monclient: _check_auth_tickets 2026-02-22T21:35:25.329 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 10 cephx: validate_tickets want 32 have 32 need 0 2026-02-22T21:35:25.329 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 20 cephx client: need_tickets: want=32 have=32 need=0 2026-02-22T21:35:25.329 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 10 monclient: _check_auth_rotating renewing rotating keys (they expired before 2026-02-22T21:34:55.310025+0000) 2026-02-22T21:35:25.329 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 10 cephx client: build_rotating_request 2026-02-22T21:35:25.329 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.23:6789/0 2026-02-22T21:35:25.329 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 1 -- 10.20.193.23:0/4278311981 --> v1:10.20.193.23:6789/0 -- auth(proto 2 2 bytes epoch 0) -- 0x7f5af41656c0 con 0x7f5af414d580 2026-02-22T21:35:25.329 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 1 -- 10.20.193.23:0/4278311981 <== mon.0 v1:10.20.193.23:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7f5ae8002e20 con 0x7f5af414d580 2026-02-22T21:35:25.329 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:35:25.329 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T21:35:25.329 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 10 monclient: dump: 2026-02-22T21:35:25.329 INFO:tasks.workunit.client.0.trial023.stderr:epoch 1 2026-02-22T21:35:25.329 INFO:tasks.workunit.client.0.trial023.stderr:fsid e2dd7ed3-13e8-4519-aab8-5d5a54f80255 2026-02-22T21:35:25.329 INFO:tasks.workunit.client.0.trial023.stderr:last_changed 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:25.329 INFO:tasks.workunit.client.0.trial023.stderr:created 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:25.330 INFO:tasks.workunit.client.0.trial023.stderr:min_mon_release 19 (squid) 2026-02-22T21:35:25.330 INFO:tasks.workunit.client.0.trial023.stderr:election_strategy: 3 2026-02-22T21:35:25.330 INFO:tasks.workunit.client.0.trial023.stderr:0: v1:10.20.193.23:6789/0 mon.a 2026-02-22T21:35:25.330 INFO:tasks.workunit.client.0.trial023.stderr: 2026-02-22T21:35:25.330 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 monclient: authenticate success, global_id 4256 2026-02-22T21:35:25.330 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 1 -- 10.20.193.23:0/4278311981 <== mon.0 v1:10.20.193.23:6789/0 4 ==== config(1 keys) ==== 25+0+0 (unknown 1514702568 0 0) 0x7f5ae80030a0 con 0x7f5af414d580 2026-02-22T21:35:25.330 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 10 monclient: handle_config config(1 keys) 2026-02-22T21:35:25.330 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 1 -- 10.20.193.23:0/4278311981 <== mon.0 v1:10.20.193.23:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7f5ae8003510 con 0x7f5af414d580 2026-02-22T21:35:25.330 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:35:25.330 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T21:35:25.330 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 10 monclient: dump: 2026-02-22T21:35:25.330 INFO:tasks.workunit.client.0.trial023.stderr:epoch 1 2026-02-22T21:35:25.330 INFO:tasks.workunit.client.0.trial023.stderr:fsid e2dd7ed3-13e8-4519-aab8-5d5a54f80255 2026-02-22T21:35:25.330 INFO:tasks.workunit.client.0.trial023.stderr:last_changed 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:25.330 INFO:tasks.workunit.client.0.trial023.stderr:created 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:25.330 INFO:tasks.workunit.client.0.trial023.stderr:min_mon_release 19 (squid) 2026-02-22T21:35:25.330 INFO:tasks.workunit.client.0.trial023.stderr:election_strategy: 3 2026-02-22T21:35:25.331 INFO:tasks.workunit.client.0.trial023.stderr:0: v1:10.20.193.23:6789/0 mon.a 2026-02-22T21:35:25.331 INFO:tasks.workunit.client.0.trial023.stderr: 2026-02-22T21:35:25.331 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 1 -- 10.20.193.23:0/4278311981 <== mon.0 v1:10.20.193.23:6789/0 6 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (unknown 3341449124 0 0) 0x7f5af41656c0 con 0x7f5af414d580 2026-02-22T21:35:25.331 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 10 cephx client: 0x7f5ae0003550 handle_response ret = 0 2026-02-22T21:35:25.331 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 10 cephx client: get_rotating_key 2026-02-22T21:35:25.331 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 10 auth: dump_rotating: 2026-02-22T21:35:25.331 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 10 auth: id 1 AQBddptpfYjTLhAAXh1N3uFywlax+2y6vwZmsw== expires 2026-02-22T21:38:21.785614+0000 2026-02-22T21:35:25.331 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 10 auth: id 2 AQBddptpiI/TLhAAdz7mEzTpWi2a8fttyDShuw== expires 2026-02-22T21:42:21.785614+0000 2026-02-22T21:35:25.331 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 10 auth: id 3 AQBddptpNJfTLhAA8yUoZRot9tLYY9D+lZZAdA== expires 2026-02-22T21:46:21.785614+0000 2026-02-22T21:35:25.331 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 10 monclient: _finish_auth 0 2026-02-22T21:35:25.331 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 10 monclient: _check_auth_tickets 2026-02-22T21:35:25.331 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 10 cephx: validate_tickets want 32 have 32 need 0 2026-02-22T21:35:25.331 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 20 cephx client: need_tickets: want=32 have=32 need=0 2026-02-22T21:35:25.331 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2026-02-22T21:34:55.310125+0000) 2026-02-22T21:35:25.331 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 10 auth: dump_rotating: 2026-02-22T21:35:25.331 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 10 auth: id 1 AQBddptpfYjTLhAAXh1N3uFywlax+2y6vwZmsw== expires 2026-02-22T21:38:21.785614+0000 2026-02-22T21:35:25.331 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 10 auth: id 2 AQBddptpiI/TLhAAdz7mEzTpWi2a8fttyDShuw== expires 2026-02-22T21:42:21.785614+0000 2026-02-22T21:35:25.331 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af1573640 10 auth: id 3 AQBddptpNJfTLhAA8yUoZRot9tLYY9D+lZZAdA== expires 2026-02-22T21:46:21.785614+0000 2026-02-22T21:35:25.331 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 10 monclient: get_monmap_and_config success 2026-02-22T21:35:25.331 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 4 set_mon_vals no callback set 2026-02-22T21:35:25.332 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 10 set_mon_vals mgr_pool = false 2026-02-22T21:35:25.332 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 10 monclient: shutdown 2026-02-22T21:35:25.332 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 1 -- 10.20.193.23:0/4278311981 >> v1:10.20.193.23:6789/0 conn(0x7f5af414d580 legacy=0x7f5af4164bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:35:25.332 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 1 -- 10.20.193.23:0/4278311981 shutdown_connections 2026-02-22T21:35:25.332 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 1 -- 10.20.193.23:0/4278311981 >> 10.20.193.23:0/4278311981 conn(0x7f5af406c860 msgr2=0x7f5af40bf590 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:35:25.332 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 1 -- 10.20.193.23:0/4278311981 shutdown_connections 2026-02-22T21:35:25.332 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 1 -- 10.20.193.23:0/4278311981 wait complete. 2026-02-22T21:35:25.332 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding auth protocol: cephx 2026-02-22T21:35:25.332 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 20 AuthRegistry(0x7f5af4067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.332 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding auth protocol: cephx 2026-02-22T21:35:25.332 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 20 AuthRegistry(0x7f5af4067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.332 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding auth protocol: cephx 2026-02-22T21:35:25.332 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 20 AuthRegistry(0x7f5af4067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.332 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding con mode: secure 2026-02-22T21:35:25.332 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding con mode: crc 2026-02-22T21:35:25.332 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 20 AuthRegistry(0x7f5af4067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.332 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding con mode: secure 2026-02-22T21:35:25.332 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding con mode: crc 2026-02-22T21:35:25.332 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 20 AuthRegistry(0x7f5af4067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.332 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding con mode: secure 2026-02-22T21:35:25.332 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding con mode: crc 2026-02-22T21:35:25.333 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 20 AuthRegistry(0x7f5af4067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.333 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding con mode: crc 2026-02-22T21:35:25.333 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding con mode: secure 2026-02-22T21:35:25.333 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 20 AuthRegistry(0x7f5af4067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.333 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding con mode: crc 2026-02-22T21:35:25.333 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding con mode: secure 2026-02-22T21:35:25.333 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 20 AuthRegistry(0x7f5af4067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.333 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding con mode: crc 2026-02-22T21:35:25.333 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding con mode: secure 2026-02-22T21:35:25.333 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 20 AuthRegistry(0x7f5af4067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.333 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 10 AuthRegistry(0x7f5af4067010) _refresh_config cluster_methods [2] service_methods [2] client_methods [2] 2026-02-22T21:35:25.333 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 10 AuthRegistry(0x7f5af4067010) _refresh_config mon_cluster_modes [2,1] mon_service_modes [2,1] mon_client_modes [2,1]; cluster_modes [1,2] service_modes [1,2] client_modes [1,2] 2026-02-22T21:35:25.333 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:25.333 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 10 monclient: build_initial_monmap 2026-02-22T21:35:25.333 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 10 monclient: monmap: 2026-02-22T21:35:25.333 INFO:tasks.workunit.client.0.trial023.stderr:epoch 0 2026-02-22T21:35:25.333 INFO:tasks.workunit.client.0.trial023.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T21:35:25.333 INFO:tasks.workunit.client.0.trial023.stderr:last_changed 0.000000 2026-02-22T21:35:25.333 INFO:tasks.workunit.client.0.trial023.stderr:created 0.000000 2026-02-22T21:35:25.334 INFO:tasks.workunit.client.0.trial023.stderr:min_mon_release 0 (unknown) 2026-02-22T21:35:25.334 INFO:tasks.workunit.client.0.trial023.stderr:election_strategy: 1 2026-02-22T21:35:25.334 INFO:tasks.workunit.client.0.trial023.stderr:0: v1:10.20.193.23:6789/0 mon.noname-a 2026-02-22T21:35:25.334 INFO:tasks.workunit.client.0.trial023.stderr: 2026-02-22T21:35:25.334 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af406e100) adding auth protocol: cephx 2026-02-22T21:35:25.334 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 20 AuthRegistry(0x7f5af406e100) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.334 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af406e100) adding auth protocol: cephx 2026-02-22T21:35:25.334 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 20 AuthRegistry(0x7f5af406e100) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.334 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af406e100) adding auth protocol: cephx 2026-02-22T21:35:25.334 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 20 AuthRegistry(0x7f5af406e100) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.334 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af406e100) adding con mode: secure 2026-02-22T21:35:25.334 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af406e100) adding con mode: crc 2026-02-22T21:35:25.334 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 20 AuthRegistry(0x7f5af406e100) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.334 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af406e100) adding con mode: secure 2026-02-22T21:35:25.334 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af406e100) adding con mode: crc 2026-02-22T21:35:25.334 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 20 AuthRegistry(0x7f5af406e100) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.334 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af406e100) adding con mode: secure 2026-02-22T21:35:25.334 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af406e100) adding con mode: crc 2026-02-22T21:35:25.334 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 20 AuthRegistry(0x7f5af406e100) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.334 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af406e100) adding con mode: crc 2026-02-22T21:35:25.334 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af406e100) adding con mode: secure 2026-02-22T21:35:25.334 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 20 AuthRegistry(0x7f5af406e100) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.335 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af406e100) adding con mode: crc 2026-02-22T21:35:25.335 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af406e100) adding con mode: secure 2026-02-22T21:35:25.335 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 20 AuthRegistry(0x7f5af406e100) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.335 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af406e100) adding con mode: crc 2026-02-22T21:35:25.335 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af406e100) adding con mode: secure 2026-02-22T21:35:25.335 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 20 AuthRegistry(0x7f5af406e100) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.335 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 10 AuthRegistry(0x7f5af406e100) _refresh_config cluster_methods [2] service_methods [2] client_methods [2] 2026-02-22T21:35:25.335 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 10 AuthRegistry(0x7f5af406e100) _refresh_config mon_cluster_modes [2,1] mon_service_modes [2,1] mon_client_modes [2,1]; cluster_modes [1,2] service_modes [1,2] client_modes [1,2] 2026-02-22T21:35:25.335 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:25.335 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 1 Processor -- start 2026-02-22T21:35:25.335 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 1 -- start start 2026-02-22T21:35:25.335 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 10 monclient: init 2026-02-22T21:35:25.335 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding auth protocol: cephx 2026-02-22T21:35:25.335 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 20 AuthRegistry(0x7f5af4067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.335 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding auth protocol: cephx 2026-02-22T21:35:25.335 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 20 AuthRegistry(0x7f5af4067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.335 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding auth protocol: cephx 2026-02-22T21:35:25.335 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 20 AuthRegistry(0x7f5af4067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.335 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding con mode: secure 2026-02-22T21:35:25.335 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding con mode: crc 2026-02-22T21:35:25.335 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 20 AuthRegistry(0x7f5af4067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.335 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding con mode: secure 2026-02-22T21:35:25.336 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding con mode: crc 2026-02-22T21:35:25.336 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 20 AuthRegistry(0x7f5af4067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.336 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding con mode: secure 2026-02-22T21:35:25.336 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding con mode: crc 2026-02-22T21:35:25.336 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 20 AuthRegistry(0x7f5af4067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.336 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding con mode: crc 2026-02-22T21:35:25.336 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding con mode: secure 2026-02-22T21:35:25.336 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 20 AuthRegistry(0x7f5af4067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.336 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding con mode: crc 2026-02-22T21:35:25.336 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding con mode: secure 2026-02-22T21:35:25.336 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 20 AuthRegistry(0x7f5af4067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.336 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding con mode: crc 2026-02-22T21:35:25.336 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 5 AuthRegistry(0x7f5af4067010) adding con mode: secure 2026-02-22T21:35:25.336 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 20 AuthRegistry(0x7f5af4067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.336 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 10 AuthRegistry(0x7f5af4067010) _refresh_config cluster_methods [2] service_methods [2] client_methods [2] 2026-02-22T21:35:25.336 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 10 AuthRegistry(0x7f5af4067010) _refresh_config mon_cluster_modes [2,1] mon_service_modes [2,1] mon_client_modes [2,1]; cluster_modes [1,2] service_modes [1,2] client_modes [1,2] 2026-02-22T21:35:25.336 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.304+0000 7f5af8c58640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:25.336 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5af8c58640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:25.336 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5af8c58640 10 monclient: _reopen_session rank -1 2026-02-22T21:35:25.336 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5af8c58640 10 monclient: _add_conns ranks=[0] 2026-02-22T21:35:25.336 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5af8c58640 10 monclient(hunting): picked mon.noname-a con 0x7f5af414d580 addr v1:10.20.193.23:6789/0 2026-02-22T21:35:25.336 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5af8c58640 1 -- --> v1:10.20.193.23:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x7f5af415c120 con 0x7f5af414d580 2026-02-22T21:35:25.336 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5af8c58640 10 monclient(hunting): _renew_subs 2026-02-22T21:35:25.336 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5af8c58640 10 monclient(hunting): authenticate will time out at 597.528282s 2026-02-22T21:35:25.337 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5af2575640 1 --1- >> v1:10.20.193.23:6789/0 conn(0x7f5af414d580 0x7f5af415b8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.23:6789/0 says I am v1:10.20.193.23:43402/0 (socket says 10.20.193.23:43402) 2026-02-22T21:35:25.337 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5af2575640 1 -- 10.20.193.23:0/376635037 learned_addr learned my addr 10.20.193.23:0/376635037 (peer_addr_for_me v1:10.20.193.23:0/0) 2026-02-22T21:35:25.337 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 1 -- 10.20.193.23:0/376635037 <== mon.0 v1:10.20.193.23:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4133412421 0 0) 0x7f5af415c120 con 0x7f5af414d580 2026-02-22T21:35:25.337 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 monclient(hunting): _negotiate 2026-02-22T21:35:25.337 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:35:25.337 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:35:25.337 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx client: reset 2026-02-22T21:35:25.337 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx: set_have_need_key no handler for service mon 2026-02-22T21:35:25.337 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx: set_have_need_key no handler for service osd 2026-02-22T21:35:25.337 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx: set_have_need_key no handler for service mgr 2026-02-22T21:35:25.337 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx: set_have_need_key no handler for service auth 2026-02-22T21:35:25.337 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx: validate_tickets want 53 have 0 need 53 2026-02-22T21:35:25.337 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx client: reset 2026-02-22T21:35:25.337 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 monclient(hunting): my global_id is 4257 2026-02-22T21:35:25.337 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx client: 0x7f5acc003550 handle_response ret = 0 2026-02-22T21:35:25.337 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx client: got initial server challenge 36a3018134e46f47 2026-02-22T21:35:25.337 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx client: validate_tickets: want=53 need=53 have=0 2026-02-22T21:35:25.337 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx: set_have_need_key no handler for service mon 2026-02-22T21:35:25.337 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx: set_have_need_key no handler for service osd 2026-02-22T21:35:25.337 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx: set_have_need_key no handler for service mgr 2026-02-22T21:35:25.337 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx: set_have_need_key no handler for service auth 2026-02-22T21:35:25.337 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx: validate_tickets want 53 have 0 need 53 2026-02-22T21:35:25.338 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx client: want=53 need=53 have=0 2026-02-22T21:35:25.338 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx client: build_request 2026-02-22T21:35:25.338 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx client: get auth session key: client_challenge 141bc9d0084e1c66 2026-02-22T21:35:25.338 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 1 -- 10.20.193.23:0/376635037 --> v1:10.20.193.23:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5acc003630 con 0x7f5af414d580 2026-02-22T21:35:25.338 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 1 -- 10.20.193.23:0/376635037 <== mon.0 v1:10.20.193.23:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 732+0+0 (unknown 3994526857 0 0) 0x7f5acc003630 con 0x7f5af414d580 2026-02-22T21:35:25.338 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx client: 0x7f5acc003550 handle_response ret = 0 2026-02-22T21:35:25.338 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx client: get_auth_session_key 2026-02-22T21:35:25.338 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx: verify_service_ticket_reply got 1 keys 2026-02-22T21:35:25.338 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx: got key for service_id auth 2026-02-22T21:35:25.338 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx: verify_service_ticket_reply ticket.secret_id=2 2026-02-22T21:35:25.338 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx: verify_service_ticket_reply service auth secret_id 2 session_key AQCddptpvHGiEhAA3+T9zFYE8+UvOPRb2nSvqg== validity=660.000000 2026-02-22T21:35:25.338 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx: verify_service_ticket_reply ticket expires=2026-02-22T21:46:25.312718+0000 renew_after=2026-02-22T21:43:40.312718+0000 2026-02-22T21:35:25.338 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx client: want=53 need=53 have=0 2026-02-22T21:35:25.338 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx client: got connection bl 0 and extra tickets 518 2026-02-22T21:35:25.338 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx: set_have_need_key no handler for service mon 2026-02-22T21:35:25.338 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx: set_have_need_key no handler for service osd 2026-02-22T21:35:25.338 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx: set_have_need_key no handler for service mgr 2026-02-22T21:35:25.338 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx: validate_tickets want 53 have 32 need 21 2026-02-22T21:35:25.338 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx client: validate_tickets: want=53 need=21 have=32 2026-02-22T21:35:25.338 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx: set_have_need_key no handler for service mon 2026-02-22T21:35:25.338 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx: set_have_need_key no handler for service osd 2026-02-22T21:35:25.338 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx: set_have_need_key no handler for service mgr 2026-02-22T21:35:25.338 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx: validate_tickets want 53 have 32 need 21 2026-02-22T21:35:25.338 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx client: want=53 need=21 have=32 2026-02-22T21:35:25.339 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx client: build_request 2026-02-22T21:35:25.339 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx client: get service keys: want=53 need=21 have=32 2026-02-22T21:35:25.339 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 1 -- 10.20.193.23:0/376635037 --> v1:10.20.193.23:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5af415c120 con 0x7f5af414d580 2026-02-22T21:35:25.339 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 1 -- 10.20.193.23:0/376635037 <== mon.0 v1:10.20.193.23:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7f5ae8002bd0 con 0x7f5af414d580 2026-02-22T21:35:25.339 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T21:35:25.339 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T21:35:25.339 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 monclient(hunting): dump: 2026-02-22T21:35:25.339 INFO:tasks.workunit.client.0.trial023.stderr:epoch 1 2026-02-22T21:35:25.339 INFO:tasks.workunit.client.0.trial023.stderr:fsid e2dd7ed3-13e8-4519-aab8-5d5a54f80255 2026-02-22T21:35:25.339 INFO:tasks.workunit.client.0.trial023.stderr:last_changed 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:25.339 INFO:tasks.workunit.client.0.trial023.stderr:created 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:25.339 INFO:tasks.workunit.client.0.trial023.stderr:min_mon_release 19 (squid) 2026-02-22T21:35:25.339 INFO:tasks.workunit.client.0.trial023.stderr:election_strategy: 3 2026-02-22T21:35:25.339 INFO:tasks.workunit.client.0.trial023.stderr:0: v1:10.20.193.23:6789/0 mon.a 2026-02-22T21:35:25.339 INFO:tasks.workunit.client.0.trial023.stderr: 2026-02-22T21:35:25.339 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 monclient(hunting): _finish_auth 0 2026-02-22T21:35:25.339 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 1 -- 10.20.193.23:0/376635037 <== mon.0 v1:10.20.193.23:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 548+0+0 (unknown 787991080 0 0) 0x7f5af415c120 con 0x7f5af414d580 2026-02-22T21:35:25.339 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx client: 0x7f5acc003550 handle_response ret = 0 2026-02-22T21:35:25.339 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx client: get_principal_session_key session_key AQCddptpvHGiEhAA3+T9zFYE8+UvOPRb2nSvqg== 2026-02-22T21:35:25.339 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx: verify_service_ticket_reply got 3 keys 2026-02-22T21:35:25.339 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx: got key for service_id mon 2026-02-22T21:35:25.339 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx: verify_service_ticket_reply ticket.secret_id=2 2026-02-22T21:35:25.339 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx: verify_service_ticket_reply service mon secret_id 2 session_key AQCddptpQ7akEhAAZg5UYBEvrvX/4XlNxuTVIg== validity=240.000000 2026-02-22T21:35:25.340 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx: verify_service_ticket_reply ticket expires=2026-02-22T21:39:25.312847+0000 renew_after=2026-02-22T21:38:25.312847+0000 2026-02-22T21:35:25.340 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx: got key for service_id osd 2026-02-22T21:35:25.340 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx: verify_service_ticket_reply ticket.secret_id=2 2026-02-22T21:35:25.340 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx: verify_service_ticket_reply service osd secret_id 2 session_key AQCddptp17qkEhAAM2q9EOTnQBbUJErKh2uegg== validity=240.000000 2026-02-22T21:35:25.340 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx: verify_service_ticket_reply ticket expires=2026-02-22T21:39:25.312854+0000 renew_after=2026-02-22T21:38:25.312854+0000 2026-02-22T21:35:25.340 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx: got key for service_id mgr 2026-02-22T21:35:25.340 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx: verify_service_ticket_reply ticket.secret_id=2 2026-02-22T21:35:25.340 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx: verify_service_ticket_reply service mgr secret_id 2 session_key AQCddptp3sCkEhAAqazdSZHC9Dc2A0m5Hp318A== validity=240.000000 2026-02-22T21:35:25.340 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx: verify_service_ticket_reply ticket expires=2026-02-22T21:39:25.312860+0000 renew_after=2026-02-22T21:38:25.312860+0000 2026-02-22T21:35:25.340 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx: validate_tickets want 53 have 53 need 0 2026-02-22T21:35:25.340 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 monclient: _finish_hunting 0 2026-02-22T21:35:25.340 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 1 monclient: found mon.a 2026-02-22T21:35:25.340 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.23:6789/0 2026-02-22T21:35:25.340 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 1 -- 10.20.193.23:0/376635037 --> v1:10.20.193.23:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5af41494b0 con 0x7f5af414d580 2026-02-22T21:35:25.340 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 monclient: _finish_auth 0 2026-02-22T21:35:25.340 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 monclient: _check_auth_tickets 2026-02-22T21:35:25.340 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx: validate_tickets want 53 have 53 need 0 2026-02-22T21:35:25.340 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 20 cephx client: need_tickets: want=53 have=53 need=0 2026-02-22T21:35:25.340 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 monclient: _check_auth_rotating renewing rotating keys (they expired before 2026-02-22T21:34:55.312875+0000) 2026-02-22T21:35:25.340 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx client: build_rotating_request 2026-02-22T21:35:25.340 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.23:6789/0 2026-02-22T21:35:25.340 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 1 -- 10.20.193.23:0/376635037 --> v1:10.20.193.23:6789/0 -- auth(proto 2 2 bytes epoch 0) -- 0x7f5acc003630 con 0x7f5af414d580 2026-02-22T21:35:25.341 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5af8c58640 5 monclient: authenticate success, global_id 4257 2026-02-22T21:35:25.341 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5af8c58640 10 monclient: _renew_subs 2026-02-22T21:35:25.341 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5af8c58640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.23:6789/0 2026-02-22T21:35:25.341 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5af8c58640 1 -- 10.20.193.23:0/376635037 --> v1:10.20.193.23:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5af4093bb0 con 0x7f5af414d580 2026-02-22T21:35:25.341 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5af8c58640 10 monclient: _renew_subs 2026-02-22T21:35:25.341 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5af8c58640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.23:6789/0 2026-02-22T21:35:25.341 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5af8c58640 1 -- 10.20.193.23:0/376635037 --> v1:10.20.193.23:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f5af4147ed0 con 0x7f5af414d580 2026-02-22T21:35:25.341 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 1 -- 10.20.193.23:0/376635037 <== mon.0 v1:10.20.193.23:6789/0 5 ==== config(1 keys) ==== 25+0+0 (unknown 1514702568 0 0) 0x7f5ae80030a0 con 0x7f5af414d580 2026-02-22T21:35:25.341 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 monclient: handle_config config(1 keys) 2026-02-22T21:35:25.341 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 1 -- 10.20.193.23:0/376635037 <== mon.0 v1:10.20.193.23:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7f5ae8004dd0 con 0x7f5af414d580 2026-02-22T21:35:25.341 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:35:25.341 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T21:35:25.341 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5af0d72640 4 set_mon_vals no callback set 2026-02-22T21:35:25.341 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 monclient: dump: 2026-02-22T21:35:25.341 INFO:tasks.workunit.client.0.trial023.stderr:epoch 1 2026-02-22T21:35:25.341 INFO:tasks.workunit.client.0.trial023.stderr:fsid e2dd7ed3-13e8-4519-aab8-5d5a54f80255 2026-02-22T21:35:25.341 INFO:tasks.workunit.client.0.trial023.stderr:last_changed 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:25.341 INFO:tasks.workunit.client.0.trial023.stderr:created 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:25.341 INFO:tasks.workunit.client.0.trial023.stderr:min_mon_release 19 (squid) 2026-02-22T21:35:25.341 INFO:tasks.workunit.client.0.trial023.stderr:election_strategy: 3 2026-02-22T21:35:25.341 INFO:tasks.workunit.client.0.trial023.stderr:0: v1:10.20.193.23:6789/0 mon.a 2026-02-22T21:35:25.341 INFO:tasks.workunit.client.0.trial023.stderr: 2026-02-22T21:35:25.341 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 1 -- 10.20.193.23:0/376635037 <== mon.0 v1:10.20.193.23:6789/0 7 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (unknown 2945294299 0 0) 0x7f5af4147ed0 con 0x7f5af414d580 2026-02-22T21:35:25.341 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx client: 0x7f5acc003550 handle_response ret = 0 2026-02-22T21:35:25.342 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx client: get_rotating_key 2026-02-22T21:35:25.342 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 auth: dump_rotating: 2026-02-22T21:35:25.342 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 auth: id 1 AQBddptpfYjTLhAAXh1N3uFywlax+2y6vwZmsw== expires 2026-02-22T21:38:21.785614+0000 2026-02-22T21:35:25.342 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 auth: id 2 AQBddptpiI/TLhAAdz7mEzTpWi2a8fttyDShuw== expires 2026-02-22T21:42:21.785614+0000 2026-02-22T21:35:25.342 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 auth: id 3 AQBddptpNJfTLhAA8yUoZRot9tLYY9D+lZZAdA== expires 2026-02-22T21:46:21.785614+0000 2026-02-22T21:35:25.342 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 monclient: _finish_auth 0 2026-02-22T21:35:25.342 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 monclient: _check_auth_tickets 2026-02-22T21:35:25.342 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 cephx: validate_tickets want 53 have 53 need 0 2026-02-22T21:35:25.342 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 20 cephx client: need_tickets: want=53 have=53 need=0 2026-02-22T21:35:25.342 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2026-02-22T21:34:55.313004+0000) 2026-02-22T21:35:25.342 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 auth: dump_rotating: 2026-02-22T21:35:25.342 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 auth: id 1 AQBddptpfYjTLhAAXh1N3uFywlax+2y6vwZmsw== expires 2026-02-22T21:38:21.785614+0000 2026-02-22T21:35:25.342 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 auth: id 2 AQBddptpiI/TLhAAdz7mEzTpWi2a8fttyDShuw== expires 2026-02-22T21:42:21.785614+0000 2026-02-22T21:35:25.342 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 auth: id 3 AQBddptpNJfTLhAA8yUoZRot9tLYY9D+lZZAdA== expires 2026-02-22T21:46:21.785614+0000 2026-02-22T21:35:25.342 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5af8c58640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T21:35:25.342 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5af8c58640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:35:25.342 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5af8c58640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.23:6789/0 2026-02-22T21:35:25.342 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5af8c58640 1 -- 10.20.193.23:0/376635037 --> v1:10.20.193.23:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5af4162ea0 con 0x7f5af414d580 2026-02-22T21:35:25.342 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 1 -- 10.20.193.23:0/376635037 <== mon.0 v1:10.20.193.23:6789/0 8 ==== mgrmap(e 4) ==== 47400+0+0 (unknown 1603120368 0 0) 0x7f5ae80109d0 con 0x7f5af414d580 2026-02-22T21:35:25.342 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 1 -- 10.20.193.23:0/376635037 <== mon.0 v1:10.20.193.23:6789/0 9 ==== osd_map(14..14 src has 1..14) ==== 2160+0+0 (unknown 946035718 0 0) 0x7f5ae8048d90 con 0x7f5af414d580 2026-02-22T21:35:25.342 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5af1d74640 10 monclient: get_auth_request con 0x7f5acc03b970 auth_method 0 2026-02-22T21:35:25.342 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5af1d74640 10 cephx client: build_authorizer for service mgr 2026-02-22T21:35:25.342 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5af1d74640 10 In get_auth_session_handler for protocol 2 2026-02-22T21:35:25.342 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 1 -- 10.20.193.23:0/376635037 <== mon.0 v1:10.20.193.23:6789/0 10 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (unknown 1092875540 0 3570997608) 0x7f5ae8016a20 con 0x7f5af414d580 2026-02-22T21:35:25.342 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:35:25.343 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.308+0000 7f5adb7fe640 10 monclient: _finish_command 1 = system:0 2026-02-22T21:35:25.427 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.420+0000 7f5af8c58640 10 start_mon_command cmd=[{"prefix": "config-key get", "key": "device/test-foo"}] 2026-02-22T21:35:25.427 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.420+0000 7f5af8c58640 10 monclient: _send_command 2 [{"prefix": "config-key get", "key": "device/test-foo"}] 2026-02-22T21:35:25.427 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.420+0000 7f5af8c58640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.23:6789/0 2026-02-22T21:35:25.427 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.420+0000 7f5af8c58640 1 -- 10.20.193.23:0/376635037 --> v1:10.20.193.23:6789/0 -- mon_command({"prefix": "config-key get", "key": "device/test-foo"} v 0) -- 0x7f5af40c1dd0 con 0x7f5af414d580 2026-02-22T21:35:25.428 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.420+0000 7f5adb7fe640 1 -- 10.20.193.23:0/376635037 <== mon.0 v1:10.20.193.23:6789/0 11 ==== mon_command_ack([{"prefix": "config-key get", "key": "device/test-foo"}]=0 v13) ==== 88+0+0 (unknown 1708176172 0 0) 0x7f5ae8016320 con 0x7f5af414d580 2026-02-22T21:35:25.428 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.420+0000 7f5adb7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config-key get", "key": "device/test-foo"}] 2026-02-22T21:35:25.428 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.420+0000 7f5adb7fe640 10 monclient: _finish_command 2 = system:0 2026-02-22T21:35:25.504 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.496+0000 7f5af8c58640 10 start_mon_command cmd=[{"prefix": "config-key get", "key": "device/test-foo"}] 2026-02-22T21:35:25.505 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.496+0000 7f5af8c58640 10 monclient: _send_command 3 [{"prefix": "config-key get", "key": "device/test-foo"}] 2026-02-22T21:35:25.505 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.496+0000 7f5af8c58640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.23:6789/0 2026-02-22T21:35:25.505 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.496+0000 7f5af8c58640 1 -- 10.20.193.23:0/376635037 --> v1:10.20.193.23:6789/0 -- mon_command({"prefix": "config-key get", "key": "device/test-foo"} v 0) -- 0x7f5af415b6c0 con 0x7f5af414d580 2026-02-22T21:35:25.505 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.500+0000 7f5adb7fe640 1 -- 10.20.193.23:0/376635037 <== mon.0 v1:10.20.193.23:6789/0 12 ==== mon_command_ack([{"prefix": "config-key get", "key": "device/test-foo"}]=0 v13) ==== 88+0+0 (unknown 1708176172 0 0) 0x7f5ae80471f0 con 0x7f5af414d580 2026-02-22T21:35:25.505 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.500+0000 7f5adb7fe640 10 monclient: handle_mon_command_ack 3 [{"prefix": "config-key get", "key": "device/test-foo"}] 2026-02-22T21:35:25.505 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.500+0000 7f5adb7fe640 10 monclient: _finish_command 3 = system:0 2026-02-22T21:35:25.505 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.500+0000 7f5af8c58640 1 -- 10.20.193.23:0/376635037 >> v1:10.20.193.23:6800/2834055528 conn(0x7f5acc03b970 legacy=0x7f5acc03de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:35:25.505 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.500+0000 7f5af8c58640 10 monclient: shutdown 2026-02-22T21:35:25.505 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.500+0000 7f5af8c58640 1 -- 10.20.193.23:0/376635037 >> v1:10.20.193.23:6789/0 conn(0x7f5af414d580 legacy=0x7f5af415b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:35:25.505 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.500+0000 7f5af8c58640 1 -- 10.20.193.23:0/376635037 shutdown_connections 2026-02-22T21:35:25.506 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.500+0000 7f5af8c58640 1 -- 10.20.193.23:0/376635037 >> 10.20.193.23:0/376635037 conn(0x7f5af406c860 msgr2=0x7f5af40ccd20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:35:25.506 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.500+0000 7f5af8c58640 1 -- 10.20.193.23:0/376635037 shutdown_connections 2026-02-22T21:35:25.506 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.500+0000 7f5af8c58640 1 -- 10.20.193.23:0/376635037 wait complete. 2026-02-22T21:35:25.513 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name mgr.b config-key get test/foo 2026-02-22T21:35:25.591 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.572+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding auth protocol: cephx 2026-02-22T21:35:25.592 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.572+0000 7f2543962640 20 AuthRegistry(0x7f253c067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.592 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.572+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding auth protocol: cephx 2026-02-22T21:35:25.592 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.572+0000 7f2543962640 20 AuthRegistry(0x7f253c067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.592 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.572+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding auth protocol: cephx 2026-02-22T21:35:25.592 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.572+0000 7f2543962640 20 AuthRegistry(0x7f253c067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.592 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.572+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding con mode: secure 2026-02-22T21:35:25.592 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.572+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding con mode: crc 2026-02-22T21:35:25.592 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.572+0000 7f2543962640 20 AuthRegistry(0x7f253c067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.592 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.572+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding con mode: secure 2026-02-22T21:35:25.592 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.572+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding con mode: crc 2026-02-22T21:35:25.593 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.572+0000 7f2543962640 20 AuthRegistry(0x7f253c067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.593 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.572+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding con mode: secure 2026-02-22T21:35:25.593 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.572+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding con mode: crc 2026-02-22T21:35:25.593 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.572+0000 7f2543962640 20 AuthRegistry(0x7f253c067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.593 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.572+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding con mode: crc 2026-02-22T21:35:25.593 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.572+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding con mode: secure 2026-02-22T21:35:25.593 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.572+0000 7f2543962640 20 AuthRegistry(0x7f253c067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.593 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.572+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding con mode: crc 2026-02-22T21:35:25.593 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.572+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding con mode: secure 2026-02-22T21:35:25.593 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.572+0000 7f2543962640 20 AuthRegistry(0x7f253c067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.593 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.572+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding con mode: crc 2026-02-22T21:35:25.594 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.572+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding con mode: secure 2026-02-22T21:35:25.594 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.572+0000 7f2543962640 20 AuthRegistry(0x7f253c067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.594 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.572+0000 7f2543962640 10 AuthRegistry(0x7f253c067010) _refresh_config cluster_methods [2] service_methods [2] client_methods [2] 2026-02-22T21:35:25.594 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.572+0000 7f2543962640 10 AuthRegistry(0x7f253c067010) _refresh_config mon_cluster_modes [2,1] mon_service_modes [2,1] mon_client_modes [2,1]; cluster_modes [1,2] service_modes [1,2] client_modes [1,2] 2026-02-22T21:35:25.594 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.572+0000 7f2543962640 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2026-02-22T21:35:25.594 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding auth protocol: cephx 2026-02-22T21:35:25.594 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 20 AuthRegistry(0x7f253c067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.594 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding auth protocol: cephx 2026-02-22T21:35:25.594 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 20 AuthRegistry(0x7f253c067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.594 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding auth protocol: cephx 2026-02-22T21:35:25.594 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 20 AuthRegistry(0x7f253c067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.594 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding con mode: secure 2026-02-22T21:35:25.595 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding con mode: crc 2026-02-22T21:35:25.595 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 20 AuthRegistry(0x7f253c067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.595 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding con mode: secure 2026-02-22T21:35:25.595 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding con mode: crc 2026-02-22T21:35:25.595 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 20 AuthRegistry(0x7f253c067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.595 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding con mode: secure 2026-02-22T21:35:25.595 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding con mode: crc 2026-02-22T21:35:25.595 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 20 AuthRegistry(0x7f253c067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.595 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding con mode: crc 2026-02-22T21:35:25.595 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding con mode: secure 2026-02-22T21:35:25.595 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 20 AuthRegistry(0x7f253c067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.595 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding con mode: crc 2026-02-22T21:35:25.596 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding con mode: secure 2026-02-22T21:35:25.596 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 20 AuthRegistry(0x7f253c067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.596 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding con mode: crc 2026-02-22T21:35:25.596 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding con mode: secure 2026-02-22T21:35:25.596 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 20 AuthRegistry(0x7f253c067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.596 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 10 AuthRegistry(0x7f253c067010) _refresh_config cluster_methods [2] service_methods [2] client_methods [2] 2026-02-22T21:35:25.596 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 10 AuthRegistry(0x7f253c067010) _refresh_config mon_cluster_modes [2,1] mon_service_modes [2,1] mon_client_modes [2,1]; cluster_modes [1,2] service_modes [1,2] client_modes [1,2] 2026-02-22T21:35:25.596 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:25.596 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 10 monclient: get_monmap_and_config 2026-02-22T21:35:25.596 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 10 monclient: build_initial_monmap 2026-02-22T21:35:25.596 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 10 monclient: monmap: 2026-02-22T21:35:25.597 INFO:tasks.workunit.client.0.trial023.stderr:epoch 0 2026-02-22T21:35:25.597 INFO:tasks.workunit.client.0.trial023.stderr:fsid e2dd7ed3-13e8-4519-aab8-5d5a54f80255 2026-02-22T21:35:25.597 INFO:tasks.workunit.client.0.trial023.stderr:last_changed 2026-02-22T21:35:25.580573+0000 2026-02-22T21:35:25.597 INFO:tasks.workunit.client.0.trial023.stderr:created 2026-02-22T21:35:25.580573+0000 2026-02-22T21:35:25.597 INFO:tasks.workunit.client.0.trial023.stderr:min_mon_release 0 (unknown) 2026-02-22T21:35:25.597 INFO:tasks.workunit.client.0.trial023.stderr:election_strategy: 3 2026-02-22T21:35:25.597 INFO:tasks.workunit.client.0.trial023.stderr:0: v1:10.20.193.23:6789/0 mon.noname-a 2026-02-22T21:35:25.597 INFO:tasks.workunit.client.0.trial023.stderr: 2026-02-22T21:35:25.597 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c068a80) adding auth protocol: cephx 2026-02-22T21:35:25.597 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 20 AuthRegistry(0x7f253c068a80) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.597 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c068a80) adding auth protocol: cephx 2026-02-22T21:35:25.598 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 20 AuthRegistry(0x7f253c068a80) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.598 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c068a80) adding auth protocol: cephx 2026-02-22T21:35:25.598 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 20 AuthRegistry(0x7f253c068a80) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.598 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c068a80) adding con mode: secure 2026-02-22T21:35:25.598 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c068a80) adding con mode: crc 2026-02-22T21:35:25.598 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 20 AuthRegistry(0x7f253c068a80) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.598 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c068a80) adding con mode: secure 2026-02-22T21:35:25.598 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c068a80) adding con mode: crc 2026-02-22T21:35:25.598 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 20 AuthRegistry(0x7f253c068a80) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.598 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c068a80) adding con mode: secure 2026-02-22T21:35:25.598 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c068a80) adding con mode: crc 2026-02-22T21:35:25.598 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 20 AuthRegistry(0x7f253c068a80) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.598 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c068a80) adding con mode: crc 2026-02-22T21:35:25.599 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c068a80) adding con mode: secure 2026-02-22T21:35:25.599 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 20 AuthRegistry(0x7f253c068a80) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.599 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c068a80) adding con mode: crc 2026-02-22T21:35:25.599 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c068a80) adding con mode: secure 2026-02-22T21:35:25.599 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 20 AuthRegistry(0x7f253c068a80) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.599 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c068a80) adding con mode: crc 2026-02-22T21:35:25.599 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c068a80) adding con mode: secure 2026-02-22T21:35:25.599 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 20 AuthRegistry(0x7f253c068a80) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.599 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 10 AuthRegistry(0x7f253c068a80) _refresh_config cluster_methods [2] service_methods [2] client_methods [2] 2026-02-22T21:35:25.599 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 10 AuthRegistry(0x7f253c068a80) _refresh_config mon_cluster_modes [2,1] mon_service_modes [2,1] mon_client_modes [2,1]; cluster_modes [1,2] service_modes [1,2] client_modes [1,2] 2026-02-22T21:35:25.600 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:25.600 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 1 Processor -- start 2026-02-22T21:35:25.600 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 1 -- start start 2026-02-22T21:35:25.600 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 10 monclient: init 2026-02-22T21:35:25.600 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f2543960f50) adding auth protocol: cephx 2026-02-22T21:35:25.600 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 20 AuthRegistry(0x7f2543960f50) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.600 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f2543960f50) adding auth protocol: cephx 2026-02-22T21:35:25.600 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 20 AuthRegistry(0x7f2543960f50) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.600 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f2543960f50) adding auth protocol: cephx 2026-02-22T21:35:25.600 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 20 AuthRegistry(0x7f2543960f50) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.600 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f2543960f50) adding con mode: secure 2026-02-22T21:35:25.600 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f2543960f50) adding con mode: crc 2026-02-22T21:35:25.600 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 20 AuthRegistry(0x7f2543960f50) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.601 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f2543960f50) adding con mode: secure 2026-02-22T21:35:25.601 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f2543960f50) adding con mode: crc 2026-02-22T21:35:25.601 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 20 AuthRegistry(0x7f2543960f50) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.601 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f2543960f50) adding con mode: secure 2026-02-22T21:35:25.601 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f2543960f50) adding con mode: crc 2026-02-22T21:35:25.601 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 20 AuthRegistry(0x7f2543960f50) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.601 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f2543960f50) adding con mode: crc 2026-02-22T21:35:25.601 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f2543960f50) adding con mode: secure 2026-02-22T21:35:25.601 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 20 AuthRegistry(0x7f2543960f50) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.601 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f2543960f50) adding con mode: crc 2026-02-22T21:35:25.601 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f2543960f50) adding con mode: secure 2026-02-22T21:35:25.601 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 20 AuthRegistry(0x7f2543960f50) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.601 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f2543960f50) adding con mode: crc 2026-02-22T21:35:25.602 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f2543960f50) adding con mode: secure 2026-02-22T21:35:25.602 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 20 AuthRegistry(0x7f2543960f50) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.602 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 10 AuthRegistry(0x7f2543960f50) _refresh_config cluster_methods [2] service_methods [2] client_methods [2] 2026-02-22T21:35:25.602 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 10 AuthRegistry(0x7f2543960f50) _refresh_config mon_cluster_modes [2,1] mon_service_modes [2,1] mon_client_modes [2,1]; cluster_modes [1,2] service_modes [1,2] client_modes [1,2] 2026-02-22T21:35:25.602 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:25.602 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:25.602 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 10 monclient: _reopen_session rank -1 2026-02-22T21:35:25.602 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 10 monclient: _add_conns ranks=[0] 2026-02-22T21:35:25.602 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 10 monclient(hunting): picked mon.noname-a con 0x7f253c14d580 addr v1:10.20.193.23:6789/0 2026-02-22T21:35:25.602 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 1 -- --> v1:10.20.193.23:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x7f253c1656c0 con 0x7f253c14d580 2026-02-22T21:35:25.602 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 10 monclient(hunting): _renew_subs 2026-02-22T21:35:25.602 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 10 monclient(hunting): authenticate will time out at 597.798040s 2026-02-22T21:35:25.603 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f25416d7640 1 --1- >> v1:10.20.193.23:6789/0 conn(0x7f253c14d580 0x7f253c164bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.23:6789/0 says I am v1:10.20.193.23:43416/0 (socket says 10.20.193.23:43416) 2026-02-22T21:35:25.603 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f25416d7640 1 -- 10.20.193.23:0/4029060532 learned_addr learned my addr 10.20.193.23:0/4029060532 (peer_addr_for_me v1:10.20.193.23:0/0) 2026-02-22T21:35:25.603 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 1 -- 10.20.193.23:0/4029060532 <== mon.0 v1:10.20.193.23:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 79106238 0 0) 0x7f253c1656c0 con 0x7f253c14d580 2026-02-22T21:35:25.603 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 10 monclient(hunting): _negotiate 2026-02-22T21:35:25.603 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:35:25.603 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:35:25.603 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 10 cephx client: reset 2026-02-22T21:35:25.603 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 10 cephx: set_have_need_key no handler for service auth 2026-02-22T21:35:25.603 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 10 cephx: validate_tickets want 32 have 0 need 32 2026-02-22T21:35:25.603 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 10 cephx client: reset 2026-02-22T21:35:25.603 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 10 monclient(hunting): my global_id is 4258 2026-02-22T21:35:25.604 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 10 cephx client: 0x7f2524003550 handle_response ret = 0 2026-02-22T21:35:25.604 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 10 cephx client: got initial server challenge 42c21d92213f8d47 2026-02-22T21:35:25.604 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 10 cephx client: validate_tickets: want=32 need=32 have=0 2026-02-22T21:35:25.604 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 10 cephx: set_have_need_key no handler for service auth 2026-02-22T21:35:25.604 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 10 cephx: validate_tickets want 32 have 0 need 32 2026-02-22T21:35:25.604 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 10 cephx client: want=32 need=32 have=0 2026-02-22T21:35:25.604 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 10 cephx client: build_request 2026-02-22T21:35:25.604 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 10 cephx client: get auth session key: client_challenge 57025411d7b2e30c 2026-02-22T21:35:25.604 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 1 -- 10.20.193.23:0/4029060532 --> v1:10.20.193.23:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2524003630 con 0x7f253c14d580 2026-02-22T21:35:25.604 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 1 -- 10.20.193.23:0/4029060532 <== mon.0 v1:10.20.193.23:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 896119883 0 0) 0x7f2524003630 con 0x7f253c14d580 2026-02-22T21:35:25.604 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 10 cephx client: 0x7f2524003550 handle_response ret = 0 2026-02-22T21:35:25.604 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 10 cephx client: get_auth_session_key 2026-02-22T21:35:25.605 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 10 cephx: verify_service_ticket_reply got 1 keys 2026-02-22T21:35:25.605 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 10 cephx: got key for service_id auth 2026-02-22T21:35:25.605 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 10 cephx: verify_service_ticket_reply ticket.secret_id=2 2026-02-22T21:35:25.605 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 10 cephx: verify_service_ticket_reply service auth secret_id 2 session_key AQCddptpY225IhAAkp+CqGO2e6Fm1lI9OYmYvg== validity=660.000000 2026-02-22T21:35:25.605 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 10 cephx: verify_service_ticket_reply ticket expires=2026-02-22T21:46:25.582662+0000 renew_after=2026-02-22T21:43:40.582662+0000 2026-02-22T21:35:25.605 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 10 cephx client: want=32 need=32 have=0 2026-02-22T21:35:25.605 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 10 cephx client: got connection bl 0 and extra tickets 0 2026-02-22T21:35:25.605 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 10 cephx: validate_tickets want 32 have 32 need 0 2026-02-22T21:35:25.605 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 10 monclient: _finish_hunting 0 2026-02-22T21:35:25.605 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 1 monclient: found mon.noname-a 2026-02-22T21:35:25.605 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.23:6789/0 2026-02-22T21:35:25.605 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 1 -- 10.20.193.23:0/4029060532 --> v1:10.20.193.23:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f253c1652d0 con 0x7f253c14d580 2026-02-22T21:35:25.606 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 10 monclient: _finish_auth 0 2026-02-22T21:35:25.606 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 10 monclient: _check_auth_tickets 2026-02-22T21:35:25.606 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 10 cephx: validate_tickets want 32 have 32 need 0 2026-02-22T21:35:25.606 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 20 cephx client: need_tickets: want=32 have=32 need=0 2026-02-22T21:35:25.606 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 10 monclient: _check_auth_rotating renewing rotating keys (they expired before 2026-02-22T21:34:55.582674+0000) 2026-02-22T21:35:25.606 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 10 cephx client: build_rotating_request 2026-02-22T21:35:25.606 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.23:6789/0 2026-02-22T21:35:25.606 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 1 -- 10.20.193.23:0/4029060532 --> v1:10.20.193.23:6789/0 -- auth(proto 2 2 bytes epoch 0) -- 0x7f253c1656c0 con 0x7f253c14d580 2026-02-22T21:35:25.606 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 1 -- 10.20.193.23:0/4029060532 <== mon.0 v1:10.20.193.23:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7f252c002e20 con 0x7f253c14d580 2026-02-22T21:35:25.606 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:35:25.606 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T21:35:25.607 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 10 monclient: dump: 2026-02-22T21:35:25.607 INFO:tasks.workunit.client.0.trial023.stderr:epoch 1 2026-02-22T21:35:25.607 INFO:tasks.workunit.client.0.trial023.stderr:fsid e2dd7ed3-13e8-4519-aab8-5d5a54f80255 2026-02-22T21:35:25.607 INFO:tasks.workunit.client.0.trial023.stderr:last_changed 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:25.607 INFO:tasks.workunit.client.0.trial023.stderr:created 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:25.607 INFO:tasks.workunit.client.0.trial023.stderr:min_mon_release 19 (squid) 2026-02-22T21:35:25.607 INFO:tasks.workunit.client.0.trial023.stderr:election_strategy: 3 2026-02-22T21:35:25.607 INFO:tasks.workunit.client.0.trial023.stderr:0: v1:10.20.193.23:6789/0 mon.a 2026-02-22T21:35:25.607 INFO:tasks.workunit.client.0.trial023.stderr: 2026-02-22T21:35:25.607 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 monclient: authenticate success, global_id 4258 2026-02-22T21:35:25.607 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 1 -- 10.20.193.23:0/4029060532 <== mon.0 v1:10.20.193.23:6789/0 4 ==== config(1 keys) ==== 25+0+0 (unknown 1514702568 0 0) 0x7f252c003140 con 0x7f253c14d580 2026-02-22T21:35:25.607 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 10 monclient: handle_config config(1 keys) 2026-02-22T21:35:25.608 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 1 -- 10.20.193.23:0/4029060532 <== mon.0 v1:10.20.193.23:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7f252c0049b0 con 0x7f253c14d580 2026-02-22T21:35:25.608 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:35:25.608 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T21:35:25.608 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 10 monclient: dump: 2026-02-22T21:35:25.608 INFO:tasks.workunit.client.0.trial023.stderr:epoch 1 2026-02-22T21:35:25.608 INFO:tasks.workunit.client.0.trial023.stderr:fsid e2dd7ed3-13e8-4519-aab8-5d5a54f80255 2026-02-22T21:35:25.608 INFO:tasks.workunit.client.0.trial023.stderr:last_changed 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:25.608 INFO:tasks.workunit.client.0.trial023.stderr:created 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:25.608 INFO:tasks.workunit.client.0.trial023.stderr:min_mon_release 19 (squid) 2026-02-22T21:35:25.608 INFO:tasks.workunit.client.0.trial023.stderr:election_strategy: 3 2026-02-22T21:35:25.608 INFO:tasks.workunit.client.0.trial023.stderr:0: v1:10.20.193.23:6789/0 mon.a 2026-02-22T21:35:25.609 INFO:tasks.workunit.client.0.trial023.stderr: 2026-02-22T21:35:25.609 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 10 monclient: get_monmap_and_config success 2026-02-22T21:35:25.609 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 4 set_mon_vals no callback set 2026-02-22T21:35:25.609 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 10 set_mon_vals mgr_pool = false 2026-02-22T21:35:25.609 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 1 -- 10.20.193.23:0/4029060532 <== mon.0 v1:10.20.193.23:6789/0 6 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (unknown 375760730 0 0) 0x7f253c1656c0 con 0x7f253c14d580 2026-02-22T21:35:25.609 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 10 cephx client: 0x7f2524003550 handle_response ret = 0 2026-02-22T21:35:25.609 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 10 cephx client: get_rotating_key 2026-02-22T21:35:25.609 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 10 auth: dump_rotating: 2026-02-22T21:35:25.609 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 10 auth: id 1 AQBddptpfYjTLhAAXh1N3uFywlax+2y6vwZmsw== expires 2026-02-22T21:38:21.785614+0000 2026-02-22T21:35:25.609 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 10 auth: id 2 AQBddptpiI/TLhAAdz7mEzTpWi2a8fttyDShuw== expires 2026-02-22T21:42:21.785614+0000 2026-02-22T21:35:25.609 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 10 auth: id 3 AQBddptpNJfTLhAA8yUoZRot9tLYY9D+lZZAdA== expires 2026-02-22T21:46:21.785614+0000 2026-02-22T21:35:25.609 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 10 monclient: _finish_auth 0 2026-02-22T21:35:25.610 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 10 monclient: _check_auth_tickets 2026-02-22T21:35:25.610 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 10 cephx: validate_tickets want 32 have 32 need 0 2026-02-22T21:35:25.610 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 20 cephx client: need_tickets: want=32 have=32 need=0 2026-02-22T21:35:25.610 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2026-02-22T21:34:55.582780+0000) 2026-02-22T21:35:25.610 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 10 auth: dump_rotating: 2026-02-22T21:35:25.610 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 10 auth: id 1 AQBddptpfYjTLhAAXh1N3uFywlax+2y6vwZmsw== expires 2026-02-22T21:38:21.785614+0000 2026-02-22T21:35:25.610 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 10 auth: id 2 AQBddptpiI/TLhAAdz7mEzTpWi2a8fttyDShuw== expires 2026-02-22T21:42:21.785614+0000 2026-02-22T21:35:25.610 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f252bfff640 10 auth: id 3 AQBddptpNJfTLhAA8yUoZRot9tLYY9D+lZZAdA== expires 2026-02-22T21:46:21.785614+0000 2026-02-22T21:35:25.610 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 10 monclient: shutdown 2026-02-22T21:35:25.610 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 1 -- 10.20.193.23:0/4029060532 >> v1:10.20.193.23:6789/0 conn(0x7f253c14d580 legacy=0x7f253c164bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:35:25.610 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 1 -- 10.20.193.23:0/4029060532 shutdown_connections 2026-02-22T21:35:25.610 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 1 -- 10.20.193.23:0/4029060532 >> 10.20.193.23:0/4029060532 conn(0x7f253c06c860 msgr2=0x7f253c0bf590 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:35:25.611 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 1 -- 10.20.193.23:0/4029060532 shutdown_connections 2026-02-22T21:35:25.611 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 1 -- 10.20.193.23:0/4029060532 wait complete. 2026-02-22T21:35:25.611 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding auth protocol: cephx 2026-02-22T21:35:25.611 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 20 AuthRegistry(0x7f253c067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.611 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding auth protocol: cephx 2026-02-22T21:35:25.611 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 20 AuthRegistry(0x7f253c067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.611 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding auth protocol: cephx 2026-02-22T21:35:25.611 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 20 AuthRegistry(0x7f253c067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.611 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding con mode: secure 2026-02-22T21:35:25.611 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding con mode: crc 2026-02-22T21:35:25.611 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 20 AuthRegistry(0x7f253c067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.611 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding con mode: secure 2026-02-22T21:35:25.611 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding con mode: crc 2026-02-22T21:35:25.612 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 20 AuthRegistry(0x7f253c067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.612 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding con mode: secure 2026-02-22T21:35:25.612 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding con mode: crc 2026-02-22T21:35:25.612 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 20 AuthRegistry(0x7f253c067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.612 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding con mode: crc 2026-02-22T21:35:25.612 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding con mode: secure 2026-02-22T21:35:25.612 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 20 AuthRegistry(0x7f253c067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.612 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding con mode: crc 2026-02-22T21:35:25.612 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding con mode: secure 2026-02-22T21:35:25.612 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 20 AuthRegistry(0x7f253c067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.612 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding con mode: crc 2026-02-22T21:35:25.612 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding con mode: secure 2026-02-22T21:35:25.613 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 20 AuthRegistry(0x7f253c067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.613 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 10 AuthRegistry(0x7f253c067010) _refresh_config cluster_methods [2] service_methods [2] client_methods [2] 2026-02-22T21:35:25.613 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 10 AuthRegistry(0x7f253c067010) _refresh_config mon_cluster_modes [2,1] mon_service_modes [2,1] mon_client_modes [2,1]; cluster_modes [1,2] service_modes [1,2] client_modes [1,2] 2026-02-22T21:35:25.613 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:25.613 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 10 monclient: build_initial_monmap 2026-02-22T21:35:25.613 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 10 monclient: monmap: 2026-02-22T21:35:25.613 INFO:tasks.workunit.client.0.trial023.stderr:epoch 0 2026-02-22T21:35:25.613 INFO:tasks.workunit.client.0.trial023.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T21:35:25.613 INFO:tasks.workunit.client.0.trial023.stderr:last_changed 0.000000 2026-02-22T21:35:25.613 INFO:tasks.workunit.client.0.trial023.stderr:created 0.000000 2026-02-22T21:35:25.613 INFO:tasks.workunit.client.0.trial023.stderr:min_mon_release 0 (unknown) 2026-02-22T21:35:25.613 INFO:tasks.workunit.client.0.trial023.stderr:election_strategy: 1 2026-02-22T21:35:25.614 INFO:tasks.workunit.client.0.trial023.stderr:0: v1:10.20.193.23:6789/0 mon.noname-a 2026-02-22T21:35:25.614 INFO:tasks.workunit.client.0.trial023.stderr: 2026-02-22T21:35:25.614 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c0c1600) adding auth protocol: cephx 2026-02-22T21:35:25.614 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 20 AuthRegistry(0x7f253c0c1600) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.614 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c0c1600) adding auth protocol: cephx 2026-02-22T21:35:25.614 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 20 AuthRegistry(0x7f253c0c1600) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.614 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c0c1600) adding auth protocol: cephx 2026-02-22T21:35:25.614 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 20 AuthRegistry(0x7f253c0c1600) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.614 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c0c1600) adding con mode: secure 2026-02-22T21:35:25.614 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c0c1600) adding con mode: crc 2026-02-22T21:35:25.614 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 20 AuthRegistry(0x7f253c0c1600) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.615 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c0c1600) adding con mode: secure 2026-02-22T21:35:25.615 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c0c1600) adding con mode: crc 2026-02-22T21:35:25.615 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 20 AuthRegistry(0x7f253c0c1600) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.615 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c0c1600) adding con mode: secure 2026-02-22T21:35:25.615 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c0c1600) adding con mode: crc 2026-02-22T21:35:25.615 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 20 AuthRegistry(0x7f253c0c1600) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.615 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c0c1600) adding con mode: crc 2026-02-22T21:35:25.615 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c0c1600) adding con mode: secure 2026-02-22T21:35:25.615 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 20 AuthRegistry(0x7f253c0c1600) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.615 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c0c1600) adding con mode: crc 2026-02-22T21:35:25.615 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c0c1600) adding con mode: secure 2026-02-22T21:35:25.615 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 20 AuthRegistry(0x7f253c0c1600) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.615 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c0c1600) adding con mode: crc 2026-02-22T21:35:25.616 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 5 AuthRegistry(0x7f253c0c1600) adding con mode: secure 2026-02-22T21:35:25.616 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 20 AuthRegistry(0x7f253c0c1600) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.616 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 10 AuthRegistry(0x7f253c0c1600) _refresh_config cluster_methods [2] service_methods [2] client_methods [2] 2026-02-22T21:35:25.616 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.576+0000 7f2543962640 10 AuthRegistry(0x7f253c0c1600) _refresh_config mon_cluster_modes [2,1] mon_service_modes [2,1] mon_client_modes [2,1]; cluster_modes [1,2] service_modes [1,2] client_modes [1,2] 2026-02-22T21:35:25.616 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f2543962640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:25.616 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f2543962640 1 Processor -- start 2026-02-22T21:35:25.616 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f2543962640 1 -- start start 2026-02-22T21:35:25.616 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f2543962640 10 monclient: init 2026-02-22T21:35:25.616 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding auth protocol: cephx 2026-02-22T21:35:25.616 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f2543962640 20 AuthRegistry(0x7f253c067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.616 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding auth protocol: cephx 2026-02-22T21:35:25.616 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f2543962640 20 AuthRegistry(0x7f253c067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.616 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding auth protocol: cephx 2026-02-22T21:35:25.616 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f2543962640 20 AuthRegistry(0x7f253c067010) _parse_method_list cephx -> [2] 2026-02-22T21:35:25.616 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding con mode: secure 2026-02-22T21:35:25.617 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding con mode: crc 2026-02-22T21:35:25.617 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f2543962640 20 AuthRegistry(0x7f253c067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.617 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding con mode: secure 2026-02-22T21:35:25.617 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding con mode: crc 2026-02-22T21:35:25.617 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f2543962640 20 AuthRegistry(0x7f253c067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.617 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding con mode: secure 2026-02-22T21:35:25.617 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding con mode: crc 2026-02-22T21:35:25.617 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f2543962640 20 AuthRegistry(0x7f253c067010) _parse_mode_list secure crc -> [2,1] 2026-02-22T21:35:25.617 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding con mode: crc 2026-02-22T21:35:25.617 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding con mode: secure 2026-02-22T21:35:25.617 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f2543962640 20 AuthRegistry(0x7f253c067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.617 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding con mode: crc 2026-02-22T21:35:25.617 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding con mode: secure 2026-02-22T21:35:25.617 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f2543962640 20 AuthRegistry(0x7f253c067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.618 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding con mode: crc 2026-02-22T21:35:25.618 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f2543962640 5 AuthRegistry(0x7f253c067010) adding con mode: secure 2026-02-22T21:35:25.618 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f2543962640 20 AuthRegistry(0x7f253c067010) _parse_mode_list crc secure -> [1,2] 2026-02-22T21:35:25.618 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f2543962640 10 AuthRegistry(0x7f253c067010) _refresh_config cluster_methods [2] service_methods [2] client_methods [2] 2026-02-22T21:35:25.618 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f2543962640 10 AuthRegistry(0x7f253c067010) _refresh_config mon_cluster_modes [2,1] mon_service_modes [2,1] mon_client_modes [2,1]; cluster_modes [1,2] service_modes [1,2] client_modes [1,2] 2026-02-22T21:35:25.618 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f2543962640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:25.618 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f2543962640 2 auth: KeyRing::load: loaded key file /tmp/test_mon_config_key_caps.oiHJL/keyring 2026-02-22T21:35:25.618 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f2543962640 10 monclient: _reopen_session rank -1 2026-02-22T21:35:25.618 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f2543962640 10 monclient: _add_conns ranks=[0] 2026-02-22T21:35:25.618 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f2543962640 10 monclient(hunting): picked mon.noname-a con 0x7f253c14d580 addr v1:10.20.193.23:6789/0 2026-02-22T21:35:25.618 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f2543962640 1 -- --> v1:10.20.193.23:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x7f253c0bf3d0 con 0x7f253c14d580 2026-02-22T21:35:25.618 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f2543962640 10 monclient(hunting): _renew_subs 2026-02-22T21:35:25.618 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f2543962640 10 monclient(hunting): authenticate will time out at 597.800919s 2026-02-22T21:35:25.619 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f25416d7640 1 --1- >> v1:10.20.193.23:6789/0 conn(0x7f253c14d580 0x7f253c1646c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.23:6789/0 says I am v1:10.20.193.23:43420/0 (socket says 10.20.193.23:43420) 2026-02-22T21:35:25.619 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f25416d7640 1 -- 10.20.193.23:0/2447283559 learned_addr learned my addr 10.20.193.23:0/2447283559 (peer_addr_for_me v1:10.20.193.23:0/0) 2026-02-22T21:35:25.619 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 1 -- 10.20.193.23:0/2447283559 <== mon.0 v1:10.20.193.23:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3297342240 0 0) 0x7f253c0bf3d0 con 0x7f253c14d580 2026-02-22T21:35:25.619 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 monclient(hunting): _negotiate 2026-02-22T21:35:25.619 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:35:25.619 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:35:25.619 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx client: reset 2026-02-22T21:35:25.619 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx: set_have_need_key no handler for service mon 2026-02-22T21:35:25.619 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx: set_have_need_key no handler for service osd 2026-02-22T21:35:25.619 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx: set_have_need_key no handler for service mgr 2026-02-22T21:35:25.619 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx: set_have_need_key no handler for service auth 2026-02-22T21:35:25.619 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx: validate_tickets want 53 have 0 need 53 2026-02-22T21:35:25.619 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx client: reset 2026-02-22T21:35:25.619 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 monclient(hunting): my global_id is 4259 2026-02-22T21:35:25.620 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx client: 0x7f2518003550 handle_response ret = 0 2026-02-22T21:35:25.620 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx client: got initial server challenge 59a7e44cd45cc7d2 2026-02-22T21:35:25.620 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx client: validate_tickets: want=53 need=53 have=0 2026-02-22T21:35:25.620 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx: set_have_need_key no handler for service mon 2026-02-22T21:35:25.620 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx: set_have_need_key no handler for service osd 2026-02-22T21:35:25.620 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx: set_have_need_key no handler for service mgr 2026-02-22T21:35:25.620 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx: set_have_need_key no handler for service auth 2026-02-22T21:35:25.620 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx: validate_tickets want 53 have 0 need 53 2026-02-22T21:35:25.620 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx client: want=53 need=53 have=0 2026-02-22T21:35:25.620 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx client: build_request 2026-02-22T21:35:25.620 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx client: get auth session key: client_challenge df3cb08495e28aeb 2026-02-22T21:35:25.620 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 1 -- 10.20.193.23:0/2447283559 --> v1:10.20.193.23:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2518003630 con 0x7f253c14d580 2026-02-22T21:35:25.620 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 1 -- 10.20.193.23:0/2447283559 <== mon.0 v1:10.20.193.23:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 732+0+0 (unknown 620081650 0 0) 0x7f2518003630 con 0x7f253c14d580 2026-02-22T21:35:25.620 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx client: 0x7f2518003550 handle_response ret = 0 2026-02-22T21:35:25.620 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx client: get_auth_session_key 2026-02-22T21:35:25.620 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx: verify_service_ticket_reply got 1 keys 2026-02-22T21:35:25.621 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx: got key for service_id auth 2026-02-22T21:35:25.621 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx: verify_service_ticket_reply ticket.secret_id=2 2026-02-22T21:35:25.621 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx: verify_service_ticket_reply service auth secret_id 2 session_key AQCddptpFLviIhAAZHeScpRVDodxMl0BFHLuGQ== validity=660.000000 2026-02-22T21:35:25.621 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx: verify_service_ticket_reply ticket expires=2026-02-22T21:46:25.585389+0000 renew_after=2026-02-22T21:43:40.585389+0000 2026-02-22T21:35:25.621 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx client: want=53 need=53 have=0 2026-02-22T21:35:25.621 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx client: got connection bl 0 and extra tickets 518 2026-02-22T21:35:25.621 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx: set_have_need_key no handler for service mon 2026-02-22T21:35:25.621 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx: set_have_need_key no handler for service osd 2026-02-22T21:35:25.621 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx: set_have_need_key no handler for service mgr 2026-02-22T21:35:25.621 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx: validate_tickets want 53 have 32 need 21 2026-02-22T21:35:25.621 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx client: validate_tickets: want=53 need=21 have=32 2026-02-22T21:35:25.621 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx: set_have_need_key no handler for service mon 2026-02-22T21:35:25.621 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx: set_have_need_key no handler for service osd 2026-02-22T21:35:25.621 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx: set_have_need_key no handler for service mgr 2026-02-22T21:35:25.621 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx: validate_tickets want 53 have 32 need 21 2026-02-22T21:35:25.621 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx client: want=53 need=21 have=32 2026-02-22T21:35:25.622 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx client: build_request 2026-02-22T21:35:25.622 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx client: get service keys: want=53 need=21 have=32 2026-02-22T21:35:25.622 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 1 -- 10.20.193.23:0/2447283559 --> v1:10.20.193.23:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f253c0bf3d0 con 0x7f253c14d580 2026-02-22T21:35:25.622 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 1 -- 10.20.193.23:0/2447283559 <== mon.0 v1:10.20.193.23:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7f252c002da0 con 0x7f253c14d580 2026-02-22T21:35:25.622 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-22T21:35:25.622 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T21:35:25.622 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 monclient(hunting): dump: 2026-02-22T21:35:25.622 INFO:tasks.workunit.client.0.trial023.stderr:epoch 1 2026-02-22T21:35:25.622 INFO:tasks.workunit.client.0.trial023.stderr:fsid e2dd7ed3-13e8-4519-aab8-5d5a54f80255 2026-02-22T21:35:25.622 INFO:tasks.workunit.client.0.trial023.stderr:last_changed 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:25.622 INFO:tasks.workunit.client.0.trial023.stderr:created 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:25.622 INFO:tasks.workunit.client.0.trial023.stderr:min_mon_release 19 (squid) 2026-02-22T21:35:25.622 INFO:tasks.workunit.client.0.trial023.stderr:election_strategy: 3 2026-02-22T21:35:25.622 INFO:tasks.workunit.client.0.trial023.stderr:0: v1:10.20.193.23:6789/0 mon.a 2026-02-22T21:35:25.622 INFO:tasks.workunit.client.0.trial023.stderr: 2026-02-22T21:35:25.623 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 monclient(hunting): _finish_auth 0 2026-02-22T21:35:25.623 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 1 -- 10.20.193.23:0/2447283559 <== mon.0 v1:10.20.193.23:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 548+0+0 (unknown 263652504 0 0) 0x7f253c0bf3d0 con 0x7f253c14d580 2026-02-22T21:35:25.623 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx client: 0x7f2518003550 handle_response ret = 0 2026-02-22T21:35:25.623 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx client: get_principal_session_key session_key AQCddptpFLviIhAAZHeScpRVDodxMl0BFHLuGQ== 2026-02-22T21:35:25.623 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx: verify_service_ticket_reply got 3 keys 2026-02-22T21:35:25.623 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx: got key for service_id mon 2026-02-22T21:35:25.623 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx: verify_service_ticket_reply ticket.secret_id=2 2026-02-22T21:35:25.623 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx: verify_service_ticket_reply service mon secret_id 2 session_key AQCddptpOJ7lIhAALxP4sbsbJqDDvXy/70Xr3g== validity=240.000000 2026-02-22T21:35:25.623 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx: verify_service_ticket_reply ticket expires=2026-02-22T21:39:25.585540+0000 renew_after=2026-02-22T21:38:25.585540+0000 2026-02-22T21:35:25.623 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx: got key for service_id osd 2026-02-22T21:35:25.623 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx: verify_service_ticket_reply ticket.secret_id=2 2026-02-22T21:35:25.623 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx: verify_service_ticket_reply service osd secret_id 2 session_key AQCddptpoqblIhAAZ3nwBfpPeJ5FgZVZGQbY+g== validity=240.000000 2026-02-22T21:35:25.623 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx: verify_service_ticket_reply ticket expires=2026-02-22T21:39:25.585545+0000 renew_after=2026-02-22T21:38:25.585545+0000 2026-02-22T21:35:25.623 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx: got key for service_id mgr 2026-02-22T21:35:25.623 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx: verify_service_ticket_reply ticket.secret_id=2 2026-02-22T21:35:25.623 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx: verify_service_ticket_reply service mgr secret_id 2 session_key AQCddptpmLHlIhAAbZl+5cWjfsgvGlkP8PJiYQ== validity=240.000000 2026-02-22T21:35:25.623 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx: verify_service_ticket_reply ticket expires=2026-02-22T21:39:25.585553+0000 renew_after=2026-02-22T21:38:25.585553+0000 2026-02-22T21:35:25.624 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx: validate_tickets want 53 have 53 need 0 2026-02-22T21:35:25.624 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 monclient: _finish_hunting 0 2026-02-22T21:35:25.624 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 1 monclient: found mon.a 2026-02-22T21:35:25.624 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.23:6789/0 2026-02-22T21:35:25.624 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 1 -- 10.20.193.23:0/2447283559 --> v1:10.20.193.23:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f253c151f00 con 0x7f253c14d580 2026-02-22T21:35:25.624 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 monclient: _finish_auth 0 2026-02-22T21:35:25.624 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 monclient: _check_auth_tickets 2026-02-22T21:35:25.624 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx: validate_tickets want 53 have 53 need 0 2026-02-22T21:35:25.624 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 20 cephx client: need_tickets: want=53 have=53 need=0 2026-02-22T21:35:25.624 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 monclient: _check_auth_rotating renewing rotating keys (they expired before 2026-02-22T21:34:55.585568+0000) 2026-02-22T21:35:25.624 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx client: build_rotating_request 2026-02-22T21:35:25.624 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.23:6789/0 2026-02-22T21:35:25.624 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 1 -- 10.20.193.23:0/2447283559 --> v1:10.20.193.23:6789/0 -- auth(proto 2 2 bytes epoch 0) -- 0x7f2518003630 con 0x7f253c14d580 2026-02-22T21:35:25.624 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f2543962640 5 monclient: authenticate success, global_id 4259 2026-02-22T21:35:25.624 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f2543962640 10 monclient: _renew_subs 2026-02-22T21:35:25.624 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f2543962640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.23:6789/0 2026-02-22T21:35:25.624 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f2543962640 1 -- 10.20.193.23:0/2447283559 --> v1:10.20.193.23:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f253c073af0 con 0x7f253c14d580 2026-02-22T21:35:25.625 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f2543962640 10 monclient: _renew_subs 2026-02-22T21:35:25.625 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f2543962640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.23:6789/0 2026-02-22T21:35:25.625 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f2543962640 1 -- 10.20.193.23:0/2447283559 --> v1:10.20.193.23:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f253c1fa4e0 con 0x7f253c14d580 2026-02-22T21:35:25.625 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 1 -- 10.20.193.23:0/2447283559 <== mon.0 v1:10.20.193.23:6789/0 5 ==== config(1 keys) ==== 25+0+0 (unknown 1514702568 0 0) 0x7f252c003140 con 0x7f253c14d580 2026-02-22T21:35:25.625 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 monclient: handle_config config(1 keys) 2026-02-22T21:35:25.625 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 1 -- 10.20.193.23:0/2447283559 <== mon.0 v1:10.20.193.23:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7f252c004c90 con 0x7f253c14d580 2026-02-22T21:35:25.625 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:35:25.625 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T21:35:25.625 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 monclient: dump: 2026-02-22T21:35:25.625 INFO:tasks.workunit.client.0.trial023.stderr:epoch 1 2026-02-22T21:35:25.625 INFO:tasks.workunit.client.0.trial023.stderr:fsid e2dd7ed3-13e8-4519-aab8-5d5a54f80255 2026-02-22T21:35:25.625 INFO:tasks.workunit.client.0.trial023.stderr:last_changed 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:25.625 INFO:tasks.workunit.client.0.trial023.stderr:created 2026-02-22T21:34:05.388399+0000 2026-02-22T21:35:25.625 INFO:tasks.workunit.client.0.trial023.stderr:min_mon_release 19 (squid) 2026-02-22T21:35:25.625 INFO:tasks.workunit.client.0.trial023.stderr:election_strategy: 3 2026-02-22T21:35:25.625 INFO:tasks.workunit.client.0.trial023.stderr:0: v1:10.20.193.23:6789/0 mon.a 2026-02-22T21:35:25.626 INFO:tasks.workunit.client.0.trial023.stderr: 2026-02-22T21:35:25.626 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252b7fe640 4 set_mon_vals no callback set 2026-02-22T21:35:25.626 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 1 -- 10.20.193.23:0/2447283559 <== mon.0 v1:10.20.193.23:6789/0 7 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (unknown 2126663461 0 0) 0x7f253c1fa4e0 con 0x7f253c14d580 2026-02-22T21:35:25.626 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx client: 0x7f2518003550 handle_response ret = 0 2026-02-22T21:35:25.626 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx client: get_rotating_key 2026-02-22T21:35:25.626 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 auth: dump_rotating: 2026-02-22T21:35:25.626 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 auth: id 1 AQBddptpfYjTLhAAXh1N3uFywlax+2y6vwZmsw== expires 2026-02-22T21:38:21.785614+0000 2026-02-22T21:35:25.626 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 auth: id 2 AQBddptpiI/TLhAAdz7mEzTpWi2a8fttyDShuw== expires 2026-02-22T21:42:21.785614+0000 2026-02-22T21:35:25.626 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 auth: id 3 AQBddptpNJfTLhAA8yUoZRot9tLYY9D+lZZAdA== expires 2026-02-22T21:46:21.785614+0000 2026-02-22T21:35:25.626 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 monclient: _finish_auth 0 2026-02-22T21:35:25.626 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 monclient: _check_auth_tickets 2026-02-22T21:35:25.626 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 cephx: validate_tickets want 53 have 53 need 0 2026-02-22T21:35:25.626 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 20 cephx client: need_tickets: want=53 have=53 need=0 2026-02-22T21:35:25.626 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2026-02-22T21:34:55.585703+0000) 2026-02-22T21:35:25.626 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 auth: dump_rotating: 2026-02-22T21:35:25.626 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 auth: id 1 AQBddptpfYjTLhAAXh1N3uFywlax+2y6vwZmsw== expires 2026-02-22T21:38:21.785614+0000 2026-02-22T21:35:25.626 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 auth: id 2 AQBddptpiI/TLhAAdz7mEzTpWi2a8fttyDShuw== expires 2026-02-22T21:42:21.785614+0000 2026-02-22T21:35:25.626 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 10 auth: id 3 AQBddptpNJfTLhAA8yUoZRot9tLYY9D+lZZAdA== expires 2026-02-22T21:46:21.785614+0000 2026-02-22T21:35:25.626 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f2543962640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T21:35:25.627 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f2543962640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:35:25.627 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f2543962640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.23:6789/0 2026-02-22T21:35:25.627 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f2543962640 1 -- 10.20.193.23:0/2447283559 --> v1:10.20.193.23:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f253c15b450 con 0x7f253c14d580 2026-02-22T21:35:25.627 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 1 -- 10.20.193.23:0/2447283559 <== mon.0 v1:10.20.193.23:6789/0 8 ==== mgrmap(e 4) ==== 47400+0+0 (unknown 1603120368 0 0) 0x7f252c005060 con 0x7f253c14d580 2026-02-22T21:35:25.627 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f252a7fc640 1 -- 10.20.193.23:0/2447283559 <== mon.0 v1:10.20.193.23:6789/0 9 ==== osd_map(14..14 src has 1..14) ==== 2160+0+0 (unknown 946035718 0 0) 0x7f252c048ee0 con 0x7f253c14d580 2026-02-22T21:35:25.627 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f2540ed6640 10 monclient: get_auth_request con 0x7f251803b9b0 auth_method 0 2026-02-22T21:35:25.627 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f2540ed6640 10 cephx client: build_authorizer for service mgr 2026-02-22T21:35:25.627 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.580+0000 7f2540ed6640 10 In get_auth_session_handler for protocol 2 2026-02-22T21:35:25.627 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.584+0000 7f252a7fc640 1 -- 10.20.193.23:0/2447283559 <== mon.0 v1:10.20.193.23:6789/0 10 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (unknown 1092875540 0 3570997608) 0x7f252c016b70 con 0x7f253c14d580 2026-02-22T21:35:25.627 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.584+0000 7f252a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:35:25.627 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.584+0000 7f252a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-22T21:35:25.699 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.692+0000 7f2543962640 10 start_mon_command cmd=[{"prefix": "config-key get", "key": "test/foo"}] 2026-02-22T21:35:25.699 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.692+0000 7f2543962640 10 monclient: _send_command 2 [{"prefix": "config-key get", "key": "test/foo"}] 2026-02-22T21:35:25.700 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.692+0000 7f2543962640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.23:6789/0 2026-02-22T21:35:25.700 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.692+0000 7f2543962640 1 -- 10.20.193.23:0/2447283559 --> v1:10.20.193.23:6789/0 -- mon_command({"prefix": "config-key get", "key": "test/foo"} v 0) -- 0x7f253c069a10 con 0x7f253c14d580 2026-02-22T21:35:25.700 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.692+0000 7f252a7fc640 1 -- 10.20.193.23:0/2447283559 <== mon.0 v1:10.20.193.23:6789/0 11 ==== mon_command_ack([{"prefix": "config-key get", "key": "test/foo"}]=0 v13) ==== 81+0+0 (unknown 1473705578 0 0) 0x7f252c016470 con 0x7f253c14d580 2026-02-22T21:35:25.700 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.692+0000 7f252a7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config-key get", "key": "test/foo"}] 2026-02-22T21:35:25.700 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.692+0000 7f252a7fc640 10 monclient: _finish_command 2 = system:0 2026-02-22T21:35:25.777 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.772+0000 7f2543962640 10 start_mon_command cmd=[{"prefix": "config-key get", "key": "test/foo"}] 2026-02-22T21:35:25.777 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.772+0000 7f2543962640 10 monclient: _send_command 3 [{"prefix": "config-key get", "key": "test/foo"}] 2026-02-22T21:35:25.777 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.772+0000 7f2543962640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.23:6789/0 2026-02-22T21:35:25.777 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.772+0000 7f2543962640 1 -- 10.20.193.23:0/2447283559 --> v1:10.20.193.23:6789/0 -- mon_command({"prefix": "config-key get", "key": "test/foo"} v 0) -- 0x7f253c071350 con 0x7f253c14d580 2026-02-22T21:35:25.777 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.772+0000 7f252a7fc640 1 -- 10.20.193.23:0/2447283559 <== mon.0 v1:10.20.193.23:6789/0 12 ==== mon_command_ack([{"prefix": "config-key get", "key": "test/foo"}]=0 v13) ==== 81+0+0 (unknown 1473705578 0 0) 0x7f252c014390 con 0x7f253c14d580 2026-02-22T21:35:25.777 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.772+0000 7f252a7fc640 10 monclient: handle_mon_command_ack 3 [{"prefix": "config-key get", "key": "test/foo"}] 2026-02-22T21:35:25.777 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.772+0000 7f252a7fc640 10 monclient: _finish_command 3 = system:0 2026-02-22T21:35:25.778 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.772+0000 7f2543962640 1 -- 10.20.193.23:0/2447283559 >> v1:10.20.193.23:6800/2834055528 conn(0x7f251803b9b0 legacy=0x7f251803de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:35:25.778 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.772+0000 7f2543962640 10 monclient: shutdown 2026-02-22T21:35:25.778 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.772+0000 7f2543962640 1 -- 10.20.193.23:0/2447283559 >> v1:10.20.193.23:6789/0 conn(0x7f253c14d580 legacy=0x7f253c1646c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:35:25.778 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.772+0000 7f2543962640 1 -- 10.20.193.23:0/2447283559 shutdown_connections 2026-02-22T21:35:25.778 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.772+0000 7f2543962640 1 -- 10.20.193.23:0/2447283559 >> 10.20.193.23:0/2447283559 conn(0x7f253c06c860 msgr2=0x7f253c06e920 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:35:25.778 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.772+0000 7f2543962640 1 -- 10.20.193.23:0/2447283559 shutdown_connections 2026-02-22T21:35:25.778 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.772+0000 7f2543962640 1 -- 10.20.193.23:0/2447283559 wait complete. 2026-02-22T21:35:25.785 INFO:tasks.workunit.client.0.trial023.stderr:+ for c in $osd_a $osd_b 2026-02-22T21:35:25.786 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name osd.100 config-key put daemon-private/osd.100/test-foo 2026-02-22T21:35:25.854 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.844+0000 7f4f79a3a640 -1 auth: unable to find a keyring on /var/lib/ceph/osd/ceph-100/keyring: (13) Permission denied 2026-02-22T21:35:25.854 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.848+0000 7f4f79a3a640 1 Processor -- start 2026-02-22T21:35:25.854 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.848+0000 7f4f79a3a640 1 -- start start 2026-02-22T21:35:25.855 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.848+0000 7f4f79a3a640 1 -- --> v1:10.20.193.23:6789/0 -- auth(proto 0 28 bytes epoch 0) -- 0x7f4f74146d30 con 0x7f4f740b7960 2026-02-22T21:35:25.855 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.848+0000 7f4f72ffd640 1 --1- >> v1:10.20.193.23:6789/0 conn(0x7f4f740b7960 0x7f4f740b7d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.23:6789/0 says I am v1:10.20.193.23:43432/0 (socket says 10.20.193.23:43432) 2026-02-22T21:35:25.855 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.848+0000 7f4f72ffd640 1 -- 10.20.193.23:0/1323212904 learned_addr learned my addr 10.20.193.23:0/1323212904 (peer_addr_for_me v1:10.20.193.23:0/0) 2026-02-22T21:35:25.856 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.848+0000 7f4f71ffb640 1 -- 10.20.193.23:0/1323212904 <== mon.0 v1:10.20.193.23:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4276370078 0 0) 0x7f4f74146d30 con 0x7f4f740b7960 2026-02-22T21:35:25.856 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.848+0000 7f4f71ffb640 1 -- 10.20.193.23:0/1323212904 --> v1:10.20.193.23:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f60003630 con 0x7f4f740b7960 2026-02-22T21:35:25.856 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.848+0000 7f4f71ffb640 1 -- 10.20.193.23:0/1323212904 <== mon.0 v1:10.20.193.23:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 462504396 0 0) 0x7f4f60003630 con 0x7f4f740b7960 2026-02-22T21:35:25.856 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.848+0000 7f4f71ffb640 1 -- 10.20.193.23:0/1323212904 --> v1:10.20.193.23:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f740b8450 con 0x7f4f740b7960 2026-02-22T21:35:25.856 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.848+0000 7f4f71ffb640 1 -- 10.20.193.23:0/1323212904 --> v1:10.20.193.23:6789/0 -- auth(proto 2 2 bytes epoch 0) -- 0x7f4f74146d30 con 0x7f4f740b7960 2026-02-22T21:35:25.856 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.848+0000 7f4f71ffb640 1 -- 10.20.193.23:0/1323212904 <== mon.0 v1:10.20.193.23:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7f4f68002e20 con 0x7f4f740b7960 2026-02-22T21:35:25.856 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.848+0000 7f4f71ffb640 1 -- 10.20.193.23:0/1323212904 <== mon.0 v1:10.20.193.23:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4f68003130 con 0x7f4f740b7960 2026-02-22T21:35:25.856 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.848+0000 7f4f71ffb640 1 -- 10.20.193.23:0/1323212904 <== mon.0 v1:10.20.193.23:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7f4f68003530 con 0x7f4f740b7960 2026-02-22T21:35:25.856 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.848+0000 7f4f71ffb640 1 -- 10.20.193.23:0/1323212904 <== mon.0 v1:10.20.193.23:6789/0 6 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (unknown 2771003476 0 0) 0x7f4f74146d30 con 0x7f4f740b7960 2026-02-22T21:35:25.856 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.848+0000 7f4f79a3a640 1 -- 10.20.193.23:0/1323212904 >> v1:10.20.193.23:6789/0 conn(0x7f4f740b7960 legacy=0x7f4f740b7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:35:25.856 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.848+0000 7f4f79a3a640 1 -- 10.20.193.23:0/1323212904 shutdown_connections 2026-02-22T21:35:25.856 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.848+0000 7f4f79a3a640 1 -- 10.20.193.23:0/1323212904 >> 10.20.193.23:0/1323212904 conn(0x7f4f7406c870 msgr2=0x7f4f7406cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:35:25.856 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.848+0000 7f4f79a3a640 1 -- 10.20.193.23:0/1323212904 shutdown_connections 2026-02-22T21:35:25.856 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.848+0000 7f4f79a3a640 1 -- 10.20.193.23:0/1323212904 wait complete. 2026-02-22T21:35:25.857 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.852+0000 7f4f79a3a640 1 Processor -- start 2026-02-22T21:35:25.857 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.852+0000 7f4f79a3a640 1 -- start start 2026-02-22T21:35:25.858 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.852+0000 7f4f79a3a640 1 -- --> v1:10.20.193.23:6789/0 -- auth(proto 0 28 bytes epoch 0) -- 0x7f4f74146210 con 0x7f4f740b7960 2026-02-22T21:35:25.858 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.852+0000 7f4f72ffd640 1 --1- >> v1:10.20.193.23:6789/0 conn(0x7f4f740b7960 0x7f4f7413e5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.23:6789/0 says I am v1:10.20.193.23:43436/0 (socket says 10.20.193.23:43436) 2026-02-22T21:35:25.858 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.852+0000 7f4f72ffd640 1 -- 10.20.193.23:0/2369731780 learned_addr learned my addr 10.20.193.23:0/2369731780 (peer_addr_for_me v1:10.20.193.23:0/0) 2026-02-22T21:35:25.859 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.852+0000 7f4f78a38640 1 -- 10.20.193.23:0/2369731780 <== mon.0 v1:10.20.193.23:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1414052440 0 0) 0x7f4f74146210 con 0x7f4f740b7960 2026-02-22T21:35:25.859 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.852+0000 7f4f78a38640 1 -- 10.20.193.23:0/2369731780 --> v1:10.20.193.23:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f48003630 con 0x7f4f740b7960 2026-02-22T21:35:25.859 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.852+0000 7f4f78a38640 1 -- 10.20.193.23:0/2369731780 <== mon.0 v1:10.20.193.23:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 732+0+0 (unknown 865188005 0 0) 0x7f4f48003630 con 0x7f4f740b7960 2026-02-22T21:35:25.859 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.852+0000 7f4f78a38640 1 -- 10.20.193.23:0/2369731780 --> v1:10.20.193.23:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4f74146210 con 0x7f4f740b7960 2026-02-22T21:35:25.859 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.852+0000 7f4f78a38640 1 -- 10.20.193.23:0/2369731780 <== mon.0 v1:10.20.193.23:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7f4f68002860 con 0x7f4f740b7960 2026-02-22T21:35:25.859 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.852+0000 7f4f78a38640 1 -- 10.20.193.23:0/2369731780 <== mon.0 v1:10.20.193.23:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 548+0+0 (unknown 3819341269 0 0) 0x7f4f74146210 con 0x7f4f740b7960 2026-02-22T21:35:25.859 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.852+0000 7f4f78a38640 1 -- 10.20.193.23:0/2369731780 --> v1:10.20.193.23:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f740adb00 con 0x7f4f740b7960 2026-02-22T21:35:25.859 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.852+0000 7f4f78a38640 1 -- 10.20.193.23:0/2369731780 --> v1:10.20.193.23:6789/0 -- auth(proto 2 2 bytes epoch 0) -- 0x7f4f48003630 con 0x7f4f740b7960 2026-02-22T21:35:25.859 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.852+0000 7f4f79a3a640 1 -- 10.20.193.23:0/2369731780 --> v1:10.20.193.23:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4f741d2c60 con 0x7f4f740b7960 2026-02-22T21:35:25.859 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.852+0000 7f4f79a3a640 1 -- 10.20.193.23:0/2369731780 --> v1:10.20.193.23:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f4f740af9d0 con 0x7f4f740b7960 2026-02-22T21:35:25.859 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.852+0000 7f4f78a38640 1 -- 10.20.193.23:0/2369731780 <== mon.0 v1:10.20.193.23:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4f68004cc0 con 0x7f4f740b7960 2026-02-22T21:35:25.859 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.852+0000 7f4f78a38640 1 -- 10.20.193.23:0/2369731780 <== mon.0 v1:10.20.193.23:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7f4f68003130 con 0x7f4f740b7960 2026-02-22T21:35:25.859 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.852+0000 7f4f78a38640 1 -- 10.20.193.23:0/2369731780 <== mon.0 v1:10.20.193.23:6789/0 7 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (unknown 3448619051 0 0) 0x7f4f740af9d0 con 0x7f4f740b7960 2026-02-22T21:35:25.860 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.852+0000 7f4f79a3a640 1 -- 10.20.193.23:0/2369731780 --> v1:10.20.193.23:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f740008e0 con 0x7f4f740b7960 2026-02-22T21:35:25.860 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.852+0000 7f4f78a38640 1 -- 10.20.193.23:0/2369731780 <== mon.0 v1:10.20.193.23:6789/0 8 ==== mgrmap(e 4) ==== 47400+0+0 (unknown 1603120368 0 0) 0x7f4f68005020 con 0x7f4f740b7960 2026-02-22T21:35:25.860 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.852+0000 7f4f78a38640 1 -- 10.20.193.23:0/2369731780 <== mon.0 v1:10.20.193.23:6789/0 9 ==== osd_map(14..14 src has 1..14) ==== 2160+0+0 (unknown 946035718 0 0) 0x7f4f68048e60 con 0x7f4f740b7960 2026-02-22T21:35:25.861 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.856+0000 7f4f78a38640 1 -- 10.20.193.23:0/2369731780 <== mon.0 v1:10.20.193.23:6789/0 10 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (unknown 1092875540 0 3570997608) 0x7f4f68016a90 con 0x7f4f740b7960 2026-02-22T21:35:25.972 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.968+0000 7f4f79a3a640 1 -- 10.20.193.23:0/2369731780 --> v1:10.20.193.23:6789/0 -- mon_command({"prefix": "config-key put", "key": "daemon-private/osd.100/test-foo"} v 0) -- 0x7f4f740b9630 con 0x7f4f740b7960 2026-02-22T21:35:25.974 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:25.968+0000 7f4f78a38640 1 -- 10.20.193.23:0/2369731780 <== mon.0 v1:10.20.193.23:6789/0 11 ==== mon_command_ack([{"prefix": "config-key put", "key": "daemon-private/osd.100/test-foo"}]=0 set daemon-private/osd.100/test-foo v14) ==== 139+0+0 (unknown 1060059989 0 0) 0x7f4f68016390 con 0x7f4f740b7960 2026-02-22T21:35:26.052 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.044+0000 7f4f79a3a640 1 -- 10.20.193.23:0/2369731780 --> v1:10.20.193.23:6789/0 -- mon_command({"prefix": "config-key put", "key": "daemon-private/osd.100/test-foo"} v 0) -- 0x7f4f740c4f10 con 0x7f4f740b7960 2026-02-22T21:35:26.053 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.048+0000 7f4f78a38640 1 -- 10.20.193.23:0/2369731780 <== mon.0 v1:10.20.193.23:6789/0 12 ==== mon_command_ack([{"prefix": "config-key put", "key": "daemon-private/osd.100/test-foo"}]=0 set daemon-private/osd.100/test-foo v15) ==== 139+0+0 (unknown 3679356121 0 0) 0x7f4f6801f560 con 0x7f4f740b7960 2026-02-22T21:35:26.053 INFO:tasks.workunit.client.0.trial023.stderr:set daemon-private/osd.100/test-foo 2026-02-22T21:35:26.054 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.048+0000 7f4f79a3a640 1 -- 10.20.193.23:0/2369731780 >> v1:10.20.193.23:6800/2834055528 conn(0x7f4f4803ba90 legacy=0x7f4f4803df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:35:26.054 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.048+0000 7f4f79a3a640 1 -- 10.20.193.23:0/2369731780 >> v1:10.20.193.23:6789/0 conn(0x7f4f740b7960 legacy=0x7f4f7413e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:35:26.054 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.048+0000 7f4f79a3a640 1 -- 10.20.193.23:0/2369731780 shutdown_connections 2026-02-22T21:35:26.054 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.048+0000 7f4f79a3a640 1 -- 10.20.193.23:0/2369731780 >> 10.20.193.23:0/2369731780 conn(0x7f4f7406c870 msgr2=0x7f4f740a9820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:35:26.054 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.048+0000 7f4f79a3a640 1 -- 10.20.193.23:0/2369731780 shutdown_connections 2026-02-22T21:35:26.054 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.048+0000 7f4f79a3a640 1 -- 10.20.193.23:0/2369731780 wait complete. 2026-02-22T21:35:26.062 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name osd.100 config-key get daemon-private/osd.100/test-foo 2026-02-22T21:35:26.130 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.124+0000 7fea7c2e8640 -1 auth: unable to find a keyring on /var/lib/ceph/osd/ceph-100/keyring: (13) Permission denied 2026-02-22T21:35:26.130 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.124+0000 7fea7c2e8640 1 Processor -- start 2026-02-22T21:35:26.130 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.124+0000 7fea7c2e8640 1 -- start start 2026-02-22T21:35:26.131 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.124+0000 7fea7c2e8640 1 -- --> v1:10.20.193.23:6789/0 -- auth(proto 0 28 bytes epoch 0) -- 0x7fea740b78f0 con 0x7fea740b2020 2026-02-22T21:35:26.131 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.124+0000 7fea7a05d640 1 --1- >> v1:10.20.193.23:6789/0 conn(0x7fea740b2020 0x7fea740b7010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.23:6789/0 says I am v1:10.20.193.23:43446/0 (socket says 10.20.193.23:43446) 2026-02-22T21:35:26.131 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.124+0000 7fea7a05d640 1 -- 10.20.193.23:0/3015535362 learned_addr learned my addr 10.20.193.23:0/3015535362 (peer_addr_for_me v1:10.20.193.23:0/0) 2026-02-22T21:35:26.131 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.124+0000 7fea7905b640 1 -- 10.20.193.23:0/3015535362 <== mon.0 v1:10.20.193.23:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3505183882 0 0) 0x7fea740b78f0 con 0x7fea740b2020 2026-02-22T21:35:26.131 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.124+0000 7fea7905b640 1 -- 10.20.193.23:0/3015535362 --> v1:10.20.193.23:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea5c003630 con 0x7fea740b2020 2026-02-22T21:35:26.132 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.124+0000 7fea7905b640 1 -- 10.20.193.23:0/3015535362 <== mon.0 v1:10.20.193.23:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 418446934 0 0) 0x7fea5c003630 con 0x7fea740b2020 2026-02-22T21:35:26.132 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.124+0000 7fea7905b640 1 -- 10.20.193.23:0/3015535362 --> v1:10.20.193.23:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea740adb10 con 0x7fea740b2020 2026-02-22T21:35:26.132 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.124+0000 7fea7905b640 1 -- 10.20.193.23:0/3015535362 --> v1:10.20.193.23:6789/0 -- auth(proto 2 2 bytes epoch 0) -- 0x7fea740b78f0 con 0x7fea740b2020 2026-02-22T21:35:26.132 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.124+0000 7fea7905b640 1 -- 10.20.193.23:0/3015535362 <== mon.0 v1:10.20.193.23:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7fea64002e20 con 0x7fea740b2020 2026-02-22T21:35:26.132 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.124+0000 7fea7905b640 1 -- 10.20.193.23:0/3015535362 <== mon.0 v1:10.20.193.23:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fea64003090 con 0x7fea740b2020 2026-02-22T21:35:26.132 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.124+0000 7fea7905b640 1 -- 10.20.193.23:0/3015535362 <== mon.0 v1:10.20.193.23:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7fea64003490 con 0x7fea740b2020 2026-02-22T21:35:26.132 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.124+0000 7fea7905b640 1 -- 10.20.193.23:0/3015535362 <== mon.0 v1:10.20.193.23:6789/0 6 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (unknown 1952839850 0 0) 0x7fea740b78f0 con 0x7fea740b2020 2026-02-22T21:35:26.132 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.124+0000 7fea7c2e8640 1 -- 10.20.193.23:0/3015535362 >> v1:10.20.193.23:6789/0 conn(0x7fea740b2020 legacy=0x7fea740b7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:35:26.132 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.124+0000 7fea7c2e8640 1 -- 10.20.193.23:0/3015535362 shutdown_connections 2026-02-22T21:35:26.132 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.124+0000 7fea7c2e8640 1 -- 10.20.193.23:0/3015535362 >> 10.20.193.23:0/3015535362 conn(0x7fea74074560 msgr2=0x7fea74074970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:35:26.132 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.124+0000 7fea7c2e8640 1 -- 10.20.193.23:0/3015535362 shutdown_connections 2026-02-22T21:35:26.132 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.128+0000 7fea7c2e8640 1 -- 10.20.193.23:0/3015535362 wait complete. 2026-02-22T21:35:26.133 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.128+0000 7fea7c2e8640 1 Processor -- start 2026-02-22T21:35:26.133 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.128+0000 7fea7c2e8640 1 -- start start 2026-02-22T21:35:26.134 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.128+0000 7fea7c2e8640 1 -- --> v1:10.20.193.23:6789/0 -- auth(proto 0 28 bytes epoch 0) -- 0x7fea740c2180 con 0x7fea740b2020 2026-02-22T21:35:26.134 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.128+0000 7fea7a05d640 1 --1- >> v1:10.20.193.23:6789/0 conn(0x7fea740b2020 0x7fea740b5350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.23:6789/0 says I am v1:10.20.193.23:43448/0 (socket says 10.20.193.23:43448) 2026-02-22T21:35:26.134 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.128+0000 7fea7a05d640 1 -- 10.20.193.23:0/3280732667 learned_addr learned my addr 10.20.193.23:0/3280732667 (peer_addr_for_me v1:10.20.193.23:0/0) 2026-02-22T21:35:26.134 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.128+0000 7fea5b7fe640 1 -- 10.20.193.23:0/3280732667 <== mon.0 v1:10.20.193.23:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1830838122 0 0) 0x7fea740c2180 con 0x7fea740b2020 2026-02-22T21:35:26.134 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.128+0000 7fea5b7fe640 1 -- 10.20.193.23:0/3280732667 --> v1:10.20.193.23:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea50003630 con 0x7fea740b2020 2026-02-22T21:35:26.134 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.128+0000 7fea5b7fe640 1 -- 10.20.193.23:0/3280732667 <== mon.0 v1:10.20.193.23:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 732+0+0 (unknown 996747632 0 0) 0x7fea50003630 con 0x7fea740b2020 2026-02-22T21:35:26.135 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.128+0000 7fea5b7fe640 1 -- 10.20.193.23:0/3280732667 --> v1:10.20.193.23:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fea740c2180 con 0x7fea740b2020 2026-02-22T21:35:26.135 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.128+0000 7fea5b7fe640 1 -- 10.20.193.23:0/3280732667 <== mon.0 v1:10.20.193.23:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7fea640028c0 con 0x7fea740b2020 2026-02-22T21:35:26.135 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.128+0000 7fea5b7fe640 1 -- 10.20.193.23:0/3280732667 <== mon.0 v1:10.20.193.23:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 548+0+0 (unknown 823736640 0 0) 0x7fea740c2180 con 0x7fea740b2020 2026-02-22T21:35:26.135 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.128+0000 7fea5b7fe640 1 -- 10.20.193.23:0/3280732667 --> v1:10.20.193.23:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea74090a70 con 0x7fea740b2020 2026-02-22T21:35:26.135 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.128+0000 7fea5b7fe640 1 -- 10.20.193.23:0/3280732667 --> v1:10.20.193.23:6789/0 -- auth(proto 2 2 bytes epoch 0) -- 0x7fea50003630 con 0x7fea740b2020 2026-02-22T21:35:26.135 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.128+0000 7fea7c2e8640 1 -- 10.20.193.23:0/3280732667 --> v1:10.20.193.23:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fea74150650 con 0x7fea740b2020 2026-02-22T21:35:26.135 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.128+0000 7fea5b7fe640 1 -- 10.20.193.23:0/3280732667 <== mon.0 v1:10.20.193.23:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fea64004c00 con 0x7fea740b2020 2026-02-22T21:35:26.135 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.128+0000 7fea7c2e8640 1 -- 10.20.193.23:0/3280732667 --> v1:10.20.193.23:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fea740a5ab0 con 0x7fea740b2020 2026-02-22T21:35:26.135 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.128+0000 7fea5b7fe640 1 -- 10.20.193.23:0/3280732667 <== mon.0 v1:10.20.193.23:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7fea64004f80 con 0x7fea740b2020 2026-02-22T21:35:26.135 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.128+0000 7fea5b7fe640 1 -- 10.20.193.23:0/3280732667 <== mon.0 v1:10.20.193.23:6789/0 7 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (unknown 482480341 0 0) 0x7fea74150650 con 0x7fea740b2020 2026-02-22T21:35:26.135 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.128+0000 7fea7c2e8640 1 -- 10.20.193.23:0/3280732667 --> v1:10.20.193.23:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea7406dca0 con 0x7fea740b2020 2026-02-22T21:35:26.135 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.128+0000 7fea5b7fe640 1 -- 10.20.193.23:0/3280732667 <== mon.0 v1:10.20.193.23:6789/0 8 ==== mgrmap(e 4) ==== 47400+0+0 (unknown 1603120368 0 0) 0x7fea64005310 con 0x7fea740b2020 2026-02-22T21:35:26.135 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.128+0000 7fea5b7fe640 1 -- 10.20.193.23:0/3280732667 <== mon.0 v1:10.20.193.23:6789/0 9 ==== osd_map(14..14 src has 1..14) ==== 2160+0+0 (unknown 946035718 0 0) 0x7fea64048c50 con 0x7fea740b2020 2026-02-22T21:35:26.137 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.132+0000 7fea5b7fe640 1 -- 10.20.193.23:0/3280732667 <== mon.0 v1:10.20.193.23:6789/0 10 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (unknown 1092875540 0 3570997608) 0x7fea640168e0 con 0x7fea740b2020 2026-02-22T21:35:26.247 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.240+0000 7fea7c2e8640 1 -- 10.20.193.23:0/3280732667 --> v1:10.20.193.23:6789/0 -- mon_command({"prefix": "config-key get", "key": "daemon-private/osd.100/test-foo"} v 0) -- 0x7fea740ad680 con 0x7fea740b2020 2026-02-22T21:35:26.247 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.240+0000 7fea5b7fe640 1 -- 10.20.193.23:0/3280732667 <== mon.0 v1:10.20.193.23:6789/0 11 ==== mon_command_ack([{"prefix": "config-key get", "key": "daemon-private/osd.100/test-foo"}]=0 v15) ==== 104+0+0 (unknown 1673481874 0 0) 0x7fea640161e0 con 0x7fea740b2020 2026-02-22T21:35:26.324 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.316+0000 7fea7c2e8640 1 -- 10.20.193.23:0/3280732667 --> v1:10.20.193.23:6789/0 -- mon_command({"prefix": "config-key get", "key": "daemon-private/osd.100/test-foo"} v 0) -- 0x7fea74150820 con 0x7fea740b2020 2026-02-22T21:35:26.324 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.316+0000 7fea5b7fe640 1 -- 10.20.193.23:0/3280732667 <== mon.0 v1:10.20.193.23:6789/0 12 ==== mon_command_ack([{"prefix": "config-key get", "key": "daemon-private/osd.100/test-foo"}]=0 v15) ==== 104+0+0 (unknown 1673481874 0 0) 0x7fea640470b0 con 0x7fea740b2020 2026-02-22T21:35:26.325 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.320+0000 7fea7c2e8640 1 -- 10.20.193.23:0/3280732667 >> v1:10.20.193.23:6800/2834055528 conn(0x7fea5003b990 legacy=0x7fea5003de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:35:26.325 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.320+0000 7fea7c2e8640 1 -- 10.20.193.23:0/3280732667 >> v1:10.20.193.23:6789/0 conn(0x7fea740b2020 legacy=0x7fea740b5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:35:26.325 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.320+0000 7fea7c2e8640 1 -- 10.20.193.23:0/3280732667 shutdown_connections 2026-02-22T21:35:26.325 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.320+0000 7fea7c2e8640 1 -- 10.20.193.23:0/3280732667 >> 10.20.193.23:0/3280732667 conn(0x7fea74074560 msgr2=0x7fea740ab690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:35:26.325 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.320+0000 7fea7c2e8640 1 -- 10.20.193.23:0/3280732667 shutdown_connections 2026-02-22T21:35:26.325 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.320+0000 7fea7c2e8640 1 -- 10.20.193.23:0/3280732667 wait complete. 2026-02-22T21:35:26.333 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name osd.100 config-key ls 2026-02-22T21:35:26.333 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:26.333 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name osd.100 config-key ls 2026-02-22T21:35:26.402 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.392+0000 7f2b8813f640 -1 auth: unable to find a keyring on /var/lib/ceph/osd/ceph-100/keyring: (13) Permission denied 2026-02-22T21:35:26.402 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.396+0000 7f2b8813f640 1 Processor -- start 2026-02-22T21:35:26.402 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.396+0000 7f2b8813f640 1 -- start start 2026-02-22T21:35:26.404 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.396+0000 7f2b8813f640 1 -- --> v1:10.20.193.23:6789/0 -- auth(proto 0 28 bytes epoch 0) -- 0x7f2b800b78f0 con 0x7f2b800b2020 2026-02-22T21:35:26.404 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.396+0000 7f2b85eb4640 1 --1- >> v1:10.20.193.23:6789/0 conn(0x7f2b800b2020 0x7f2b800b7010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.23:6789/0 says I am v1:10.20.193.23:43452/0 (socket says 10.20.193.23:43452) 2026-02-22T21:35:26.404 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.396+0000 7f2b85eb4640 1 -- 10.20.193.23:0/2979368429 learned_addr learned my addr 10.20.193.23:0/2979368429 (peer_addr_for_me v1:10.20.193.23:0/0) 2026-02-22T21:35:26.404 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.396+0000 7f2b84eb2640 1 -- 10.20.193.23:0/2979368429 <== mon.0 v1:10.20.193.23:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 273973903 0 0) 0x7f2b800b78f0 con 0x7f2b800b2020 2026-02-22T21:35:26.404 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.396+0000 7f2b84eb2640 1 -- 10.20.193.23:0/2979368429 --> v1:10.20.193.23:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b68003630 con 0x7f2b800b2020 2026-02-22T21:35:26.405 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.396+0000 7f2b84eb2640 1 -- 10.20.193.23:0/2979368429 <== mon.0 v1:10.20.193.23:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 411881532 0 0) 0x7f2b68003630 con 0x7f2b800b2020 2026-02-22T21:35:26.405 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.396+0000 7f2b84eb2640 1 -- 10.20.193.23:0/2979368429 --> v1:10.20.193.23:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b800adb10 con 0x7f2b800b2020 2026-02-22T21:35:26.405 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.396+0000 7f2b84eb2640 1 -- 10.20.193.23:0/2979368429 --> v1:10.20.193.23:6789/0 -- auth(proto 2 2 bytes epoch 0) -- 0x7f2b800b78f0 con 0x7f2b800b2020 2026-02-22T21:35:26.405 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.396+0000 7f2b84eb2640 1 -- 10.20.193.23:0/2979368429 <== mon.0 v1:10.20.193.23:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7f2b70002e20 con 0x7f2b800b2020 2026-02-22T21:35:26.405 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.396+0000 7f2b84eb2640 1 -- 10.20.193.23:0/2979368429 <== mon.0 v1:10.20.193.23:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2b70003090 con 0x7f2b800b2020 2026-02-22T21:35:26.405 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.396+0000 7f2b84eb2640 1 -- 10.20.193.23:0/2979368429 <== mon.0 v1:10.20.193.23:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7f2b70003490 con 0x7f2b800b2020 2026-02-22T21:35:26.405 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.396+0000 7f2b84eb2640 1 -- 10.20.193.23:0/2979368429 <== mon.0 v1:10.20.193.23:6789/0 6 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (unknown 1230120882 0 0) 0x7f2b800b78f0 con 0x7f2b800b2020 2026-02-22T21:35:26.405 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.396+0000 7f2b8813f640 1 -- 10.20.193.23:0/2979368429 >> v1:10.20.193.23:6789/0 conn(0x7f2b800b2020 legacy=0x7f2b800b7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:35:26.405 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.396+0000 7f2b8813f640 1 -- 10.20.193.23:0/2979368429 shutdown_connections 2026-02-22T21:35:26.405 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.396+0000 7f2b8813f640 1 -- 10.20.193.23:0/2979368429 >> 10.20.193.23:0/2979368429 conn(0x7f2b80074560 msgr2=0x7f2b80074970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:35:26.405 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.396+0000 7f2b8813f640 1 -- 10.20.193.23:0/2979368429 shutdown_connections 2026-02-22T21:35:26.405 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.396+0000 7f2b8813f640 1 -- 10.20.193.23:0/2979368429 wait complete. 2026-02-22T21:35:26.408 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.400+0000 7f2b8813f640 1 Processor -- start 2026-02-22T21:35:26.408 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.400+0000 7f2b8813f640 1 -- start start 2026-02-22T21:35:26.408 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.400+0000 7f2b8813f640 1 -- --> v1:10.20.193.23:6789/0 -- auth(proto 0 28 bytes epoch 0) -- 0x7f2b800c2180 con 0x7f2b800b2020 2026-02-22T21:35:26.408 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.400+0000 7f2b85eb4640 1 --1- >> v1:10.20.193.23:6789/0 conn(0x7f2b800b2020 0x7f2b800b5350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.23:6789/0 says I am v1:10.20.193.23:43460/0 (socket says 10.20.193.23:43460) 2026-02-22T21:35:26.408 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.400+0000 7f2b85eb4640 1 -- 10.20.193.23:0/3050707612 learned_addr learned my addr 10.20.193.23:0/3050707612 (peer_addr_for_me v1:10.20.193.23:0/0) 2026-02-22T21:35:26.408 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.400+0000 7f2b6effd640 1 -- 10.20.193.23:0/3050707612 <== mon.0 v1:10.20.193.23:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1888392346 0 0) 0x7f2b800c2180 con 0x7f2b800b2020 2026-02-22T21:35:26.408 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.400+0000 7f2b6effd640 1 -- 10.20.193.23:0/3050707612 --> v1:10.20.193.23:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b5c003630 con 0x7f2b800b2020 2026-02-22T21:35:26.408 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.400+0000 7f2b6effd640 1 -- 10.20.193.23:0/3050707612 <== mon.0 v1:10.20.193.23:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 732+0+0 (unknown 959576647 0 0) 0x7f2b5c003630 con 0x7f2b800b2020 2026-02-22T21:35:26.408 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.400+0000 7f2b6effd640 1 -- 10.20.193.23:0/3050707612 --> v1:10.20.193.23:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2b800c2180 con 0x7f2b800b2020 2026-02-22T21:35:26.408 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.400+0000 7f2b6effd640 1 -- 10.20.193.23:0/3050707612 <== mon.0 v1:10.20.193.23:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7f2b700028c0 con 0x7f2b800b2020 2026-02-22T21:35:26.409 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.400+0000 7f2b6effd640 1 -- 10.20.193.23:0/3050707612 <== mon.0 v1:10.20.193.23:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 548+0+0 (unknown 46910218 0 0) 0x7f2b800c2180 con 0x7f2b800b2020 2026-02-22T21:35:26.409 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.400+0000 7f2b6effd640 1 -- 10.20.193.23:0/3050707612 --> v1:10.20.193.23:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b80090a70 con 0x7f2b800b2020 2026-02-22T21:35:26.409 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.400+0000 7f2b6effd640 1 -- 10.20.193.23:0/3050707612 --> v1:10.20.193.23:6789/0 -- auth(proto 2 2 bytes epoch 0) -- 0x7f2b5c003630 con 0x7f2b800b2020 2026-02-22T21:35:26.409 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.400+0000 7f2b8813f640 1 -- 10.20.193.23:0/3050707612 --> v1:10.20.193.23:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2b80150650 con 0x7f2b800b2020 2026-02-22T21:35:26.409 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.400+0000 7f2b8813f640 1 -- 10.20.193.23:0/3050707612 --> v1:10.20.193.23:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f2b800a5ab0 con 0x7f2b800b2020 2026-02-22T21:35:26.409 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.400+0000 7f2b6effd640 1 -- 10.20.193.23:0/3050707612 <== mon.0 v1:10.20.193.23:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2b70002a90 con 0x7f2b800b2020 2026-02-22T21:35:26.409 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.400+0000 7f2b6effd640 1 -- 10.20.193.23:0/3050707612 <== mon.0 v1:10.20.193.23:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7f2b70002fe0 con 0x7f2b800b2020 2026-02-22T21:35:26.409 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.400+0000 7f2b6effd640 1 -- 10.20.193.23:0/3050707612 <== mon.0 v1:10.20.193.23:6789/0 7 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (unknown 569757645 0 0) 0x7f2b800a5ab0 con 0x7f2b800b2020 2026-02-22T21:35:26.409 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.400+0000 7f2b8813f640 1 -- 10.20.193.23:0/3050707612 --> v1:10.20.193.23:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b8006dca0 con 0x7f2b800b2020 2026-02-22T21:35:26.409 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.400+0000 7f2b6effd640 1 -- 10.20.193.23:0/3050707612 <== mon.0 v1:10.20.193.23:6789/0 8 ==== mgrmap(e 4) ==== 47400+0+0 (unknown 1603120368 0 0) 0x7f2b70004fc0 con 0x7f2b800b2020 2026-02-22T21:35:26.409 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.400+0000 7f2b6effd640 1 -- 10.20.193.23:0/3050707612 <== mon.0 v1:10.20.193.23:6789/0 9 ==== osd_map(14..14 src has 1..14) ==== 2160+0+0 (unknown 946035718 0 0) 0x7f2b70048d10 con 0x7f2b800b2020 2026-02-22T21:35:26.410 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.404+0000 7f2b6effd640 1 -- 10.20.193.23:0/3050707612 <== mon.0 v1:10.20.193.23:6789/0 10 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (unknown 1092875540 0 3570997608) 0x7f2b700169a0 con 0x7f2b800b2020 2026-02-22T21:35:26.523 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.516+0000 7f2b8813f640 1 -- 10.20.193.23:0/3050707612 --> v1:10.20.193.23:6789/0 -- mon_command({"prefix": "config-key ls"} v 0) -- 0x7f2b800ad680 con 0x7f2b800b2020 2026-02-22T21:35:26.524 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.516+0000 7f2b6effd640 1 -- 10.20.193.23:0/3050707612 <== mon.0 v1:10.20.193.23:6789/0 11 ==== mon_command_ack([{"prefix": "config-key ls"}]=-13 access denied v0) ==== 74+0+0 (unknown 2083006276 0 0) 0x7f2b700162a0 con 0x7f2b800b2020 2026-02-22T21:35:26.524 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:26.527 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:26.527 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name osd.100 config-key get mgr/test-foo 2026-02-22T21:35:26.527 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:26.527 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name osd.100 config-key get mgr/test-foo 2026-02-22T21:35:26.579 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.568+0000 7f47c8452640 -1 auth: unable to find a keyring on /var/lib/ceph/osd/ceph-100/keyring: (13) Permission denied 2026-02-22T21:35:26.580 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.572+0000 7f47c8452640 1 Processor -- start 2026-02-22T21:35:26.580 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.572+0000 7f47c8452640 1 -- start start 2026-02-22T21:35:26.582 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.576+0000 7f47c8452640 1 -- --> v1:10.20.193.23:6789/0 -- auth(proto 0 28 bytes epoch 0) -- 0x7f47c0146d30 con 0x7f47c00b7960 2026-02-22T21:35:26.582 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.576+0000 7f47c61c7640 1 --1- >> v1:10.20.193.23:6789/0 conn(0x7f47c00b7960 0x7f47c00b7d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.23:6789/0 says I am v1:10.20.193.23:43472/0 (socket says 10.20.193.23:43472) 2026-02-22T21:35:26.582 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.576+0000 7f47c61c7640 1 -- 10.20.193.23:0/3041113118 learned_addr learned my addr 10.20.193.23:0/3041113118 (peer_addr_for_me v1:10.20.193.23:0/0) 2026-02-22T21:35:26.582 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.576+0000 7f47c51c5640 1 -- 10.20.193.23:0/3041113118 <== mon.0 v1:10.20.193.23:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 985570257 0 0) 0x7f47c0146d30 con 0x7f47c00b7960 2026-02-22T21:35:26.582 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.576+0000 7f47c51c5640 1 -- 10.20.193.23:0/3041113118 --> v1:10.20.193.23:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47a8003630 con 0x7f47c00b7960 2026-02-22T21:35:26.582 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.576+0000 7f47c51c5640 1 -- 10.20.193.23:0/3041113118 <== mon.0 v1:10.20.193.23:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4072527558 0 0) 0x7f47a8003630 con 0x7f47c00b7960 2026-02-22T21:35:26.582 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.576+0000 7f47c51c5640 1 -- 10.20.193.23:0/3041113118 --> v1:10.20.193.23:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47c00b8450 con 0x7f47c00b7960 2026-02-22T21:35:26.582 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.576+0000 7f47c51c5640 1 -- 10.20.193.23:0/3041113118 --> v1:10.20.193.23:6789/0 -- auth(proto 2 2 bytes epoch 0) -- 0x7f47c0146d30 con 0x7f47c00b7960 2026-02-22T21:35:26.582 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.576+0000 7f47c51c5640 1 -- 10.20.193.23:0/3041113118 <== mon.0 v1:10.20.193.23:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7f47b0002e20 con 0x7f47c00b7960 2026-02-22T21:35:26.582 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.576+0000 7f47c51c5640 1 -- 10.20.193.23:0/3041113118 <== mon.0 v1:10.20.193.23:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f47b0003090 con 0x7f47c00b7960 2026-02-22T21:35:26.582 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.576+0000 7f47c51c5640 1 -- 10.20.193.23:0/3041113118 <== mon.0 v1:10.20.193.23:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7f47b0003490 con 0x7f47c00b7960 2026-02-22T21:35:26.582 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.576+0000 7f47c51c5640 1 -- 10.20.193.23:0/3041113118 <== mon.0 v1:10.20.193.23:6789/0 6 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (unknown 2552100684 0 0) 0x7f47c0146d30 con 0x7f47c00b7960 2026-02-22T21:35:26.582 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.576+0000 7f47c8452640 1 -- 10.20.193.23:0/3041113118 >> v1:10.20.193.23:6789/0 conn(0x7f47c00b7960 legacy=0x7f47c00b7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:35:26.583 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.576+0000 7f47c8452640 1 -- 10.20.193.23:0/3041113118 shutdown_connections 2026-02-22T21:35:26.583 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.576+0000 7f47c8452640 1 -- 10.20.193.23:0/3041113118 >> 10.20.193.23:0/3041113118 conn(0x7f47c006c870 msgr2=0x7f47c006cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:35:26.583 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.576+0000 7f47c8452640 1 -- 10.20.193.23:0/3041113118 shutdown_connections 2026-02-22T21:35:26.583 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.576+0000 7f47c8452640 1 -- 10.20.193.23:0/3041113118 wait complete. 2026-02-22T21:35:26.585 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.576+0000 7f47c8452640 1 Processor -- start 2026-02-22T21:35:26.585 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.576+0000 7f47c8452640 1 -- start start 2026-02-22T21:35:26.585 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.576+0000 7f47c8452640 1 -- --> v1:10.20.193.23:6789/0 -- auth(proto 0 28 bytes epoch 0) -- 0x7f47c01d1d00 con 0x7f47c00b7960 2026-02-22T21:35:26.585 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.576+0000 7f47c61c7640 1 --1- >> v1:10.20.193.23:6789/0 conn(0x7f47c00b7960 0x7f47c01d2570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.23:6789/0 says I am v1:10.20.193.23:43474/0 (socket says 10.20.193.23:43474) 2026-02-22T21:35:26.585 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.576+0000 7f47c61c7640 1 -- 10.20.193.23:0/99371710 learned_addr learned my addr 10.20.193.23:0/99371710 (peer_addr_for_me v1:10.20.193.23:0/0) 2026-02-22T21:35:26.585 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.576+0000 7f47a77fe640 1 -- 10.20.193.23:0/99371710 <== mon.0 v1:10.20.193.23:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3043569075 0 0) 0x7f47c01d1d00 con 0x7f47c00b7960 2026-02-22T21:35:26.585 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.576+0000 7f47a77fe640 1 -- 10.20.193.23:0/99371710 --> v1:10.20.193.23:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f479c003630 con 0x7f47c00b7960 2026-02-22T21:35:26.585 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.576+0000 7f47a77fe640 1 -- 10.20.193.23:0/99371710 <== mon.0 v1:10.20.193.23:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 732+0+0 (unknown 1786363768 0 0) 0x7f479c003630 con 0x7f47c00b7960 2026-02-22T21:35:26.585 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.576+0000 7f47a77fe640 1 -- 10.20.193.23:0/99371710 --> v1:10.20.193.23:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f47c01d1d00 con 0x7f47c00b7960 2026-02-22T21:35:26.585 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.576+0000 7f47a77fe640 1 -- 10.20.193.23:0/99371710 <== mon.0 v1:10.20.193.23:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7f47b0003240 con 0x7f47c00b7960 2026-02-22T21:35:26.585 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.576+0000 7f47a77fe640 1 -- 10.20.193.23:0/99371710 <== mon.0 v1:10.20.193.23:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 548+0+0 (unknown 1467757283 0 0) 0x7f47c01d1d00 con 0x7f47c00b7960 2026-02-22T21:35:26.585 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.576+0000 7f47a77fe640 1 -- 10.20.193.23:0/99371710 --> v1:10.20.193.23:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47c01d18f0 con 0x7f47c00b7960 2026-02-22T21:35:26.585 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.576+0000 7f47a77fe640 1 -- 10.20.193.23:0/99371710 --> v1:10.20.193.23:6789/0 -- auth(proto 2 2 bytes epoch 0) -- 0x7f479c003630 con 0x7f47c00b7960 2026-02-22T21:35:26.586 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.576+0000 7f47c8452640 1 -- 10.20.193.23:0/99371710 --> v1:10.20.193.23:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f47c00ae6f0 con 0x7f47c00b7960 2026-02-22T21:35:26.586 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.576+0000 7f47c8452640 1 -- 10.20.193.23:0/99371710 --> v1:10.20.193.23:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f47c00aeaf0 con 0x7f47c00b7960 2026-02-22T21:35:26.586 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.576+0000 7f47a77fe640 1 -- 10.20.193.23:0/99371710 <== mon.0 v1:10.20.193.23:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f47b0004b80 con 0x7f47c00b7960 2026-02-22T21:35:26.586 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.576+0000 7f47a77fe640 1 -- 10.20.193.23:0/99371710 <== mon.0 v1:10.20.193.23:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7f47b0004f00 con 0x7f47c00b7960 2026-02-22T21:35:26.586 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.576+0000 7f47a77fe640 1 -- 10.20.193.23:0/99371710 <== mon.0 v1:10.20.193.23:6789/0 7 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (unknown 4038729523 0 0) 0x7f47c00ae6f0 con 0x7f47c00b7960 2026-02-22T21:35:26.586 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.580+0000 7f47c8452640 1 -- 10.20.193.23:0/99371710 --> v1:10.20.193.23:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47c01d3070 con 0x7f47c00b7960 2026-02-22T21:35:26.586 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.580+0000 7f47a77fe640 1 -- 10.20.193.23:0/99371710 <== mon.0 v1:10.20.193.23:6789/0 8 ==== mgrmap(e 4) ==== 47400+0+0 (unknown 1603120368 0 0) 0x7f47b0005290 con 0x7f47c00b7960 2026-02-22T21:35:26.586 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.580+0000 7f47a77fe640 1 -- 10.20.193.23:0/99371710 <== mon.0 v1:10.20.193.23:6789/0 9 ==== osd_map(14..14 src has 1..14) ==== 2160+0+0 (unknown 946035718 0 0) 0x7f47b0048c40 con 0x7f47c00b7960 2026-02-22T21:35:26.587 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.580+0000 7f47a77fe640 1 -- 10.20.193.23:0/99371710 <== mon.0 v1:10.20.193.23:6789/0 10 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (unknown 1092875540 0 3570997608) 0x7f47b00168d0 con 0x7f47c00b7960 2026-02-22T21:35:26.697 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.688+0000 7f47c8452640 1 -- 10.20.193.23:0/99371710 --> v1:10.20.193.23:6789/0 -- mon_command({"prefix": "config-key get", "key": "mgr/test-foo"} v 0) -- 0x7f47c00a1660 con 0x7f47c00b7960 2026-02-22T21:35:26.697 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.692+0000 7f47c61c7640 1 -- 10.20.193.23:0/99371710 >> v1:10.20.193.23:6789/0 conn(0x7f47c00b7960 legacy=0x7f47c01d2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2026-02-22T21:35:26.697 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.692+0000 7f47c61c7640 1 -- 10.20.193.23:0/99371710 >> v1:10.20.193.23:6789/0 conn(0x7f47c00b7960 legacy=0x7f47c01d2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T21:35:26.697 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.692+0000 7f47c61c7640 1 --1- 10.20.193.23:0/99371710 >> v1:10.20.193.23:6789/0 conn(0x7f47c00b7960 0x7f47c01d2570 :-1 s=OPENED pgs=181 cs=1 l=1).handle_message read tag failed 2026-02-22T21:35:26.697 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.692+0000 7f47c61c7640 1 --1- 10.20.193.23:0/99371710 >> v1:10.20.193.23:6789/0 conn(0x7f47c00b7960 0x7f47c01d2570 :-1 s=OPENED pgs=181 cs=1 l=1).fault on lossy channel, failing 2026-02-22T21:35:26.697 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.692+0000 7f47a77fe640 1 -- 10.20.193.23:0/99371710 >> v1:10.20.193.23:6789/0 conn(0x7f47c00b7960 legacy=0x7f47c01d2570 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T21:35:26.697 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.692+0000 7f47a77fe640 1 -- 10.20.193.23:0/99371710 --> v1:10.20.193.23:6789/0 -- auth(proto 0 28 bytes epoch 1) -- 0x7f47c00ae6f0 con 0x7f479c041380 2026-02-22T21:35:26.697 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.692+0000 7f47a77fe640 1 -- 10.20.193.23:0/99371710 <== mon.0 v1:10.20.193.23:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2146870175 0 0) 0x7f47c00ae6f0 con 0x7f479c041380 2026-02-22T21:35:26.697 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.692+0000 7f47a77fe640 1 -- 10.20.193.23:0/99371710 --> v1:10.20.193.23:6789/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7f479c045220 con 0x7f479c041380 2026-02-22T21:35:26.697 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.692+0000 7f47c61c7640 1 -- 10.20.193.23:0/99371710 >> v1:10.20.193.23:6789/0 conn(0x7f479c041380 legacy=0x7f479c0437b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2026-02-22T21:35:26.697 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.692+0000 7f47c61c7640 1 -- 10.20.193.23:0/99371710 >> v1:10.20.193.23:6789/0 conn(0x7f479c041380 legacy=0x7f479c0437b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T21:35:26.697 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.692+0000 7f47c61c7640 1 --1- 10.20.193.23:0/99371710 >> v1:10.20.193.23:6789/0 conn(0x7f479c041380 0x7f479c0437b0 :-1 s=OPENED pgs=182 cs=1 l=1).handle_message read tag failed 2026-02-22T21:35:26.697 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.692+0000 7f47a77fe640 1 -- 10.20.193.23:0/99371710 <== mon.0 v1:10.20.193.23:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (unknown 2196888775 0 0) 0x7f479c045220 con 0x7f479c041380 2026-02-22T21:35:26.697 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.692+0000 7f47c61c7640 1 --1- 10.20.193.23:0/99371710 >> v1:10.20.193.23:6789/0 conn(0x7f479c041380 0x7f479c0437b0 :-1 s=OPENED pgs=182 cs=1 l=1).fault on lossy channel, failing 2026-02-22T21:35:26.697 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.692+0000 7f47a77fe640 1 -- 10.20.193.23:0/99371710 --> v1:10.20.193.23:6789/0 -- mon_subscribe({config=0+,mgrmap=0+,monmap=2+}) -- 0x7f47c01d1d00 con 0x7f479c041380 2026-02-22T21:35:26.697 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.692+0000 7f47a77fe640 1 -- 10.20.193.23:0/99371710 --> v1:10.20.193.23:6789/0 -- mon_command({"prefix": "config-key get", "key": "mgr/test-foo"} v 0) -- 0x7f47c01d1d00 con 0x7f479c041380 2026-02-22T21:35:26.697 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.692+0000 7f47a77fe640 1 -- 10.20.193.23:0/99371710 >> v1:10.20.193.23:6789/0 conn(0x7f479c041380 legacy=0x7f479c0437b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T21:35:26.697 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.692+0000 7f47a77fe640 1 -- 10.20.193.23:0/99371710 --> v1:10.20.193.23:6789/0 -- auth(proto 0 28 bytes epoch 1) -- 0x7f479c045220 con 0x7f47c00b7960 2026-02-22T21:35:26.697 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.692+0000 7f47a77fe640 1 -- 10.20.193.23:0/99371710 <== mon.0 v1:10.20.193.23:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3067929855 0 0) 0x7f479c045220 con 0x7f47c00b7960 2026-02-22T21:35:26.697 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.692+0000 7f47a77fe640 1 -- 10.20.193.23:0/99371710 --> v1:10.20.193.23:6789/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7f47c00ae6f0 con 0x7f47c00b7960 2026-02-22T21:35:26.698 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.692+0000 7f47a77fe640 1 -- 10.20.193.23:0/99371710 <== mon.0 v1:10.20.193.23:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (unknown 3704967468 0 0) 0x7f47c00ae6f0 con 0x7f47c00b7960 2026-02-22T21:35:26.698 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.692+0000 7f47a77fe640 1 -- 10.20.193.23:0/99371710 --> v1:10.20.193.23:6789/0 -- mon_subscribe({config=0+,mgrmap=0+,monmap=2+}) -- 0x7f47c01d1d00 con 0x7f47c00b7960 2026-02-22T21:35:26.698 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.692+0000 7f47a77fe640 1 -- 10.20.193.23:0/99371710 --> v1:10.20.193.23:6789/0 -- mon_command({"prefix": "config-key get", "key": "mgr/test-foo"} v 0) -- 0x7f479c045220 con 0x7f47c00b7960 2026-02-22T21:35:26.698 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.692+0000 7f47a77fe640 1 -- 10.20.193.23:0/99371710 <== mon.0 v1:10.20.193.23:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7f47b00055b0 con 0x7f47c00b7960 2026-02-22T21:35:26.698 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.692+0000 7f47a77fe640 1 -- 10.20.193.23:0/99371710 <== mon.0 v1:10.20.193.23:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f47b00470a0 con 0x7f47c00b7960 2026-02-22T21:35:26.698 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.692+0000 7f47a77fe640 1 -- 10.20.193.23:0/99371710 <== mon.0 v1:10.20.193.23:6789/0 5 ==== mgrmap(e 4) ==== 47400+0+0 (unknown 1603120368 0 0) 0x7f47b0047420 con 0x7f47c00b7960 2026-02-22T21:35:26.698 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.692+0000 7f47a77fe640 1 -- 10.20.193.23:0/99371710 <== mon.0 v1:10.20.193.23:6789/0 6 ==== mon_command_ack([{"prefix": "config-key get", "key": "mgr/test-foo"}]=-13 access denied v0) ==== 98+0+0 (unknown 1738449250 0 0) 0x7f47b004c940 con 0x7f47c00b7960 2026-02-22T21:35:26.698 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:26.701 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:26.701 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name osd.100 config-key get device/test-foo 2026-02-22T21:35:26.701 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:26.701 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name osd.100 config-key get device/test-foo 2026-02-22T21:35:26.755 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.748+0000 7fda91e56640 -1 auth: unable to find a keyring on /var/lib/ceph/osd/ceph-100/keyring: (13) Permission denied 2026-02-22T21:35:26.755 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.748+0000 7fda91e56640 1 Processor -- start 2026-02-22T21:35:26.755 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.748+0000 7fda91e56640 1 -- start start 2026-02-22T21:35:26.757 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.748+0000 7fda91e56640 1 -- --> v1:10.20.193.23:6789/0 -- auth(proto 0 28 bytes epoch 0) -- 0x7fda8c0b78f0 con 0x7fda8c0b2020 2026-02-22T21:35:26.757 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.748+0000 7fda8b7fe640 1 --1- >> v1:10.20.193.23:6789/0 conn(0x7fda8c0b2020 0x7fda8c0b7010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.23:6789/0 says I am v1:10.20.193.23:43496/0 (socket says 10.20.193.23:43496) 2026-02-22T21:35:26.757 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.748+0000 7fda8b7fe640 1 -- 10.20.193.23:0/2662355243 learned_addr learned my addr 10.20.193.23:0/2662355243 (peer_addr_for_me v1:10.20.193.23:0/0) 2026-02-22T21:35:26.757 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.748+0000 7fda8a7fc640 1 -- 10.20.193.23:0/2662355243 <== mon.0 v1:10.20.193.23:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 334021452 0 0) 0x7fda8c0b78f0 con 0x7fda8c0b2020 2026-02-22T21:35:26.757 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.748+0000 7fda8a7fc640 1 -- 10.20.193.23:0/2662355243 --> v1:10.20.193.23:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda70003630 con 0x7fda8c0b2020 2026-02-22T21:35:26.757 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.748+0000 7fda8a7fc640 1 -- 10.20.193.23:0/2662355243 <== mon.0 v1:10.20.193.23:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3723379966 0 0) 0x7fda70003630 con 0x7fda8c0b2020 2026-02-22T21:35:26.758 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.748+0000 7fda8a7fc640 1 -- 10.20.193.23:0/2662355243 --> v1:10.20.193.23:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda8c0adb10 con 0x7fda8c0b2020 2026-02-22T21:35:26.758 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.748+0000 7fda8a7fc640 1 -- 10.20.193.23:0/2662355243 --> v1:10.20.193.23:6789/0 -- auth(proto 2 2 bytes epoch 0) -- 0x7fda8c0b78f0 con 0x7fda8c0b2020 2026-02-22T21:35:26.758 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.748+0000 7fda8a7fc640 1 -- 10.20.193.23:0/2662355243 <== mon.0 v1:10.20.193.23:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7fda78002e20 con 0x7fda8c0b2020 2026-02-22T21:35:26.758 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.748+0000 7fda8a7fc640 1 -- 10.20.193.23:0/2662355243 <== mon.0 v1:10.20.193.23:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fda78003090 con 0x7fda8c0b2020 2026-02-22T21:35:26.758 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.748+0000 7fda8a7fc640 1 -- 10.20.193.23:0/2662355243 <== mon.0 v1:10.20.193.23:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7fda78003490 con 0x7fda8c0b2020 2026-02-22T21:35:26.758 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.748+0000 7fda8a7fc640 1 -- 10.20.193.23:0/2662355243 <== mon.0 v1:10.20.193.23:6789/0 6 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (unknown 3995201727 0 0) 0x7fda8c0b78f0 con 0x7fda8c0b2020 2026-02-22T21:35:26.758 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.748+0000 7fda91e56640 1 -- 10.20.193.23:0/2662355243 >> v1:10.20.193.23:6789/0 conn(0x7fda8c0b2020 legacy=0x7fda8c0b7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:35:26.758 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.748+0000 7fda91e56640 1 -- 10.20.193.23:0/2662355243 shutdown_connections 2026-02-22T21:35:26.758 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.748+0000 7fda91e56640 1 -- 10.20.193.23:0/2662355243 >> 10.20.193.23:0/2662355243 conn(0x7fda8c074560 msgr2=0x7fda8c074970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:35:26.758 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.748+0000 7fda91e56640 1 -- 10.20.193.23:0/2662355243 shutdown_connections 2026-02-22T21:35:26.759 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.748+0000 7fda91e56640 1 -- 10.20.193.23:0/2662355243 wait complete. 2026-02-22T21:35:26.761 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.752+0000 7fda91e56640 1 Processor -- start 2026-02-22T21:35:26.761 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.752+0000 7fda91e56640 1 -- start start 2026-02-22T21:35:26.761 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.752+0000 7fda91e56640 1 -- --> v1:10.20.193.23:6789/0 -- auth(proto 0 28 bytes epoch 0) -- 0x7fda8c0c2180 con 0x7fda8c0b2020 2026-02-22T21:35:26.761 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.752+0000 7fda8b7fe640 1 --1- >> v1:10.20.193.23:6789/0 conn(0x7fda8c0b2020 0x7fda8c0b5350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.23:6789/0 says I am v1:10.20.193.23:43500/0 (socket says 10.20.193.23:43500) 2026-02-22T21:35:26.761 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.752+0000 7fda8b7fe640 1 -- 10.20.193.23:0/4118519346 learned_addr learned my addr 10.20.193.23:0/4118519346 (peer_addr_for_me v1:10.20.193.23:0/0) 2026-02-22T21:35:26.761 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.752+0000 7fda88ff9640 1 -- 10.20.193.23:0/4118519346 <== mon.0 v1:10.20.193.23:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 523877629 0 0) 0x7fda8c0c2180 con 0x7fda8c0b2020 2026-02-22T21:35:26.761 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.752+0000 7fda88ff9640 1 -- 10.20.193.23:0/4118519346 --> v1:10.20.193.23:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda60003630 con 0x7fda8c0b2020 2026-02-22T21:35:26.761 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.752+0000 7fda88ff9640 1 -- 10.20.193.23:0/4118519346 <== mon.0 v1:10.20.193.23:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 732+0+0 (unknown 2895819777 0 0) 0x7fda60003630 con 0x7fda8c0b2020 2026-02-22T21:35:26.761 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.752+0000 7fda88ff9640 1 -- 10.20.193.23:0/4118519346 --> v1:10.20.193.23:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fda8c0c2180 con 0x7fda8c0b2020 2026-02-22T21:35:26.761 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.752+0000 7fda88ff9640 1 -- 10.20.193.23:0/4118519346 <== mon.0 v1:10.20.193.23:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7fda780028c0 con 0x7fda8c0b2020 2026-02-22T21:35:26.762 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.752+0000 7fda88ff9640 1 -- 10.20.193.23:0/4118519346 <== mon.0 v1:10.20.193.23:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 548+0+0 (unknown 3188425112 0 0) 0x7fda8c0c2180 con 0x7fda8c0b2020 2026-02-22T21:35:26.762 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.752+0000 7fda88ff9640 1 -- 10.20.193.23:0/4118519346 --> v1:10.20.193.23:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda8c090a70 con 0x7fda8c0b2020 2026-02-22T21:35:26.762 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.752+0000 7fda88ff9640 1 -- 10.20.193.23:0/4118519346 --> v1:10.20.193.23:6789/0 -- auth(proto 2 2 bytes epoch 0) -- 0x7fda60003630 con 0x7fda8c0b2020 2026-02-22T21:35:26.762 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.752+0000 7fda91e56640 1 -- 10.20.193.23:0/4118519346 --> v1:10.20.193.23:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fda8c150650 con 0x7fda8c0b2020 2026-02-22T21:35:26.762 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.752+0000 7fda91e56640 1 -- 10.20.193.23:0/4118519346 --> v1:10.20.193.23:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fda8c0a5ab0 con 0x7fda8c0b2020 2026-02-22T21:35:26.762 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.752+0000 7fda88ff9640 1 -- 10.20.193.23:0/4118519346 <== mon.0 v1:10.20.193.23:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fda78002e10 con 0x7fda8c0b2020 2026-02-22T21:35:26.762 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.752+0000 7fda88ff9640 1 -- 10.20.193.23:0/4118519346 <== mon.0 v1:10.20.193.23:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7fda78004fa0 con 0x7fda8c0b2020 2026-02-22T21:35:26.762 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.752+0000 7fda88ff9640 1 -- 10.20.193.23:0/4118519346 <== mon.0 v1:10.20.193.23:6789/0 7 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (unknown 2256935104 0 0) 0x7fda8c0a5ab0 con 0x7fda8c0b2020 2026-02-22T21:35:26.762 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.752+0000 7fda88ff9640 1 -- 10.20.193.23:0/4118519346 <== mon.0 v1:10.20.193.23:6789/0 8 ==== mgrmap(e 4) ==== 47400+0+0 (unknown 1603120368 0 0) 0x7fda78005140 con 0x7fda8c0b2020 2026-02-22T21:35:26.762 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.752+0000 7fda91e56640 1 -- 10.20.193.23:0/4118519346 --> v1:10.20.193.23:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda8c06dca0 con 0x7fda8c0b2020 2026-02-22T21:35:26.762 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.752+0000 7fda88ff9640 1 -- 10.20.193.23:0/4118519346 <== mon.0 v1:10.20.193.23:6789/0 9 ==== osd_map(14..14 src has 1..14) ==== 2160+0+0 (unknown 946035718 0 0) 0x7fda78048dc0 con 0x7fda8c0b2020 2026-02-22T21:35:26.763 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.756+0000 7fda88ff9640 1 -- 10.20.193.23:0/4118519346 <== mon.0 v1:10.20.193.23:6789/0 10 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (unknown 1092875540 0 3570997608) 0x7fda78016a50 con 0x7fda8c0b2020 2026-02-22T21:35:26.880 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.872+0000 7fda91e56640 1 -- 10.20.193.23:0/4118519346 --> v1:10.20.193.23:6789/0 -- mon_command({"prefix": "config-key get", "key": "device/test-foo"} v 0) -- 0x7fda8c0ad680 con 0x7fda8c0b2020 2026-02-22T21:35:26.880 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.872+0000 7fda88ff9640 1 -- 10.20.193.23:0/4118519346 <== mon.0 v1:10.20.193.23:6789/0 11 ==== mon_command_ack([{"prefix": "config-key get", "key": "device/test-foo"}]=-13 access denied v0) ==== 101+0+0 (unknown 3359981662 0 0) 0x7fda78016350 con 0x7fda8c0b2020 2026-02-22T21:35:26.880 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:26.884 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:26.884 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name osd.100 config-key get test/foo 2026-02-22T21:35:26.884 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:26.884 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name osd.100 config-key get test/foo 2026-02-22T21:35:26.937 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.928+0000 7f3e7df74640 -1 auth: unable to find a keyring on /var/lib/ceph/osd/ceph-100/keyring: (13) Permission denied 2026-02-22T21:35:26.938 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.932+0000 7f3e7df74640 1 Processor -- start 2026-02-22T21:35:26.938 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.932+0000 7f3e7df74640 1 -- start start 2026-02-22T21:35:26.938 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.932+0000 7f3e7df74640 1 -- --> v1:10.20.193.23:6789/0 -- auth(proto 0 28 bytes epoch 0) -- 0x7f3e780b78f0 con 0x7f3e780b2020 2026-02-22T21:35:26.938 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.932+0000 7f3e777fe640 1 --1- >> v1:10.20.193.23:6789/0 conn(0x7f3e780b2020 0x7f3e780b7010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.23:6789/0 says I am v1:10.20.193.23:43508/0 (socket says 10.20.193.23:43508) 2026-02-22T21:35:26.938 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.932+0000 7f3e777fe640 1 -- 10.20.193.23:0/386718824 learned_addr learned my addr 10.20.193.23:0/386718824 (peer_addr_for_me v1:10.20.193.23:0/0) 2026-02-22T21:35:26.940 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.932+0000 7f3e767fc640 1 -- 10.20.193.23:0/386718824 <== mon.0 v1:10.20.193.23:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3369796288 0 0) 0x7f3e780b78f0 con 0x7f3e780b2020 2026-02-22T21:35:26.940 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.932+0000 7f3e767fc640 1 -- 10.20.193.23:0/386718824 --> v1:10.20.193.23:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e5c003630 con 0x7f3e780b2020 2026-02-22T21:35:26.940 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.932+0000 7f3e767fc640 1 -- 10.20.193.23:0/386718824 <== mon.0 v1:10.20.193.23:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1732720662 0 0) 0x7f3e5c003630 con 0x7f3e780b2020 2026-02-22T21:35:26.940 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.932+0000 7f3e767fc640 1 -- 10.20.193.23:0/386718824 --> v1:10.20.193.23:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e780adb10 con 0x7f3e780b2020 2026-02-22T21:35:26.940 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.932+0000 7f3e767fc640 1 -- 10.20.193.23:0/386718824 --> v1:10.20.193.23:6789/0 -- auth(proto 2 2 bytes epoch 0) -- 0x7f3e780b78f0 con 0x7f3e780b2020 2026-02-22T21:35:26.941 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.932+0000 7f3e767fc640 1 -- 10.20.193.23:0/386718824 <== mon.0 v1:10.20.193.23:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7f3e64002e20 con 0x7f3e780b2020 2026-02-22T21:35:26.941 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.932+0000 7f3e767fc640 1 -- 10.20.193.23:0/386718824 <== mon.0 v1:10.20.193.23:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3e64003090 con 0x7f3e780b2020 2026-02-22T21:35:26.941 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.932+0000 7f3e767fc640 1 -- 10.20.193.23:0/386718824 <== mon.0 v1:10.20.193.23:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7f3e64003490 con 0x7f3e780b2020 2026-02-22T21:35:26.941 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.932+0000 7f3e767fc640 1 -- 10.20.193.23:0/386718824 <== mon.0 v1:10.20.193.23:6789/0 6 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (unknown 1064181825 0 0) 0x7f3e780b78f0 con 0x7f3e780b2020 2026-02-22T21:35:26.941 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.932+0000 7f3e7df74640 1 -- 10.20.193.23:0/386718824 >> v1:10.20.193.23:6789/0 conn(0x7f3e780b2020 legacy=0x7f3e780b7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:35:26.941 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.932+0000 7f3e7df74640 1 -- 10.20.193.23:0/386718824 shutdown_connections 2026-02-22T21:35:26.941 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.932+0000 7f3e7df74640 1 -- 10.20.193.23:0/386718824 >> 10.20.193.23:0/386718824 conn(0x7f3e78074560 msgr2=0x7f3e78074970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:35:26.941 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.932+0000 7f3e7df74640 1 -- 10.20.193.23:0/386718824 shutdown_connections 2026-02-22T21:35:26.941 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.932+0000 7f3e7df74640 1 -- 10.20.193.23:0/386718824 wait complete. 2026-02-22T21:35:26.941 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.932+0000 7f3e7df74640 1 Processor -- start 2026-02-22T21:35:26.942 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.932+0000 7f3e7df74640 1 -- start start 2026-02-22T21:35:26.944 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.936+0000 7f3e7df74640 1 -- --> v1:10.20.193.23:6789/0 -- auth(proto 0 28 bytes epoch 0) -- 0x7f3e780c2180 con 0x7f3e780b2020 2026-02-22T21:35:26.944 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.936+0000 7f3e777fe640 1 --1- >> v1:10.20.193.23:6789/0 conn(0x7f3e780b2020 0x7f3e780b5350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.23:6789/0 says I am v1:10.20.193.23:43518/0 (socket says 10.20.193.23:43518) 2026-02-22T21:35:26.944 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.936+0000 7f3e777fe640 1 -- 10.20.193.23:0/2305908708 learned_addr learned my addr 10.20.193.23:0/2305908708 (peer_addr_for_me v1:10.20.193.23:0/0) 2026-02-22T21:35:26.944 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.936+0000 7f3e74ff9640 1 -- 10.20.193.23:0/2305908708 <== mon.0 v1:10.20.193.23:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2189530608 0 0) 0x7f3e780c2180 con 0x7f3e780b2020 2026-02-22T21:35:26.945 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.936+0000 7f3e74ff9640 1 -- 10.20.193.23:0/2305908708 --> v1:10.20.193.23:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e4c003630 con 0x7f3e780b2020 2026-02-22T21:35:26.945 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.936+0000 7f3e74ff9640 1 -- 10.20.193.23:0/2305908708 <== mon.0 v1:10.20.193.23:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 732+0+0 (unknown 839789103 0 0) 0x7f3e4c003630 con 0x7f3e780b2020 2026-02-22T21:35:26.945 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.936+0000 7f3e74ff9640 1 -- 10.20.193.23:0/2305908708 --> v1:10.20.193.23:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3e780c2180 con 0x7f3e780b2020 2026-02-22T21:35:26.945 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.936+0000 7f3e74ff9640 1 -- 10.20.193.23:0/2305908708 <== mon.0 v1:10.20.193.23:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7f3e640028c0 con 0x7f3e780b2020 2026-02-22T21:35:26.945 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.936+0000 7f3e74ff9640 1 -- 10.20.193.23:0/2305908708 <== mon.0 v1:10.20.193.23:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 548+0+0 (unknown 4051366534 0 0) 0x7f3e780c2180 con 0x7f3e780b2020 2026-02-22T21:35:26.945 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.936+0000 7f3e74ff9640 1 -- 10.20.193.23:0/2305908708 --> v1:10.20.193.23:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e78090a70 con 0x7f3e780b2020 2026-02-22T21:35:26.945 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.936+0000 7f3e74ff9640 1 -- 10.20.193.23:0/2305908708 --> v1:10.20.193.23:6789/0 -- auth(proto 2 2 bytes epoch 0) -- 0x7f3e4c003630 con 0x7f3e780b2020 2026-02-22T21:35:26.945 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.936+0000 7f3e7df74640 1 -- 10.20.193.23:0/2305908708 --> v1:10.20.193.23:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3e78150650 con 0x7f3e780b2020 2026-02-22T21:35:26.945 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.936+0000 7f3e777fe640 1 -- 10.20.193.23:0/2305908708 >> v1:10.20.193.23:6789/0 conn(0x7f3e780b2020 legacy=0x7f3e780b5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2026-02-22T21:35:26.945 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.936+0000 7f3e7df74640 1 -- 10.20.193.23:0/2305908708 --> v1:10.20.193.23:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3e780a5ab0 con 0x7f3e780b2020 2026-02-22T21:35:26.945 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.936+0000 7f3e777fe640 1 -- 10.20.193.23:0/2305908708 >> v1:10.20.193.23:6789/0 conn(0x7f3e780b2020 legacy=0x7f3e780b5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T21:35:26.946 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.936+0000 7f3e777fe640 1 --1- 10.20.193.23:0/2305908708 >> v1:10.20.193.23:6789/0 conn(0x7f3e780b2020 0x7f3e780b5350 :-1 s=OPENED pgs=187 cs=1 l=1).handle_message read tag failed 2026-02-22T21:35:26.946 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.936+0000 7f3e777fe640 1 --1- 10.20.193.23:0/2305908708 >> v1:10.20.193.23:6789/0 conn(0x7f3e780b2020 0x7f3e780b5350 :-1 s=OPENED pgs=187 cs=1 l=1).fault on lossy channel, failing 2026-02-22T21:35:26.946 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.936+0000 7f3e74ff9640 1 -- 10.20.193.23:0/2305908708 >> v1:10.20.193.23:6789/0 conn(0x7f3e780b2020 legacy=0x7f3e780b5350 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T21:35:26.946 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.936+0000 7f3e74ff9640 1 -- 10.20.193.23:0/2305908708 --> v1:10.20.193.23:6789/0 -- auth(proto 0 28 bytes epoch 1) -- 0x7f3e780c2180 con 0x7f3e4c004910 2026-02-22T21:35:26.946 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.936+0000 7f3e74ff9640 1 -- 10.20.193.23:0/2305908708 <== mon.0 v1:10.20.193.23:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 347105979 0 0) 0x7f3e780c2180 con 0x7f3e4c004910 2026-02-22T21:35:26.946 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.936+0000 7f3e74ff9640 1 -- 10.20.193.23:0/2305908708 --> v1:10.20.193.23:6789/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7f3e4c008ac0 con 0x7f3e4c004910 2026-02-22T21:35:26.946 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.936+0000 7f3e74ff9640 1 -- 10.20.193.23:0/2305908708 <== mon.0 v1:10.20.193.23:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (unknown 1521694045 0 0) 0x7f3e4c008ac0 con 0x7f3e4c004910 2026-02-22T21:35:26.946 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.936+0000 7f3e74ff9640 1 -- 10.20.193.23:0/2305908708 --> v1:10.20.193.23:6789/0 -- mon_subscribe({config=0+,mgrmap=0+,monmap=2+,osdmap=0}) -- 0x7f3e4c009ad0 con 0x7f3e4c004910 2026-02-22T21:35:26.946 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.936+0000 7f3e74ff9640 1 -- 10.20.193.23:0/2305908708 --> v1:10.20.193.23:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e7806dca0 con 0x7f3e4c004910 2026-02-22T21:35:26.946 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.936+0000 7f3e74ff9640 1 -- 10.20.193.23:0/2305908708 --> v1:10.20.193.23:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e780c2180 con 0x7f3e4c004910 2026-02-22T21:35:26.946 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.936+0000 7f3e74ff9640 1 -- 10.20.193.23:0/2305908708 --> v1:10.20.193.23:6789/0 -- auth(proto 2 2 bytes epoch 0) -- 0x7f3e4c009700 con 0x7f3e4c004910 2026-02-22T21:35:26.946 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.936+0000 7f3e74ff9640 1 -- 10.20.193.23:0/2305908708 <== mon.0 v1:10.20.193.23:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7f3e64004dd0 con 0x7f3e4c004910 2026-02-22T21:35:26.946 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.936+0000 7f3e74ff9640 1 -- 10.20.193.23:0/2305908708 <== mon.0 v1:10.20.193.23:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3e64004f70 con 0x7f3e4c004910 2026-02-22T21:35:26.947 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.936+0000 7f3e74ff9640 1 -- 10.20.193.23:0/2305908708 <== mon.0 v1:10.20.193.23:6789/0 5 ==== mgrmap(e 4) ==== 47400+0+0 (unknown 1603120368 0 0) 0x7f3e64005120 con 0x7f3e4c004910 2026-02-22T21:35:26.947 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.936+0000 7f3e74ff9640 1 -- 10.20.193.23:0/2305908708 <== mon.0 v1:10.20.193.23:6789/0 6 ==== osd_map(14..14 src has 1..14) ==== 2160+0+0 (unknown 946035718 0 0) 0x7f3e64048d50 con 0x7f3e4c004910 2026-02-22T21:35:26.947 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.936+0000 7f3e74ff9640 1 -- 10.20.193.23:0/2305908708 <== mon.0 v1:10.20.193.23:6789/0 7 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (unknown 1092875540 0 3570997608) 0x7f3e64016a40 con 0x7f3e4c004910 2026-02-22T21:35:26.947 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.940+0000 7f3e74ff9640 1 -- 10.20.193.23:0/2305908708 <== mon.0 v1:10.20.193.23:6789/0 8 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (unknown 1092875540 0 3570997608) 0x7f3e64016340 con 0x7f3e4c004910 2026-02-22T21:35:26.947 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:26.940+0000 7f3e74ff9640 1 -- 10.20.193.23:0/2305908708 <== mon.0 v1:10.20.193.23:6789/0 9 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (unknown 1472841790 0 0) 0x7f3e7806dca0 con 0x7f3e4c004910 2026-02-22T21:35:27.055 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.048+0000 7f3e7df74640 1 -- 10.20.193.23:0/2305908708 --> v1:10.20.193.23:6789/0 -- mon_command({"prefix": "config-key get", "key": "test/foo"} v 0) -- 0x7f3e780ad680 con 0x7f3e4c004910 2026-02-22T21:35:27.056 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.048+0000 7f3e74ff9640 1 -- 10.20.193.23:0/2305908708 <== mon.0 v1:10.20.193.23:6789/0 10 ==== mon_command_ack([{"prefix": "config-key get", "key": "test/foo"}]=-13 access denied v0) ==== 94+0+0 (unknown 1363093350 0 0) 0x7f3e640471b0 con 0x7f3e4c004910 2026-02-22T21:35:27.056 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:27.060 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:27.060 INFO:tasks.workunit.client.0.trial023.stderr:+ for c in $osd_a $osd_b 2026-02-22T21:35:27.060 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name osd.200 config-key put daemon-private/osd.200/test-foo 2026-02-22T21:35:27.121 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.108+0000 7fa681f1e640 -1 auth: unable to find a keyring on /var/lib/ceph/osd/ceph-200/keyring: (13) Permission denied 2026-02-22T21:35:27.122 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.108+0000 7fa681f1e640 1 Processor -- start 2026-02-22T21:35:27.122 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.108+0000 7fa681f1e640 1 -- start start 2026-02-22T21:35:27.122 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.108+0000 7fa681f1e640 1 -- --> v1:10.20.193.23:6789/0 -- auth(proto 0 28 bytes epoch 0) -- 0x7fa67c146d30 con 0x7fa67c0b7960 2026-02-22T21:35:27.122 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.108+0000 7fa67b7fe640 1 --1- >> v1:10.20.193.23:6789/0 conn(0x7fa67c0b7960 0x7fa67c0b7d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.23:6789/0 says I am v1:10.20.193.23:43530/0 (socket says 10.20.193.23:43530) 2026-02-22T21:35:27.122 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.108+0000 7fa67b7fe640 1 -- 10.20.193.23:0/1354518085 learned_addr learned my addr 10.20.193.23:0/1354518085 (peer_addr_for_me v1:10.20.193.23:0/0) 2026-02-22T21:35:27.123 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.108+0000 7fa67a7fc640 1 -- 10.20.193.23:0/1354518085 <== mon.0 v1:10.20.193.23:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2798985616 0 0) 0x7fa67c146d30 con 0x7fa67c0b7960 2026-02-22T21:35:27.123 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.108+0000 7fa67a7fc640 1 -- 10.20.193.23:0/1354518085 --> v1:10.20.193.23:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa660003630 con 0x7fa67c0b7960 2026-02-22T21:35:27.123 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.108+0000 7fa67a7fc640 1 -- 10.20.193.23:0/1354518085 <== mon.0 v1:10.20.193.23:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1573760192 0 0) 0x7fa660003630 con 0x7fa67c0b7960 2026-02-22T21:35:27.123 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.108+0000 7fa67a7fc640 1 -- 10.20.193.23:0/1354518085 --> v1:10.20.193.23:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa67c0b8450 con 0x7fa67c0b7960 2026-02-22T21:35:27.123 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.108+0000 7fa67a7fc640 1 -- 10.20.193.23:0/1354518085 --> v1:10.20.193.23:6789/0 -- auth(proto 2 2 bytes epoch 0) -- 0x7fa67c146d30 con 0x7fa67c0b7960 2026-02-22T21:35:27.123 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.108+0000 7fa67a7fc640 1 -- 10.20.193.23:0/1354518085 <== mon.0 v1:10.20.193.23:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7fa668002e20 con 0x7fa67c0b7960 2026-02-22T21:35:27.124 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.108+0000 7fa67a7fc640 1 -- 10.20.193.23:0/1354518085 <== mon.0 v1:10.20.193.23:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa668003130 con 0x7fa67c0b7960 2026-02-22T21:35:27.124 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.108+0000 7fa67a7fc640 1 -- 10.20.193.23:0/1354518085 <== mon.0 v1:10.20.193.23:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7fa668003530 con 0x7fa67c0b7960 2026-02-22T21:35:27.124 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.108+0000 7fa67a7fc640 1 -- 10.20.193.23:0/1354518085 <== mon.0 v1:10.20.193.23:6789/0 6 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (unknown 967657848 0 0) 0x7fa67c146d30 con 0x7fa67c0b7960 2026-02-22T21:35:27.124 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.108+0000 7fa681f1e640 1 -- 10.20.193.23:0/1354518085 >> v1:10.20.193.23:6789/0 conn(0x7fa67c0b7960 legacy=0x7fa67c0b7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:35:27.124 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.108+0000 7fa681f1e640 1 -- 10.20.193.23:0/1354518085 shutdown_connections 2026-02-22T21:35:27.124 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.108+0000 7fa681f1e640 1 -- 10.20.193.23:0/1354518085 >> 10.20.193.23:0/1354518085 conn(0x7fa67c06c870 msgr2=0x7fa67c06cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:35:27.125 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.108+0000 7fa681f1e640 1 -- 10.20.193.23:0/1354518085 shutdown_connections 2026-02-22T21:35:27.125 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.108+0000 7fa681f1e640 1 -- 10.20.193.23:0/1354518085 wait complete. 2026-02-22T21:35:27.125 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.112+0000 7fa681f1e640 1 Processor -- start 2026-02-22T21:35:27.125 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.112+0000 7fa681f1e640 1 -- start start 2026-02-22T21:35:27.125 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.112+0000 7fa681f1e640 1 -- --> v1:10.20.193.23:6789/0 -- auth(proto 0 28 bytes epoch 0) -- 0x7fa67c146210 con 0x7fa67c0b7960 2026-02-22T21:35:27.125 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.112+0000 7fa67b7fe640 1 --1- >> v1:10.20.193.23:6789/0 conn(0x7fa67c0b7960 0x7fa67c13e5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.23:6789/0 says I am v1:10.20.193.23:43538/0 (socket says 10.20.193.23:43538) 2026-02-22T21:35:27.125 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.112+0000 7fa67b7fe640 1 -- 10.20.193.23:0/3798057700 learned_addr learned my addr 10.20.193.23:0/3798057700 (peer_addr_for_me v1:10.20.193.23:0/0) 2026-02-22T21:35:27.126 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.112+0000 7fa678ff9640 1 -- 10.20.193.23:0/3798057700 <== mon.0 v1:10.20.193.23:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 701614770 0 0) 0x7fa67c146210 con 0x7fa67c0b7960 2026-02-22T21:35:27.126 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.112+0000 7fa678ff9640 1 -- 10.20.193.23:0/3798057700 --> v1:10.20.193.23:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa650003630 con 0x7fa67c0b7960 2026-02-22T21:35:27.126 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.112+0000 7fa678ff9640 1 -- 10.20.193.23:0/3798057700 <== mon.0 v1:10.20.193.23:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 732+0+0 (unknown 3643489824 0 0) 0x7fa650003630 con 0x7fa67c0b7960 2026-02-22T21:35:27.126 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.112+0000 7fa678ff9640 1 -- 10.20.193.23:0/3798057700 --> v1:10.20.193.23:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa67c146210 con 0x7fa67c0b7960 2026-02-22T21:35:27.126 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.112+0000 7fa678ff9640 1 -- 10.20.193.23:0/3798057700 <== mon.0 v1:10.20.193.23:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7fa668004a00 con 0x7fa67c0b7960 2026-02-22T21:35:27.126 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.112+0000 7fa678ff9640 1 -- 10.20.193.23:0/3798057700 <== mon.0 v1:10.20.193.23:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 548+0+0 (unknown 1733813837 0 0) 0x7fa67c146210 con 0x7fa67c0b7960 2026-02-22T21:35:27.126 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.112+0000 7fa678ff9640 1 -- 10.20.193.23:0/3798057700 --> v1:10.20.193.23:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa67c0adb00 con 0x7fa67c0b7960 2026-02-22T21:35:27.127 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.112+0000 7fa678ff9640 1 -- 10.20.193.23:0/3798057700 --> v1:10.20.193.23:6789/0 -- auth(proto 2 2 bytes epoch 0) -- 0x7fa650003630 con 0x7fa67c0b7960 2026-02-22T21:35:27.127 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.112+0000 7fa681f1e640 1 -- 10.20.193.23:0/3798057700 --> v1:10.20.193.23:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa67c1d2c60 con 0x7fa67c0b7960 2026-02-22T21:35:27.127 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.112+0000 7fa681f1e640 1 -- 10.20.193.23:0/3798057700 --> v1:10.20.193.23:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa67c0af9d0 con 0x7fa67c0b7960 2026-02-22T21:35:27.127 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.112+0000 7fa678ff9640 1 -- 10.20.193.23:0/3798057700 <== mon.0 v1:10.20.193.23:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa668003130 con 0x7fa67c0b7960 2026-02-22T21:35:27.127 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.112+0000 7fa678ff9640 1 -- 10.20.193.23:0/3798057700 <== mon.0 v1:10.20.193.23:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7fa668004c40 con 0x7fa67c0b7960 2026-02-22T21:35:27.127 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.112+0000 7fa678ff9640 1 -- 10.20.193.23:0/3798057700 <== mon.0 v1:10.20.193.23:6789/0 7 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (unknown 1359651079 0 0) 0x7fa67c0af9d0 con 0x7fa67c0b7960 2026-02-22T21:35:27.127 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.112+0000 7fa681f1e640 1 -- 10.20.193.23:0/3798057700 --> v1:10.20.193.23:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa67c0008e0 con 0x7fa67c0b7960 2026-02-22T21:35:27.127 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.112+0000 7fa678ff9640 1 -- 10.20.193.23:0/3798057700 <== mon.0 v1:10.20.193.23:6789/0 8 ==== mgrmap(e 4) ==== 47400+0+0 (unknown 1603120368 0 0) 0x7fa668005010 con 0x7fa67c0b7960 2026-02-22T21:35:27.128 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.112+0000 7fa678ff9640 1 -- 10.20.193.23:0/3798057700 <== mon.0 v1:10.20.193.23:6789/0 9 ==== osd_map(14..14 src has 1..14) ==== 2160+0+0 (unknown 946035718 0 0) 0x7fa668048e80 con 0x7fa67c0b7960 2026-02-22T21:35:27.129 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.116+0000 7fa678ff9640 1 -- 10.20.193.23:0/3798057700 <== mon.0 v1:10.20.193.23:6789/0 10 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (unknown 1092875540 0 3570997608) 0x7fa668016ab0 con 0x7fa67c0b7960 2026-02-22T21:35:27.238 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.232+0000 7fa681f1e640 1 -- 10.20.193.23:0/3798057700 --> v1:10.20.193.23:6789/0 -- mon_command({"prefix": "config-key put", "key": "daemon-private/osd.200/test-foo"} v 0) -- 0x7fa67c0b9630 con 0x7fa67c0b7960 2026-02-22T21:35:27.239 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.232+0000 7fa678ff9640 1 -- 10.20.193.23:0/3798057700 <== mon.0 v1:10.20.193.23:6789/0 11 ==== mon_command_ack([{"prefix": "config-key put", "key": "daemon-private/osd.200/test-foo"}]=0 set daemon-private/osd.200/test-foo v16) ==== 139+0+0 (unknown 2005801283 0 0) 0x7fa6680163b0 con 0x7fa67c0b7960 2026-02-22T21:35:27.321 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.316+0000 7fa681f1e640 1 -- 10.20.193.23:0/3798057700 --> v1:10.20.193.23:6789/0 -- mon_command({"prefix": "config-key put", "key": "daemon-private/osd.200/test-foo"} v 0) -- 0x7fa67c0c4f10 con 0x7fa67c0b7960 2026-02-22T21:35:27.322 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.316+0000 7fa678ff9640 1 -- 10.20.193.23:0/3798057700 <== mon.0 v1:10.20.193.23:6789/0 12 ==== mon_command_ack([{"prefix": "config-key put", "key": "daemon-private/osd.200/test-foo"}]=0 set daemon-private/osd.200/test-foo v17) ==== 139+0+0 (unknown 2481956559 0 0) 0x7fa66801f580 con 0x7fa67c0b7960 2026-02-22T21:35:27.322 INFO:tasks.workunit.client.0.trial023.stderr:set daemon-private/osd.200/test-foo 2026-02-22T21:35:27.323 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.316+0000 7fa681f1e640 1 -- 10.20.193.23:0/3798057700 >> v1:10.20.193.23:6800/2834055528 conn(0x7fa65003b8a0 legacy=0x7fa65003dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:35:27.323 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.316+0000 7fa681f1e640 1 -- 10.20.193.23:0/3798057700 >> v1:10.20.193.23:6789/0 conn(0x7fa67c0b7960 legacy=0x7fa67c13e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:35:27.324 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.316+0000 7fa681f1e640 1 -- 10.20.193.23:0/3798057700 shutdown_connections 2026-02-22T21:35:27.324 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.316+0000 7fa681f1e640 1 -- 10.20.193.23:0/3798057700 >> 10.20.193.23:0/3798057700 conn(0x7fa67c06c870 msgr2=0x7fa67c0a9820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:35:27.324 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.316+0000 7fa681f1e640 1 -- 10.20.193.23:0/3798057700 shutdown_connections 2026-02-22T21:35:27.324 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.316+0000 7fa681f1e640 1 -- 10.20.193.23:0/3798057700 wait complete. 2026-02-22T21:35:27.332 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name osd.200 config-key get daemon-private/osd.200/test-foo 2026-02-22T21:35:27.386 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.376+0000 7f8ea94f8640 -1 auth: unable to find a keyring on /var/lib/ceph/osd/ceph-200/keyring: (13) Permission denied 2026-02-22T21:35:27.387 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.380+0000 7f8ea94f8640 1 Processor -- start 2026-02-22T21:35:27.387 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.380+0000 7f8ea94f8640 1 -- start start 2026-02-22T21:35:27.394 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.380+0000 7f8ea94f8640 1 -- --> v1:10.20.193.23:6789/0 -- auth(proto 0 28 bytes epoch 0) -- 0x7f8ea40b78f0 con 0x7f8ea40b2020 2026-02-22T21:35:27.394 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.380+0000 7f8ea2ffd640 1 --1- >> v1:10.20.193.23:6789/0 conn(0x7f8ea40b2020 0x7f8ea40b7010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.23:6789/0 says I am v1:10.20.193.23:43546/0 (socket says 10.20.193.23:43546) 2026-02-22T21:35:27.394 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.380+0000 7f8ea2ffd640 1 -- 10.20.193.23:0/89556998 learned_addr learned my addr 10.20.193.23:0/89556998 (peer_addr_for_me v1:10.20.193.23:0/0) 2026-02-22T21:35:27.395 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.380+0000 7f8ea1ffb640 1 -- 10.20.193.23:0/89556998 <== mon.0 v1:10.20.193.23:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1106927311 0 0) 0x7f8ea40b78f0 con 0x7f8ea40b2020 2026-02-22T21:35:27.395 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.380+0000 7f8ea1ffb640 1 -- 10.20.193.23:0/89556998 --> v1:10.20.193.23:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e90003630 con 0x7f8ea40b2020 2026-02-22T21:35:27.395 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.380+0000 7f8ea1ffb640 1 -- 10.20.193.23:0/89556998 <== mon.0 v1:10.20.193.23:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 802749894 0 0) 0x7f8e90003630 con 0x7f8ea40b2020 2026-02-22T21:35:27.395 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.380+0000 7f8ea1ffb640 1 -- 10.20.193.23:0/89556998 --> v1:10.20.193.23:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ea40adb10 con 0x7f8ea40b2020 2026-02-22T21:35:27.395 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.380+0000 7f8ea1ffb640 1 -- 10.20.193.23:0/89556998 --> v1:10.20.193.23:6789/0 -- auth(proto 2 2 bytes epoch 0) -- 0x7f8ea40b78f0 con 0x7f8ea40b2020 2026-02-22T21:35:27.395 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.380+0000 7f8ea1ffb640 1 -- 10.20.193.23:0/89556998 <== mon.0 v1:10.20.193.23:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7f8e98002e20 con 0x7f8ea40b2020 2026-02-22T21:35:27.396 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.380+0000 7f8ea1ffb640 1 -- 10.20.193.23:0/89556998 <== mon.0 v1:10.20.193.23:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8e98003090 con 0x7f8ea40b2020 2026-02-22T21:35:27.396 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.380+0000 7f8ea1ffb640 1 -- 10.20.193.23:0/89556998 <== mon.0 v1:10.20.193.23:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7f8e98003490 con 0x7f8ea40b2020 2026-02-22T21:35:27.396 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.380+0000 7f8ea1ffb640 1 -- 10.20.193.23:0/89556998 <== mon.0 v1:10.20.193.23:6789/0 6 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (unknown 3907164550 0 0) 0x7f8ea40b78f0 con 0x7f8ea40b2020 2026-02-22T21:35:27.396 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.380+0000 7f8ea94f8640 1 -- 10.20.193.23:0/89556998 >> v1:10.20.193.23:6789/0 conn(0x7f8ea40b2020 legacy=0x7f8ea40b7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:35:27.396 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.380+0000 7f8ea94f8640 1 -- 10.20.193.23:0/89556998 shutdown_connections 2026-02-22T21:35:27.396 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.380+0000 7f8ea94f8640 1 -- 10.20.193.23:0/89556998 >> 10.20.193.23:0/89556998 conn(0x7f8ea4074560 msgr2=0x7f8ea4074970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:35:27.397 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.380+0000 7f8ea94f8640 1 -- 10.20.193.23:0/89556998 shutdown_connections 2026-02-22T21:35:27.397 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.380+0000 7f8ea94f8640 1 -- 10.20.193.23:0/89556998 wait complete. 2026-02-22T21:35:27.397 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.384+0000 7f8ea94f8640 1 Processor -- start 2026-02-22T21:35:27.397 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.384+0000 7f8ea94f8640 1 -- start start 2026-02-22T21:35:27.397 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.384+0000 7f8ea94f8640 1 -- --> v1:10.20.193.23:6789/0 -- auth(proto 0 28 bytes epoch 0) -- 0x7f8ea40c2180 con 0x7f8ea40b2020 2026-02-22T21:35:27.397 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.384+0000 7f8ea2ffd640 1 --1- >> v1:10.20.193.23:6789/0 conn(0x7f8ea40b2020 0x7f8ea40b5350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.23:6789/0 says I am v1:10.20.193.23:43556/0 (socket says 10.20.193.23:43556) 2026-02-22T21:35:27.398 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.384+0000 7f8ea2ffd640 1 -- 10.20.193.23:0/3378001722 learned_addr learned my addr 10.20.193.23:0/3378001722 (peer_addr_for_me v1:10.20.193.23:0/0) 2026-02-22T21:35:27.398 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.384+0000 7f8e83fff640 1 -- 10.20.193.23:0/3378001722 <== mon.0 v1:10.20.193.23:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 79218882 0 0) 0x7f8ea40c2180 con 0x7f8ea40b2020 2026-02-22T21:35:27.398 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.384+0000 7f8e83fff640 1 -- 10.20.193.23:0/3378001722 --> v1:10.20.193.23:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e78003630 con 0x7f8ea40b2020 2026-02-22T21:35:27.398 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.384+0000 7f8e83fff640 1 -- 10.20.193.23:0/3378001722 <== mon.0 v1:10.20.193.23:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 732+0+0 (unknown 710887994 0 0) 0x7f8e78003630 con 0x7f8ea40b2020 2026-02-22T21:35:27.398 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.384+0000 7f8e83fff640 1 -- 10.20.193.23:0/3378001722 --> v1:10.20.193.23:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8ea40c2180 con 0x7f8ea40b2020 2026-02-22T21:35:27.398 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.384+0000 7f8e83fff640 1 -- 10.20.193.23:0/3378001722 <== mon.0 v1:10.20.193.23:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7f8e98003240 con 0x7f8ea40b2020 2026-02-22T21:35:27.399 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.384+0000 7f8e83fff640 1 -- 10.20.193.23:0/3378001722 <== mon.0 v1:10.20.193.23:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 548+0+0 (unknown 2655122346 0 0) 0x7f8ea40c2180 con 0x7f8ea40b2020 2026-02-22T21:35:27.399 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.384+0000 7f8e83fff640 1 -- 10.20.193.23:0/3378001722 --> v1:10.20.193.23:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ea4090a70 con 0x7f8ea40b2020 2026-02-22T21:35:27.399 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.384+0000 7f8e83fff640 1 -- 10.20.193.23:0/3378001722 --> v1:10.20.193.23:6789/0 -- auth(proto 2 2 bytes epoch 0) -- 0x7f8e78003630 con 0x7f8ea40b2020 2026-02-22T21:35:27.399 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.384+0000 7f8ea94f8640 1 -- 10.20.193.23:0/3378001722 --> v1:10.20.193.23:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8ea4150650 con 0x7f8ea40b2020 2026-02-22T21:35:27.399 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.384+0000 7f8e83fff640 1 -- 10.20.193.23:0/3378001722 <== mon.0 v1:10.20.193.23:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8e980034a0 con 0x7f8ea40b2020 2026-02-22T21:35:27.399 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.384+0000 7f8e83fff640 1 -- 10.20.193.23:0/3378001722 <== mon.0 v1:10.20.193.23:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7f8e98004f20 con 0x7f8ea40b2020 2026-02-22T21:35:27.400 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.384+0000 7f8ea94f8640 1 -- 10.20.193.23:0/3378001722 --> v1:10.20.193.23:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8ea40a5ab0 con 0x7f8ea40b2020 2026-02-22T21:35:27.400 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.384+0000 7f8e83fff640 1 -- 10.20.193.23:0/3378001722 <== mon.0 v1:10.20.193.23:6789/0 7 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (unknown 2152034809 0 0) 0x7f8ea4150650 con 0x7f8ea40b2020 2026-02-22T21:35:27.400 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.384+0000 7f8ea94f8640 1 -- 10.20.193.23:0/3378001722 --> v1:10.20.193.23:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ea406dca0 con 0x7f8ea40b2020 2026-02-22T21:35:27.400 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.384+0000 7f8e83fff640 1 -- 10.20.193.23:0/3378001722 <== mon.0 v1:10.20.193.23:6789/0 8 ==== mgrmap(e 4) ==== 47400+0+0 (unknown 1603120368 0 0) 0x7f8e98005330 con 0x7f8ea40b2020 2026-02-22T21:35:27.400 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.384+0000 7f8e83fff640 1 -- 10.20.193.23:0/3378001722 <== mon.0 v1:10.20.193.23:6789/0 9 ==== osd_map(14..14 src has 1..14) ==== 2160+0+0 (unknown 946035718 0 0) 0x7f8e98048d00 con 0x7f8ea40b2020 2026-02-22T21:35:27.401 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.388+0000 7f8e83fff640 1 -- 10.20.193.23:0/3378001722 <== mon.0 v1:10.20.193.23:6789/0 10 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (unknown 1092875540 0 3570997608) 0x7f8e98016990 con 0x7f8ea40b2020 2026-02-22T21:35:27.506 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.500+0000 7f8ea94f8640 1 -- 10.20.193.23:0/3378001722 --> v1:10.20.193.23:6789/0 -- mon_command({"prefix": "config-key get", "key": "daemon-private/osd.200/test-foo"} v 0) -- 0x7f8ea40ad680 con 0x7f8ea40b2020 2026-02-22T21:35:27.506 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.500+0000 7f8e83fff640 1 -- 10.20.193.23:0/3378001722 <== mon.0 v1:10.20.193.23:6789/0 11 ==== mon_command_ack([{"prefix": "config-key get", "key": "daemon-private/osd.200/test-foo"}]=0 v17) ==== 104+0+0 (unknown 1435423285 0 0) 0x7f8e98016290 con 0x7f8ea40b2020 2026-02-22T21:35:27.584 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.576+0000 7f8ea94f8640 1 -- 10.20.193.23:0/3378001722 --> v1:10.20.193.23:6789/0 -- mon_command({"prefix": "config-key get", "key": "daemon-private/osd.200/test-foo"} v 0) -- 0x7f8ea4150820 con 0x7f8ea40b2020 2026-02-22T21:35:27.584 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.576+0000 7f8e83fff640 1 -- 10.20.193.23:0/3378001722 <== mon.0 v1:10.20.193.23:6789/0 12 ==== mon_command_ack([{"prefix": "config-key get", "key": "daemon-private/osd.200/test-foo"}]=0 v17) ==== 104+0+0 (unknown 1435423285 0 0) 0x7f8e98003050 con 0x7f8ea40b2020 2026-02-22T21:35:27.584 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.576+0000 7f8ea94f8640 1 -- 10.20.193.23:0/3378001722 >> v1:10.20.193.23:6800/2834055528 conn(0x7f8e7803b930 legacy=0x7f8e7803ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:35:27.584 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.576+0000 7f8ea94f8640 1 -- 10.20.193.23:0/3378001722 >> v1:10.20.193.23:6789/0 conn(0x7f8ea40b2020 legacy=0x7f8ea40b5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:35:27.584 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.580+0000 7f8ea94f8640 1 -- 10.20.193.23:0/3378001722 shutdown_connections 2026-02-22T21:35:27.584 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.580+0000 7f8ea94f8640 1 -- 10.20.193.23:0/3378001722 >> 10.20.193.23:0/3378001722 conn(0x7f8ea4074560 msgr2=0x7f8ea40ab690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:35:27.584 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.580+0000 7f8ea94f8640 1 -- 10.20.193.23:0/3378001722 shutdown_connections 2026-02-22T21:35:27.584 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.580+0000 7f8ea94f8640 1 -- 10.20.193.23:0/3378001722 wait complete. 2026-02-22T21:35:27.593 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name osd.200 config-key ls 2026-02-22T21:35:27.593 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:27.593 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name osd.200 config-key ls 2026-02-22T21:35:27.661 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.652+0000 7fad0aea3640 -1 auth: unable to find a keyring on /var/lib/ceph/osd/ceph-200/keyring: (13) Permission denied 2026-02-22T21:35:27.661 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.656+0000 7fad0aea3640 1 Processor -- start 2026-02-22T21:35:27.661 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.656+0000 7fad0aea3640 1 -- start start 2026-02-22T21:35:27.662 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.656+0000 7fad0aea3640 1 -- --> v1:10.20.193.23:6789/0 -- auth(proto 0 28 bytes epoch 0) -- 0x7fad040b78f0 con 0x7fad040b2020 2026-02-22T21:35:27.662 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.656+0000 7fad08c18640 1 --1- >> v1:10.20.193.23:6789/0 conn(0x7fad040b2020 0x7fad040b7010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.23:6789/0 says I am v1:10.20.193.23:43570/0 (socket says 10.20.193.23:43570) 2026-02-22T21:35:27.662 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.656+0000 7fad08c18640 1 -- 10.20.193.23:0/2142482096 learned_addr learned my addr 10.20.193.23:0/2142482096 (peer_addr_for_me v1:10.20.193.23:0/0) 2026-02-22T21:35:27.662 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.656+0000 7facfb7fe640 1 -- 10.20.193.23:0/2142482096 <== mon.0 v1:10.20.193.23:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4072567643 0 0) 0x7fad040b78f0 con 0x7fad040b2020 2026-02-22T21:35:27.662 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.656+0000 7facfb7fe640 1 -- 10.20.193.23:0/2142482096 --> v1:10.20.193.23:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7facf0003630 con 0x7fad040b2020 2026-02-22T21:35:27.662 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.656+0000 7facfb7fe640 1 -- 10.20.193.23:0/2142482096 <== mon.0 v1:10.20.193.23:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4173676007 0 0) 0x7facf0003630 con 0x7fad040b2020 2026-02-22T21:35:27.662 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.656+0000 7facfb7fe640 1 -- 10.20.193.23:0/2142482096 --> v1:10.20.193.23:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad040adb10 con 0x7fad040b2020 2026-02-22T21:35:27.663 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.656+0000 7facfb7fe640 1 -- 10.20.193.23:0/2142482096 --> v1:10.20.193.23:6789/0 -- auth(proto 2 2 bytes epoch 0) -- 0x7fad040b78f0 con 0x7fad040b2020 2026-02-22T21:35:27.663 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.656+0000 7facfb7fe640 1 -- 10.20.193.23:0/2142482096 <== mon.0 v1:10.20.193.23:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7facf4002e20 con 0x7fad040b2020 2026-02-22T21:35:27.663 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.656+0000 7facfb7fe640 1 -- 10.20.193.23:0/2142482096 <== mon.0 v1:10.20.193.23:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7facf4003130 con 0x7fad040b2020 2026-02-22T21:35:27.663 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.656+0000 7facfb7fe640 1 -- 10.20.193.23:0/2142482096 <== mon.0 v1:10.20.193.23:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7facf4003530 con 0x7fad040b2020 2026-02-22T21:35:27.663 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.656+0000 7facfb7fe640 1 -- 10.20.193.23:0/2142482096 <== mon.0 v1:10.20.193.23:6789/0 6 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (unknown 2665389685 0 0) 0x7fad040b78f0 con 0x7fad040b2020 2026-02-22T21:35:27.663 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.656+0000 7fad0aea3640 1 -- 10.20.193.23:0/2142482096 >> v1:10.20.193.23:6789/0 conn(0x7fad040b2020 legacy=0x7fad040b7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:35:27.663 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.656+0000 7fad0aea3640 1 -- 10.20.193.23:0/2142482096 shutdown_connections 2026-02-22T21:35:27.663 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.656+0000 7fad0aea3640 1 -- 10.20.193.23:0/2142482096 >> 10.20.193.23:0/2142482096 conn(0x7fad04074560 msgr2=0x7fad04074970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:35:27.663 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.656+0000 7fad0aea3640 1 -- 10.20.193.23:0/2142482096 shutdown_connections 2026-02-22T21:35:27.663 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.656+0000 7fad0aea3640 1 -- 10.20.193.23:0/2142482096 wait complete. 2026-02-22T21:35:27.664 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.656+0000 7fad0aea3640 1 Processor -- start 2026-02-22T21:35:27.664 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.656+0000 7fad0aea3640 1 -- start start 2026-02-22T21:35:27.664 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.660+0000 7fad0aea3640 1 -- --> v1:10.20.193.23:6789/0 -- auth(proto 0 28 bytes epoch 0) -- 0x7fad040b06d0 con 0x7fad040b2020 2026-02-22T21:35:27.665 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.660+0000 7fad08c18640 1 --1- >> v1:10.20.193.23:6789/0 conn(0x7fad040b2020 0x7fad040b31b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.23:6789/0 says I am v1:10.20.193.23:43572/0 (socket says 10.20.193.23:43572) 2026-02-22T21:35:27.665 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.660+0000 7fad08c18640 1 -- 10.20.193.23:0/3220034411 learned_addr learned my addr 10.20.193.23:0/3220034411 (peer_addr_for_me v1:10.20.193.23:0/0) 2026-02-22T21:35:27.665 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.660+0000 7facf9ffb640 1 -- 10.20.193.23:0/3220034411 <== mon.0 v1:10.20.193.23:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1162338536 0 0) 0x7fad040b06d0 con 0x7fad040b2020 2026-02-22T21:35:27.665 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.660+0000 7facf9ffb640 1 -- 10.20.193.23:0/3220034411 --> v1:10.20.193.23:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7face0003630 con 0x7fad040b2020 2026-02-22T21:35:27.665 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.660+0000 7facf9ffb640 1 -- 10.20.193.23:0/3220034411 <== mon.0 v1:10.20.193.23:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 732+0+0 (unknown 638087166 0 0) 0x7face0003630 con 0x7fad040b2020 2026-02-22T21:35:27.665 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.660+0000 7facf9ffb640 1 -- 10.20.193.23:0/3220034411 --> v1:10.20.193.23:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fad040b06d0 con 0x7fad040b2020 2026-02-22T21:35:27.665 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.660+0000 7facf9ffb640 1 -- 10.20.193.23:0/3220034411 <== mon.0 v1:10.20.193.23:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7facf4002bd0 con 0x7fad040b2020 2026-02-22T21:35:27.665 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.660+0000 7facf9ffb640 1 -- 10.20.193.23:0/3220034411 <== mon.0 v1:10.20.193.23:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 548+0+0 (unknown 4106907375 0 0) 0x7fad040b06d0 con 0x7fad040b2020 2026-02-22T21:35:27.665 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.660+0000 7facf9ffb640 1 -- 10.20.193.23:0/3220034411 --> v1:10.20.193.23:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad040bd4e0 con 0x7fad040b2020 2026-02-22T21:35:27.665 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.660+0000 7facf9ffb640 1 -- 10.20.193.23:0/3220034411 --> v1:10.20.193.23:6789/0 -- auth(proto 2 2 bytes epoch 0) -- 0x7face0003630 con 0x7fad040b2020 2026-02-22T21:35:27.665 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.660+0000 7fad0aea3640 1 -- 10.20.193.23:0/3220034411 --> v1:10.20.193.23:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fad040b55b0 con 0x7fad040b2020 2026-02-22T21:35:27.666 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.660+0000 7fad0aea3640 1 -- 10.20.193.23:0/3220034411 --> v1:10.20.193.23:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fad041e6c90 con 0x7fad040b2020 2026-02-22T21:35:27.666 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.660+0000 7facf9ffb640 1 -- 10.20.193.23:0/3220034411 <== mon.0 v1:10.20.193.23:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7facf4004cc0 con 0x7fad040b2020 2026-02-22T21:35:27.666 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.660+0000 7facf9ffb640 1 -- 10.20.193.23:0/3220034411 <== mon.0 v1:10.20.193.23:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7facf40050c0 con 0x7fad040b2020 2026-02-22T21:35:27.666 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.660+0000 7facf9ffb640 1 -- 10.20.193.23:0/3220034411 <== mon.0 v1:10.20.193.23:6789/0 7 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (unknown 4135155210 0 0) 0x7fad041e6c90 con 0x7fad040b2020 2026-02-22T21:35:27.666 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.660+0000 7fad0aea3640 1 -- 10.20.193.23:0/3220034411 --> v1:10.20.193.23:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad0406e210 con 0x7fad040b2020 2026-02-22T21:35:27.666 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.660+0000 7facf9ffb640 1 -- 10.20.193.23:0/3220034411 <== mon.0 v1:10.20.193.23:6789/0 8 ==== mgrmap(e 4) ==== 47400+0+0 (unknown 1603120368 0 0) 0x7facf4005260 con 0x7fad040b2020 2026-02-22T21:35:27.666 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.660+0000 7facf9ffb640 1 -- 10.20.193.23:0/3220034411 <== mon.0 v1:10.20.193.23:6789/0 9 ==== osd_map(14..14 src has 1..14) ==== 2160+0+0 (unknown 946035718 0 0) 0x7facf4048ce0 con 0x7fad040b2020 2026-02-22T21:35:27.668 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.660+0000 7facf9ffb640 1 -- 10.20.193.23:0/3220034411 <== mon.0 v1:10.20.193.23:6789/0 10 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (unknown 1092875540 0 3570997608) 0x7facf40168b0 con 0x7fad040b2020 2026-02-22T21:35:27.779 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.772+0000 7fad0aea3640 1 -- 10.20.193.23:0/3220034411 --> v1:10.20.193.23:6789/0 -- mon_command({"prefix": "config-key ls"} v 0) -- 0x7fad0407d7c0 con 0x7fad040b2020 2026-02-22T21:35:27.780 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.772+0000 7facf9ffb640 1 -- 10.20.193.23:0/3220034411 <== mon.0 v1:10.20.193.23:6789/0 11 ==== mon_command_ack([{"prefix": "config-key ls"}]=-13 access denied v0) ==== 74+0+0 (unknown 2083006276 0 0) 0x7facf401f3e0 con 0x7fad040b2020 2026-02-22T21:35:27.780 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:27.784 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:27.784 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name osd.200 config-key get mgr/test-foo 2026-02-22T21:35:27.784 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:27.784 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name osd.200 config-key get mgr/test-foo 2026-02-22T21:35:27.837 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.828+0000 7fd950423640 -1 auth: unable to find a keyring on /var/lib/ceph/osd/ceph-200/keyring: (13) Permission denied 2026-02-22T21:35:27.838 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.832+0000 7fd950423640 1 Processor -- start 2026-02-22T21:35:27.838 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.832+0000 7fd950423640 1 -- start start 2026-02-22T21:35:27.840 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.832+0000 7fd950423640 1 -- --> v1:10.20.193.23:6789/0 -- auth(proto 0 28 bytes epoch 0) -- 0x7fd9480b78f0 con 0x7fd9480b2020 2026-02-22T21:35:27.840 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.832+0000 7fd94e198640 1 --1- >> v1:10.20.193.23:6789/0 conn(0x7fd9480b2020 0x7fd9480b7010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.23:6789/0 says I am v1:10.20.193.23:43580/0 (socket says 10.20.193.23:43580) 2026-02-22T21:35:27.840 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.832+0000 7fd94e198640 1 -- 10.20.193.23:0/3050980250 learned_addr learned my addr 10.20.193.23:0/3050980250 (peer_addr_for_me v1:10.20.193.23:0/0) 2026-02-22T21:35:27.840 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.832+0000 7fd94d196640 1 -- 10.20.193.23:0/3050980250 <== mon.0 v1:10.20.193.23:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4236011793 0 0) 0x7fd9480b78f0 con 0x7fd9480b2020 2026-02-22T21:35:27.840 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.832+0000 7fd94d196640 1 -- 10.20.193.23:0/3050980250 --> v1:10.20.193.23:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd930003630 con 0x7fd9480b2020 2026-02-22T21:35:27.840 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.832+0000 7fd94d196640 1 -- 10.20.193.23:0/3050980250 <== mon.0 v1:10.20.193.23:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2326760658 0 0) 0x7fd930003630 con 0x7fd9480b2020 2026-02-22T21:35:27.840 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.832+0000 7fd94d196640 1 -- 10.20.193.23:0/3050980250 --> v1:10.20.193.23:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9480adb10 con 0x7fd9480b2020 2026-02-22T21:35:27.840 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.832+0000 7fd94d196640 1 -- 10.20.193.23:0/3050980250 --> v1:10.20.193.23:6789/0 -- auth(proto 2 2 bytes epoch 0) -- 0x7fd9480b78f0 con 0x7fd9480b2020 2026-02-22T21:35:27.840 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.832+0000 7fd94d196640 1 -- 10.20.193.23:0/3050980250 <== mon.0 v1:10.20.193.23:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7fd938002e20 con 0x7fd9480b2020 2026-02-22T21:35:27.840 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.832+0000 7fd94d196640 1 -- 10.20.193.23:0/3050980250 <== mon.0 v1:10.20.193.23:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd938003130 con 0x7fd9480b2020 2026-02-22T21:35:27.841 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.832+0000 7fd94d196640 1 -- 10.20.193.23:0/3050980250 <== mon.0 v1:10.20.193.23:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7fd938003530 con 0x7fd9480b2020 2026-02-22T21:35:27.841 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.832+0000 7fd94d196640 1 -- 10.20.193.23:0/3050980250 <== mon.0 v1:10.20.193.23:6789/0 6 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (unknown 1334922891 0 0) 0x7fd9480b78f0 con 0x7fd9480b2020 2026-02-22T21:35:27.841 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.832+0000 7fd950423640 1 -- 10.20.193.23:0/3050980250 >> v1:10.20.193.23:6789/0 conn(0x7fd9480b2020 legacy=0x7fd9480b7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:35:27.841 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.832+0000 7fd950423640 1 -- 10.20.193.23:0/3050980250 shutdown_connections 2026-02-22T21:35:27.841 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.832+0000 7fd950423640 1 -- 10.20.193.23:0/3050980250 >> 10.20.193.23:0/3050980250 conn(0x7fd948074560 msgr2=0x7fd948074970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:35:27.841 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.832+0000 7fd950423640 1 -- 10.20.193.23:0/3050980250 shutdown_connections 2026-02-22T21:35:27.841 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.832+0000 7fd950423640 1 -- 10.20.193.23:0/3050980250 wait complete. 2026-02-22T21:35:27.843 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.832+0000 7fd950423640 1 Processor -- start 2026-02-22T21:35:27.843 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.832+0000 7fd950423640 1 -- start start 2026-02-22T21:35:27.843 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.836+0000 7fd950423640 1 -- --> v1:10.20.193.23:6789/0 -- auth(proto 0 28 bytes epoch 0) -- 0x7fd9480b06d0 con 0x7fd9480b2020 2026-02-22T21:35:27.843 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.836+0000 7fd94e198640 1 --1- >> v1:10.20.193.23:6789/0 conn(0x7fd9480b2020 0x7fd9480b31b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.23:6789/0 says I am v1:10.20.193.23:43586/0 (socket says 10.20.193.23:43586) 2026-02-22T21:35:27.844 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.836+0000 7fd94e198640 1 -- 10.20.193.23:0/3794797844 learned_addr learned my addr 10.20.193.23:0/3794797844 (peer_addr_for_me v1:10.20.193.23:0/0) 2026-02-22T21:35:27.844 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.836+0000 7fd92f7fe640 1 -- 10.20.193.23:0/3794797844 <== mon.0 v1:10.20.193.23:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1785288653 0 0) 0x7fd9480b06d0 con 0x7fd9480b2020 2026-02-22T21:35:27.844 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.836+0000 7fd92f7fe640 1 -- 10.20.193.23:0/3794797844 --> v1:10.20.193.23:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd924003630 con 0x7fd9480b2020 2026-02-22T21:35:27.844 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.836+0000 7fd92f7fe640 1 -- 10.20.193.23:0/3794797844 <== mon.0 v1:10.20.193.23:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 732+0+0 (unknown 3414701513 0 0) 0x7fd924003630 con 0x7fd9480b2020 2026-02-22T21:35:27.844 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.836+0000 7fd92f7fe640 1 -- 10.20.193.23:0/3794797844 --> v1:10.20.193.23:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd9480b06d0 con 0x7fd9480b2020 2026-02-22T21:35:27.844 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.836+0000 7fd92f7fe640 1 -- 10.20.193.23:0/3794797844 <== mon.0 v1:10.20.193.23:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7fd938002bd0 con 0x7fd9480b2020 2026-02-22T21:35:27.844 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.836+0000 7fd92f7fe640 1 -- 10.20.193.23:0/3794797844 <== mon.0 v1:10.20.193.23:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 548+0+0 (unknown 3132990764 0 0) 0x7fd9480b06d0 con 0x7fd9480b2020 2026-02-22T21:35:27.844 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.836+0000 7fd92f7fe640 1 -- 10.20.193.23:0/3794797844 --> v1:10.20.193.23:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9480bd4e0 con 0x7fd9480b2020 2026-02-22T21:35:27.844 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.836+0000 7fd92f7fe640 1 -- 10.20.193.23:0/3794797844 --> v1:10.20.193.23:6789/0 -- auth(proto 2 2 bytes epoch 0) -- 0x7fd924003630 con 0x7fd9480b2020 2026-02-22T21:35:27.844 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.836+0000 7fd950423640 1 -- 10.20.193.23:0/3794797844 --> v1:10.20.193.23:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd9480b55b0 con 0x7fd9480b2020 2026-02-22T21:35:27.844 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.836+0000 7fd92f7fe640 1 -- 10.20.193.23:0/3794797844 <== mon.0 v1:10.20.193.23:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd938004cc0 con 0x7fd9480b2020 2026-02-22T21:35:27.844 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.836+0000 7fd950423640 1 -- 10.20.193.23:0/3794797844 --> v1:10.20.193.23:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd9481e6c90 con 0x7fd9480b2020 2026-02-22T21:35:27.845 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.836+0000 7fd92f7fe640 1 -- 10.20.193.23:0/3794797844 <== mon.0 v1:10.20.193.23:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7fd9380050c0 con 0x7fd9480b2020 2026-02-22T21:35:27.845 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.836+0000 7fd92f7fe640 1 -- 10.20.193.23:0/3794797844 <== mon.0 v1:10.20.193.23:6789/0 7 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (unknown 657893108 0 0) 0x7fd9480b55b0 con 0x7fd9480b2020 2026-02-22T21:35:27.845 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.836+0000 7fd950423640 1 -- 10.20.193.23:0/3794797844 --> v1:10.20.193.23:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd94806e210 con 0x7fd9480b2020 2026-02-22T21:35:27.845 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.836+0000 7fd92f7fe640 1 -- 10.20.193.23:0/3794797844 <== mon.0 v1:10.20.193.23:6789/0 8 ==== mgrmap(e 4) ==== 47400+0+0 (unknown 1603120368 0 0) 0x7fd938005450 con 0x7fd9480b2020 2026-02-22T21:35:27.845 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.836+0000 7fd92f7fe640 1 -- 10.20.193.23:0/3794797844 <== mon.0 v1:10.20.193.23:6789/0 9 ==== osd_map(14..14 src has 1..14) ==== 2160+0+0 (unknown 946035718 0 0) 0x7fd938048c10 con 0x7fd9480b2020 2026-02-22T21:35:27.845 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.840+0000 7fd92f7fe640 1 -- 10.20.193.23:0/3794797844 <== mon.0 v1:10.20.193.23:6789/0 10 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (unknown 1092875540 0 3570997608) 0x7fd9380167e0 con 0x7fd9480b2020 2026-02-22T21:35:27.959 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.952+0000 7fd950423640 1 -- 10.20.193.23:0/3794797844 --> v1:10.20.193.23:6789/0 -- mon_command({"prefix": "config-key get", "key": "mgr/test-foo"} v 0) -- 0x7fd94807d7c0 con 0x7fd9480b2020 2026-02-22T21:35:27.959 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:27.952+0000 7fd92f7fe640 1 -- 10.20.193.23:0/3794797844 <== mon.0 v1:10.20.193.23:6789/0 11 ==== mon_command_ack([{"prefix": "config-key get", "key": "mgr/test-foo"}]=-13 access denied v0) ==== 98+0+0 (unknown 1738449250 0 0) 0x7fd93801f310 con 0x7fd9480b2020 2026-02-22T21:35:27.959 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:27.962 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:27.962 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name osd.200 config-key get device/test-foo 2026-02-22T21:35:27.962 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:27.962 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name osd.200 config-key get device/test-foo 2026-02-22T21:35:28.014 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.004+0000 7ff2fb116640 -1 auth: unable to find a keyring on /var/lib/ceph/osd/ceph-200/keyring: (13) Permission denied 2026-02-22T21:35:28.014 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.008+0000 7ff2fb116640 1 Processor -- start 2026-02-22T21:35:28.014 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.008+0000 7ff2fb116640 1 -- start start 2026-02-22T21:35:28.015 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.008+0000 7ff2fb116640 1 -- --> v1:10.20.193.23:6789/0 -- auth(proto 0 28 bytes epoch 0) -- 0x7ff2f40b78f0 con 0x7ff2f40b2020 2026-02-22T21:35:28.015 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.008+0000 7ff2f8e8b640 1 --1- >> v1:10.20.193.23:6789/0 conn(0x7ff2f40b2020 0x7ff2f40b7010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.23:6789/0 says I am v1:10.20.193.23:43596/0 (socket says 10.20.193.23:43596) 2026-02-22T21:35:28.015 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.008+0000 7ff2f8e8b640 1 -- 10.20.193.23:0/571638869 learned_addr learned my addr 10.20.193.23:0/571638869 (peer_addr_for_me v1:10.20.193.23:0/0) 2026-02-22T21:35:28.015 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.008+0000 7ff2eb7fe640 1 -- 10.20.193.23:0/571638869 <== mon.0 v1:10.20.193.23:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 520422954 0 0) 0x7ff2f40b78f0 con 0x7ff2f40b2020 2026-02-22T21:35:28.015 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.008+0000 7ff2eb7fe640 1 -- 10.20.193.23:0/571638869 --> v1:10.20.193.23:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2e0003630 con 0x7ff2f40b2020 2026-02-22T21:35:28.016 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.008+0000 7ff2eb7fe640 1 -- 10.20.193.23:0/571638869 <== mon.0 v1:10.20.193.23:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3944960309 0 0) 0x7ff2e0003630 con 0x7ff2f40b2020 2026-02-22T21:35:28.016 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.008+0000 7ff2eb7fe640 1 -- 10.20.193.23:0/571638869 --> v1:10.20.193.23:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2f40adb10 con 0x7ff2f40b2020 2026-02-22T21:35:28.016 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.008+0000 7ff2eb7fe640 1 -- 10.20.193.23:0/571638869 --> v1:10.20.193.23:6789/0 -- auth(proto 2 2 bytes epoch 0) -- 0x7ff2f40b78f0 con 0x7ff2f40b2020 2026-02-22T21:35:28.016 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.008+0000 7ff2eb7fe640 1 -- 10.20.193.23:0/571638869 <== mon.0 v1:10.20.193.23:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7ff2e4002e20 con 0x7ff2f40b2020 2026-02-22T21:35:28.016 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.008+0000 7ff2eb7fe640 1 -- 10.20.193.23:0/571638869 <== mon.0 v1:10.20.193.23:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff2e4003090 con 0x7ff2f40b2020 2026-02-22T21:35:28.016 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.008+0000 7ff2eb7fe640 1 -- 10.20.193.23:0/571638869 <== mon.0 v1:10.20.193.23:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7ff2e4003490 con 0x7ff2f40b2020 2026-02-22T21:35:28.016 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.008+0000 7ff2eb7fe640 1 -- 10.20.193.23:0/571638869 <== mon.0 v1:10.20.193.23:6789/0 6 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (unknown 1923518867 0 0) 0x7ff2f40b78f0 con 0x7ff2f40b2020 2026-02-22T21:35:28.016 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.008+0000 7ff2fb116640 1 -- 10.20.193.23:0/571638869 >> v1:10.20.193.23:6789/0 conn(0x7ff2f40b2020 legacy=0x7ff2f40b7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:35:28.016 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.008+0000 7ff2fb116640 1 -- 10.20.193.23:0/571638869 shutdown_connections 2026-02-22T21:35:28.016 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.008+0000 7ff2fb116640 1 -- 10.20.193.23:0/571638869 >> 10.20.193.23:0/571638869 conn(0x7ff2f4074560 msgr2=0x7ff2f4074970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:35:28.016 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.008+0000 7ff2fb116640 1 -- 10.20.193.23:0/571638869 shutdown_connections 2026-02-22T21:35:28.016 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.008+0000 7ff2fb116640 1 -- 10.20.193.23:0/571638869 wait complete. 2026-02-22T21:35:28.017 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.012+0000 7ff2fb116640 1 Processor -- start 2026-02-22T21:35:28.017 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.012+0000 7ff2fb116640 1 -- start start 2026-02-22T21:35:28.017 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.012+0000 7ff2fb116640 1 -- --> v1:10.20.193.23:6789/0 -- auth(proto 0 28 bytes epoch 0) -- 0x7ff2f40c2180 con 0x7ff2f40b2020 2026-02-22T21:35:28.018 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.012+0000 7ff2f8e8b640 1 --1- >> v1:10.20.193.23:6789/0 conn(0x7ff2f40b2020 0x7ff2f40b5350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.23:6789/0 says I am v1:10.20.193.23:43612/0 (socket says 10.20.193.23:43612) 2026-02-22T21:35:28.018 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.012+0000 7ff2f8e8b640 1 -- 10.20.193.23:0/25603986 learned_addr learned my addr 10.20.193.23:0/25603986 (peer_addr_for_me v1:10.20.193.23:0/0) 2026-02-22T21:35:28.018 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.012+0000 7ff2e9ffb640 1 -- 10.20.193.23:0/25603986 <== mon.0 v1:10.20.193.23:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3587341258 0 0) 0x7ff2f40c2180 con 0x7ff2f40b2020 2026-02-22T21:35:28.018 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.012+0000 7ff2e9ffb640 1 -- 10.20.193.23:0/25603986 --> v1:10.20.193.23:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2d0003630 con 0x7ff2f40b2020 2026-02-22T21:35:28.018 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.012+0000 7ff2e9ffb640 1 -- 10.20.193.23:0/25603986 <== mon.0 v1:10.20.193.23:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 732+0+0 (unknown 985834843 0 0) 0x7ff2d0003630 con 0x7ff2f40b2020 2026-02-22T21:35:28.018 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.012+0000 7ff2e9ffb640 1 -- 10.20.193.23:0/25603986 --> v1:10.20.193.23:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff2f40c2180 con 0x7ff2f40b2020 2026-02-22T21:35:28.018 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.012+0000 7ff2e9ffb640 1 -- 10.20.193.23:0/25603986 <== mon.0 v1:10.20.193.23:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7ff2e40028c0 con 0x7ff2f40b2020 2026-02-22T21:35:28.018 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.012+0000 7ff2e9ffb640 1 -- 10.20.193.23:0/25603986 <== mon.0 v1:10.20.193.23:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 548+0+0 (unknown 3389524209 0 0) 0x7ff2f40c2180 con 0x7ff2f40b2020 2026-02-22T21:35:28.018 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.012+0000 7ff2e9ffb640 1 -- 10.20.193.23:0/25603986 --> v1:10.20.193.23:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2f4090a70 con 0x7ff2f40b2020 2026-02-22T21:35:28.019 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.012+0000 7ff2e9ffb640 1 -- 10.20.193.23:0/25603986 --> v1:10.20.193.23:6789/0 -- auth(proto 2 2 bytes epoch 0) -- 0x7ff2d0003630 con 0x7ff2f40b2020 2026-02-22T21:35:28.019 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.012+0000 7ff2fb116640 1 -- 10.20.193.23:0/25603986 --> v1:10.20.193.23:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff2f4150650 con 0x7ff2f40b2020 2026-02-22T21:35:28.019 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.012+0000 7ff2fb116640 1 -- 10.20.193.23:0/25603986 --> v1:10.20.193.23:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff2f40a5ab0 con 0x7ff2f40b2020 2026-02-22T21:35:28.019 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.012+0000 7ff2e9ffb640 1 -- 10.20.193.23:0/25603986 <== mon.0 v1:10.20.193.23:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff2e4004c00 con 0x7ff2f40b2020 2026-02-22T21:35:28.019 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.012+0000 7ff2e9ffb640 1 -- 10.20.193.23:0/25603986 <== mon.0 v1:10.20.193.23:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7ff2e4004f80 con 0x7ff2f40b2020 2026-02-22T21:35:28.019 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.012+0000 7ff2e9ffb640 1 -- 10.20.193.23:0/25603986 <== mon.0 v1:10.20.193.23:6789/0 7 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (unknown 436304364 0 0) 0x7ff2f40a5ab0 con 0x7ff2f40b2020 2026-02-22T21:35:28.019 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.012+0000 7ff2fb116640 1 -- 10.20.193.23:0/25603986 --> v1:10.20.193.23:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2f406dca0 con 0x7ff2f40b2020 2026-02-22T21:35:28.019 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.012+0000 7ff2e9ffb640 1 -- 10.20.193.23:0/25603986 <== mon.0 v1:10.20.193.23:6789/0 8 ==== mgrmap(e 4) ==== 47400+0+0 (unknown 1603120368 0 0) 0x7ff2e4005120 con 0x7ff2f40b2020 2026-02-22T21:35:28.019 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.012+0000 7ff2e9ffb640 1 -- 10.20.193.23:0/25603986 <== mon.0 v1:10.20.193.23:6789/0 9 ==== osd_map(14..14 src has 1..14) ==== 2160+0+0 (unknown 946035718 0 0) 0x7ff2e4048cd0 con 0x7ff2f40b2020 2026-02-22T21:35:28.022 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.016+0000 7ff2e9ffb640 1 -- 10.20.193.23:0/25603986 <== mon.0 v1:10.20.193.23:6789/0 10 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (unknown 1092875540 0 3570997608) 0x7ff2e40169c0 con 0x7ff2f40b2020 2026-02-22T21:35:28.136 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.132+0000 7ff2fb116640 1 -- 10.20.193.23:0/25603986 --> v1:10.20.193.23:6789/0 -- mon_command({"prefix": "config-key get", "key": "device/test-foo"} v 0) -- 0x7ff2f40ad680 con 0x7ff2f40b2020 2026-02-22T21:35:28.136 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.132+0000 7ff2e9ffb640 1 -- 10.20.193.23:0/25603986 <== mon.0 v1:10.20.193.23:6789/0 11 ==== mon_command_ack([{"prefix": "config-key get", "key": "device/test-foo"}]=-13 access denied v0) ==== 101+0+0 (unknown 3359981662 0 0) 0x7ff2e40162c0 con 0x7ff2f40b2020 2026-02-22T21:35:28.137 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:28.141 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:28.141 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name osd.200 config-key get test/foo 2026-02-22T21:35:28.141 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:28.141 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name osd.200 config-key get test/foo 2026-02-22T21:35:28.194 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.184+0000 7ff9b2be4640 -1 auth: unable to find a keyring on /var/lib/ceph/osd/ceph-200/keyring: (13) Permission denied 2026-02-22T21:35:28.195 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.188+0000 7ff9b2be4640 1 Processor -- start 2026-02-22T21:35:28.195 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.188+0000 7ff9b2be4640 1 -- start start 2026-02-22T21:35:28.196 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.188+0000 7ff9b2be4640 1 -- --> v1:10.20.193.23:6789/0 -- auth(proto 0 28 bytes epoch 0) -- 0x7ff9ac146d30 con 0x7ff9ac0b7960 2026-02-22T21:35:28.196 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.188+0000 7ff9b0959640 1 --1- >> v1:10.20.193.23:6789/0 conn(0x7ff9ac0b7960 0x7ff9ac0b7d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.23:6789/0 says I am v1:10.20.193.23:43620/0 (socket says 10.20.193.23:43620) 2026-02-22T21:35:28.196 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.188+0000 7ff9b0959640 1 -- 10.20.193.23:0/2819571329 learned_addr learned my addr 10.20.193.23:0/2819571329 (peer_addr_for_me v1:10.20.193.23:0/0) 2026-02-22T21:35:28.196 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.188+0000 7ff9a37fe640 1 -- 10.20.193.23:0/2819571329 <== mon.0 v1:10.20.193.23:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3071864022 0 0) 0x7ff9ac146d30 con 0x7ff9ac0b7960 2026-02-22T21:35:28.197 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.188+0000 7ff9a37fe640 1 -- 10.20.193.23:0/2819571329 --> v1:10.20.193.23:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff998003630 con 0x7ff9ac0b7960 2026-02-22T21:35:28.197 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.192+0000 7ff9a37fe640 1 -- 10.20.193.23:0/2819571329 <== mon.0 v1:10.20.193.23:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1267357362 0 0) 0x7ff998003630 con 0x7ff9ac0b7960 2026-02-22T21:35:28.197 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.192+0000 7ff9a37fe640 1 -- 10.20.193.23:0/2819571329 --> v1:10.20.193.23:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9ac0b8450 con 0x7ff9ac0b7960 2026-02-22T21:35:28.197 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.192+0000 7ff9a37fe640 1 -- 10.20.193.23:0/2819571329 --> v1:10.20.193.23:6789/0 -- auth(proto 2 2 bytes epoch 0) -- 0x7ff9ac146d30 con 0x7ff9ac0b7960 2026-02-22T21:35:28.197 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.192+0000 7ff9a37fe640 1 -- 10.20.193.23:0/2819571329 <== mon.0 v1:10.20.193.23:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7ff99c002e20 con 0x7ff9ac0b7960 2026-02-22T21:35:28.197 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.192+0000 7ff9a37fe640 1 -- 10.20.193.23:0/2819571329 <== mon.0 v1:10.20.193.23:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff99c003130 con 0x7ff9ac0b7960 2026-02-22T21:35:28.197 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.192+0000 7ff9a37fe640 1 -- 10.20.193.23:0/2819571329 <== mon.0 v1:10.20.193.23:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7ff99c003530 con 0x7ff9ac0b7960 2026-02-22T21:35:28.197 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.192+0000 7ff9a37fe640 1 -- 10.20.193.23:0/2819571329 <== mon.0 v1:10.20.193.23:6789/0 6 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (unknown 2749972845 0 0) 0x7ff9ac146d30 con 0x7ff9ac0b7960 2026-02-22T21:35:28.197 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.192+0000 7ff9b2be4640 1 -- 10.20.193.23:0/2819571329 >> v1:10.20.193.23:6789/0 conn(0x7ff9ac0b7960 legacy=0x7ff9ac0b7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:35:28.197 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.192+0000 7ff9b2be4640 1 -- 10.20.193.23:0/2819571329 shutdown_connections 2026-02-22T21:35:28.197 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.192+0000 7ff9b2be4640 1 -- 10.20.193.23:0/2819571329 >> 10.20.193.23:0/2819571329 conn(0x7ff9ac06c870 msgr2=0x7ff9ac06cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:35:28.197 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.192+0000 7ff9b2be4640 1 -- 10.20.193.23:0/2819571329 shutdown_connections 2026-02-22T21:35:28.197 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.192+0000 7ff9b2be4640 1 -- 10.20.193.23:0/2819571329 wait complete. 2026-02-22T21:35:28.198 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.192+0000 7ff9b2be4640 1 Processor -- start 2026-02-22T21:35:28.198 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.192+0000 7ff9b2be4640 1 -- start start 2026-02-22T21:35:28.198 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.192+0000 7ff9b2be4640 1 -- --> v1:10.20.193.23:6789/0 -- auth(proto 0 28 bytes epoch 0) -- 0x7ff9ac146210 con 0x7ff9ac0b7960 2026-02-22T21:35:28.199 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.192+0000 7ff9b0959640 1 --1- >> v1:10.20.193.23:6789/0 conn(0x7ff9ac0b7960 0x7ff9ac13e5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.23:6789/0 says I am v1:10.20.193.23:43636/0 (socket says 10.20.193.23:43636) 2026-02-22T21:35:28.199 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.192+0000 7ff9b0959640 1 -- 10.20.193.23:0/4176576131 learned_addr learned my addr 10.20.193.23:0/4176576131 (peer_addr_for_me v1:10.20.193.23:0/0) 2026-02-22T21:35:28.199 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.192+0000 7ff9a1ffb640 1 -- 10.20.193.23:0/4176576131 <== mon.0 v1:10.20.193.23:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1803263614 0 0) 0x7ff9ac146210 con 0x7ff9ac0b7960 2026-02-22T21:35:28.199 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.192+0000 7ff9a1ffb640 1 -- 10.20.193.23:0/4176576131 --> v1:10.20.193.23:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff988003630 con 0x7ff9ac0b7960 2026-02-22T21:35:28.199 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.192+0000 7ff9a1ffb640 1 -- 10.20.193.23:0/4176576131 <== mon.0 v1:10.20.193.23:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 732+0+0 (unknown 1535762372 0 0) 0x7ff988003630 con 0x7ff9ac0b7960 2026-02-22T21:35:28.199 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.192+0000 7ff9a1ffb640 1 -- 10.20.193.23:0/4176576131 --> v1:10.20.193.23:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff9ac146210 con 0x7ff9ac0b7960 2026-02-22T21:35:28.199 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.192+0000 7ff9a1ffb640 1 -- 10.20.193.23:0/4176576131 <== mon.0 v1:10.20.193.23:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7ff99c004a00 con 0x7ff9ac0b7960 2026-02-22T21:35:28.199 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.192+0000 7ff9a1ffb640 1 -- 10.20.193.23:0/4176576131 <== mon.0 v1:10.20.193.23:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 548+0+0 (unknown 3395507035 0 0) 0x7ff9ac146210 con 0x7ff9ac0b7960 2026-02-22T21:35:28.199 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.192+0000 7ff9a1ffb640 1 -- 10.20.193.23:0/4176576131 --> v1:10.20.193.23:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9ac0adb00 con 0x7ff9ac0b7960 2026-02-22T21:35:28.199 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.192+0000 7ff9a1ffb640 1 -- 10.20.193.23:0/4176576131 --> v1:10.20.193.23:6789/0 -- auth(proto 2 2 bytes epoch 0) -- 0x7ff988003630 con 0x7ff9ac0b7960 2026-02-22T21:35:28.199 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.192+0000 7ff9b2be4640 1 -- 10.20.193.23:0/4176576131 --> v1:10.20.193.23:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff9ac1d2c60 con 0x7ff9ac0b7960 2026-02-22T21:35:28.199 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.192+0000 7ff9b2be4640 1 -- 10.20.193.23:0/4176576131 --> v1:10.20.193.23:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff9ac0af9d0 con 0x7ff9ac0b7960 2026-02-22T21:35:28.199 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.192+0000 7ff9a1ffb640 1 -- 10.20.193.23:0/4176576131 <== mon.0 v1:10.20.193.23:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff99c004c40 con 0x7ff9ac0b7960 2026-02-22T21:35:28.199 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.192+0000 7ff9a1ffb640 1 -- 10.20.193.23:0/4176576131 <== mon.0 v1:10.20.193.23:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7ff99c005000 con 0x7ff9ac0b7960 2026-02-22T21:35:28.199 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.192+0000 7ff9a1ffb640 1 -- 10.20.193.23:0/4176576131 <== mon.0 v1:10.20.193.23:6789/0 7 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (unknown 3410929938 0 0) 0x7ff9ac1d2c60 con 0x7ff9ac0b7960 2026-02-22T21:35:28.200 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.192+0000 7ff9a1ffb640 1 -- 10.20.193.23:0/4176576131 <== mon.0 v1:10.20.193.23:6789/0 8 ==== mgrmap(e 4) ==== 47400+0+0 (unknown 1603120368 0 0) 0x7ff99c005390 con 0x7ff9ac0b7960 2026-02-22T21:35:28.200 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.192+0000 7ff9b2be4640 1 -- 10.20.193.23:0/4176576131 --> v1:10.20.193.23:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9ac0008e0 con 0x7ff9ac0b7960 2026-02-22T21:35:28.200 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.192+0000 7ff9a1ffb640 1 -- 10.20.193.23:0/4176576131 <== mon.0 v1:10.20.193.23:6789/0 9 ==== osd_map(14..14 src has 1..14) ==== 2160+0+0 (unknown 946035718 0 0) 0x7ff99c048cb0 con 0x7ff9ac0b7960 2026-02-22T21:35:28.203 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.196+0000 7ff9a1ffb640 1 -- 10.20.193.23:0/4176576131 <== mon.0 v1:10.20.193.23:6789/0 10 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (unknown 1092875540 0 3570997608) 0x7ff99c0168e0 con 0x7ff9ac0b7960 2026-02-22T21:35:28.317 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.312+0000 7ff9b2be4640 1 -- 10.20.193.23:0/4176576131 --> v1:10.20.193.23:6789/0 -- mon_command({"prefix": "config-key get", "key": "test/foo"} v 0) -- 0x7ff9ac0b9630 con 0x7ff9ac0b7960 2026-02-22T21:35:28.317 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.312+0000 7ff9a1ffb640 1 -- 10.20.193.23:0/4176576131 <== mon.0 v1:10.20.193.23:6789/0 11 ==== mon_command_ack([{"prefix": "config-key get", "key": "test/foo"}]=-13 access denied v0) ==== 94+0+0 (unknown 1363093350 0 0) 0x7ff99c0161e0 con 0x7ff9ac0b7960 2026-02-22T21:35:28.317 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:28.320 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:28.320 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name osd.100 get daemon-private/osd.200/test-foo 2026-02-22T21:35:28.320 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:28.320 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name osd.100 get daemon-private/osd.200/test-foo 2026-02-22T21:35:28.374 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.364+0000 7f4685424640 -1 auth: unable to find a keyring on /var/lib/ceph/osd/ceph-100/keyring: (13) Permission denied 2026-02-22T21:35:28.374 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.368+0000 7f4685424640 1 Processor -- start 2026-02-22T21:35:28.375 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.368+0000 7f4685424640 1 -- start start 2026-02-22T21:35:28.380 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.368+0000 7f4685424640 1 -- --> v1:10.20.193.23:6789/0 -- auth(proto 0 28 bytes epoch 0) -- 0x7f4680146d30 con 0x7f46800b7960 2026-02-22T21:35:28.380 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.368+0000 7f467effd640 1 --1- >> v1:10.20.193.23:6789/0 conn(0x7f46800b7960 0x7f46800b7d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.23:6789/0 says I am v1:10.20.193.23:43650/0 (socket says 10.20.193.23:43650) 2026-02-22T21:35:28.380 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.368+0000 7f467effd640 1 -- 10.20.193.23:0/1318805174 learned_addr learned my addr 10.20.193.23:0/1318805174 (peer_addr_for_me v1:10.20.193.23:0/0) 2026-02-22T21:35:28.380 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.368+0000 7f467dffb640 1 -- 10.20.193.23:0/1318805174 <== mon.0 v1:10.20.193.23:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3405650214 0 0) 0x7f4680146d30 con 0x7f46800b7960 2026-02-22T21:35:28.380 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.368+0000 7f467dffb640 1 -- 10.20.193.23:0/1318805174 --> v1:10.20.193.23:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f466c003630 con 0x7f46800b7960 2026-02-22T21:35:28.380 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.368+0000 7f467dffb640 1 -- 10.20.193.23:0/1318805174 <== mon.0 v1:10.20.193.23:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4084244376 0 0) 0x7f466c003630 con 0x7f46800b7960 2026-02-22T21:35:28.380 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.368+0000 7f467dffb640 1 -- 10.20.193.23:0/1318805174 --> v1:10.20.193.23:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46800b8450 con 0x7f46800b7960 2026-02-22T21:35:28.380 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.368+0000 7f467dffb640 1 -- 10.20.193.23:0/1318805174 --> v1:10.20.193.23:6789/0 -- auth(proto 2 2 bytes epoch 0) -- 0x7f4680146d30 con 0x7f46800b7960 2026-02-22T21:35:28.381 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.368+0000 7f467dffb640 1 -- 10.20.193.23:0/1318805174 <== mon.0 v1:10.20.193.23:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7f4674002e20 con 0x7f46800b7960 2026-02-22T21:35:28.381 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.368+0000 7f467dffb640 1 -- 10.20.193.23:0/1318805174 <== mon.0 v1:10.20.193.23:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4674003130 con 0x7f46800b7960 2026-02-22T21:35:28.381 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.368+0000 7f467dffb640 1 -- 10.20.193.23:0/1318805174 <== mon.0 v1:10.20.193.23:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7f4674003530 con 0x7f46800b7960 2026-02-22T21:35:28.381 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.368+0000 7f467dffb640 1 -- 10.20.193.23:0/1318805174 <== mon.0 v1:10.20.193.23:6789/0 6 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (unknown 2016821609 0 0) 0x7f4680146d30 con 0x7f46800b7960 2026-02-22T21:35:28.381 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.368+0000 7f4685424640 1 -- 10.20.193.23:0/1318805174 >> v1:10.20.193.23:6789/0 conn(0x7f46800b7960 legacy=0x7f46800b7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:35:28.381 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.368+0000 7f4685424640 1 -- 10.20.193.23:0/1318805174 shutdown_connections 2026-02-22T21:35:28.381 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.368+0000 7f4685424640 1 -- 10.20.193.23:0/1318805174 >> 10.20.193.23:0/1318805174 conn(0x7f468006c870 msgr2=0x7f468006cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:35:28.381 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.368+0000 7f4685424640 1 -- 10.20.193.23:0/1318805174 shutdown_connections 2026-02-22T21:35:28.381 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.368+0000 7f4685424640 1 -- 10.20.193.23:0/1318805174 wait complete. 2026-02-22T21:35:28.381 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.372+0000 7f4685424640 1 Processor -- start 2026-02-22T21:35:28.381 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.372+0000 7f4685424640 1 -- start start 2026-02-22T21:35:28.382 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.372+0000 7f4685424640 1 -- --> v1:10.20.193.23:6789/0 -- auth(proto 0 28 bytes epoch 0) -- 0x7f4680146210 con 0x7f46800b7960 2026-02-22T21:35:28.382 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.372+0000 7f467effd640 1 --1- >> v1:10.20.193.23:6789/0 conn(0x7f46800b7960 0x7f468013e5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.23:6789/0 says I am v1:10.20.193.23:43664/0 (socket says 10.20.193.23:43664) 2026-02-22T21:35:28.382 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.372+0000 7f467effd640 1 -- 10.20.193.23:0/3462385661 learned_addr learned my addr 10.20.193.23:0/3462385661 (peer_addr_for_me v1:10.20.193.23:0/0) 2026-02-22T21:35:28.382 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.372+0000 7f465ffff640 1 -- 10.20.193.23:0/3462385661 <== mon.0 v1:10.20.193.23:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2165620899 0 0) 0x7f4680146210 con 0x7f46800b7960 2026-02-22T21:35:28.382 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.372+0000 7f465ffff640 1 -- 10.20.193.23:0/3462385661 --> v1:10.20.193.23:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4654003630 con 0x7f46800b7960 2026-02-22T21:35:28.382 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.372+0000 7f465ffff640 1 -- 10.20.193.23:0/3462385661 <== mon.0 v1:10.20.193.23:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 732+0+0 (unknown 1714410271 0 0) 0x7f4654003630 con 0x7f46800b7960 2026-02-22T21:35:28.382 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.372+0000 7f465ffff640 1 -- 10.20.193.23:0/3462385661 --> v1:10.20.193.23:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4680146210 con 0x7f46800b7960 2026-02-22T21:35:28.382 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.372+0000 7f465ffff640 1 -- 10.20.193.23:0/3462385661 <== mon.0 v1:10.20.193.23:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7f4674004a00 con 0x7f46800b7960 2026-02-22T21:35:28.382 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.372+0000 7f465ffff640 1 -- 10.20.193.23:0/3462385661 <== mon.0 v1:10.20.193.23:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 548+0+0 (unknown 3308376167 0 0) 0x7f4680146210 con 0x7f46800b7960 2026-02-22T21:35:28.382 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.372+0000 7f465ffff640 1 -- 10.20.193.23:0/3462385661 --> v1:10.20.193.23:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46800adb00 con 0x7f46800b7960 2026-02-22T21:35:28.382 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.372+0000 7f465ffff640 1 -- 10.20.193.23:0/3462385661 --> v1:10.20.193.23:6789/0 -- auth(proto 2 2 bytes epoch 0) -- 0x7f4654003630 con 0x7f46800b7960 2026-02-22T21:35:28.383 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.372+0000 7f4685424640 1 -- 10.20.193.23:0/3462385661 --> v1:10.20.193.23:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f46801d2c60 con 0x7f46800b7960 2026-02-22T21:35:28.383 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.372+0000 7f4685424640 1 -- 10.20.193.23:0/3462385661 --> v1:10.20.193.23:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f46800af9d0 con 0x7f46800b7960 2026-02-22T21:35:28.383 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.372+0000 7f465ffff640 1 -- 10.20.193.23:0/3462385661 <== mon.0 v1:10.20.193.23:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4674004c80 con 0x7f46800b7960 2026-02-22T21:35:28.383 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.372+0000 7f465ffff640 1 -- 10.20.193.23:0/3462385661 <== mon.0 v1:10.20.193.23:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7f4674005080 con 0x7f46800b7960 2026-02-22T21:35:28.383 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.372+0000 7f465ffff640 1 -- 10.20.193.23:0/3462385661 <== mon.0 v1:10.20.193.23:6789/0 7 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (unknown 277981462 0 0) 0x7f46801d2c60 con 0x7f46800b7960 2026-02-22T21:35:28.383 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.372+0000 7f4685424640 1 -- 10.20.193.23:0/3462385661 --> v1:10.20.193.23:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46800008e0 con 0x7f46800b7960 2026-02-22T21:35:28.383 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.372+0000 7f465ffff640 1 -- 10.20.193.23:0/3462385661 <== mon.0 v1:10.20.193.23:6789/0 8 ==== mgrmap(e 4) ==== 47400+0+0 (unknown 1603120368 0 0) 0x7f4674005410 con 0x7f46800b7960 2026-02-22T21:35:28.383 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.372+0000 7f465ffff640 1 -- 10.20.193.23:0/3462385661 <== mon.0 v1:10.20.193.23:6789/0 9 ==== osd_map(14..14 src has 1..14) ==== 2160+0+0 (unknown 946035718 0 0) 0x7f4674048cb0 con 0x7f46800b7960 2026-02-22T21:35:28.384 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.376+0000 7f465ffff640 1 -- 10.20.193.23:0/3462385661 <== mon.0 v1:10.20.193.23:6789/0 10 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (unknown 1092875540 0 3570997608) 0x7f46740168e0 con 0x7f46800b7960 2026-02-22T21:35:28.540 INFO:tasks.workunit.client.0.trial023.stderr:no valid command found; 10 closest matches: 2026-02-22T21:35:28.540 INFO:tasks.workunit.client.0.trial023.stderr:pg stat 2026-02-22T21:35:28.540 INFO:tasks.workunit.client.0.trial023.stderr:pg getmap 2026-02-22T21:35:28.540 INFO:tasks.workunit.client.0.trial023.stderr:pg dump [...] 2026-02-22T21:35:28.541 INFO:tasks.workunit.client.0.trial023.stderr:pg dump_json [...] 2026-02-22T21:35:28.541 INFO:tasks.workunit.client.0.trial023.stderr:pg dump_pools_json 2026-02-22T21:35:28.541 INFO:tasks.workunit.client.0.trial023.stderr:pg ls-by-pool [...] 2026-02-22T21:35:28.541 INFO:tasks.workunit.client.0.trial023.stderr:pg ls-by-primary [] [...] 2026-02-22T21:35:28.541 INFO:tasks.workunit.client.0.trial023.stderr:pg ls-by-osd [] [...] 2026-02-22T21:35:28.541 INFO:tasks.workunit.client.0.trial023.stderr:pg ls [] [...] 2026-02-22T21:35:28.541 INFO:tasks.workunit.client.0.trial023.stderr:pg dump_stuck [...] [] 2026-02-22T21:35:28.541 INFO:tasks.workunit.client.0.trial023.stderr:Error EINVAL: invalid command 2026-02-22T21:35:28.543 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:28.543 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name osd.200 get daemon-private/osd.100/test-foo 2026-02-22T21:35:28.543 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:28.543 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name osd.200 get daemon-private/osd.100/test-foo 2026-02-22T21:35:28.594 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.584+0000 7fc484181640 -1 auth: unable to find a keyring on /var/lib/ceph/osd/ceph-200/keyring: (13) Permission denied 2026-02-22T21:35:28.594 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.588+0000 7fc484181640 1 Processor -- start 2026-02-22T21:35:28.595 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.588+0000 7fc484181640 1 -- start start 2026-02-22T21:35:28.595 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.588+0000 7fc484181640 1 -- --> v1:10.20.193.23:6789/0 -- auth(proto 0 28 bytes epoch 0) -- 0x7fc47c146d30 con 0x7fc47c0b7960 2026-02-22T21:35:28.595 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.588+0000 7fc481ef6640 1 --1- >> v1:10.20.193.23:6789/0 conn(0x7fc47c0b7960 0x7fc47c0b7d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.23:6789/0 says I am v1:10.20.193.23:43678/0 (socket says 10.20.193.23:43678) 2026-02-22T21:35:28.595 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.588+0000 7fc481ef6640 1 -- 10.20.193.23:0/1503443636 learned_addr learned my addr 10.20.193.23:0/1503443636 (peer_addr_for_me v1:10.20.193.23:0/0) 2026-02-22T21:35:28.596 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.588+0000 7fc480ef4640 1 -- 10.20.193.23:0/1503443636 <== mon.0 v1:10.20.193.23:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 356233982 0 0) 0x7fc47c146d30 con 0x7fc47c0b7960 2026-02-22T21:35:28.596 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.588+0000 7fc480ef4640 1 -- 10.20.193.23:0/1503443636 --> v1:10.20.193.23:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc464003630 con 0x7fc47c0b7960 2026-02-22T21:35:28.596 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.588+0000 7fc480ef4640 1 -- 10.20.193.23:0/1503443636 <== mon.0 v1:10.20.193.23:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3801550548 0 0) 0x7fc464003630 con 0x7fc47c0b7960 2026-02-22T21:35:28.596 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.588+0000 7fc480ef4640 1 -- 10.20.193.23:0/1503443636 --> v1:10.20.193.23:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc47c0b8450 con 0x7fc47c0b7960 2026-02-22T21:35:28.596 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.588+0000 7fc480ef4640 1 -- 10.20.193.23:0/1503443636 --> v1:10.20.193.23:6789/0 -- auth(proto 2 2 bytes epoch 0) -- 0x7fc47c146d30 con 0x7fc47c0b7960 2026-02-22T21:35:28.596 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.588+0000 7fc480ef4640 1 -- 10.20.193.23:0/1503443636 <== mon.0 v1:10.20.193.23:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7fc46c002e20 con 0x7fc47c0b7960 2026-02-22T21:35:28.596 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.588+0000 7fc480ef4640 1 -- 10.20.193.23:0/1503443636 <== mon.0 v1:10.20.193.23:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc46c003090 con 0x7fc47c0b7960 2026-02-22T21:35:28.596 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.588+0000 7fc480ef4640 1 -- 10.20.193.23:0/1503443636 <== mon.0 v1:10.20.193.23:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7fc46c003490 con 0x7fc47c0b7960 2026-02-22T21:35:28.596 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.588+0000 7fc480ef4640 1 -- 10.20.193.23:0/1503443636 <== mon.0 v1:10.20.193.23:6789/0 6 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (unknown 77239904 0 0) 0x7fc47c146d30 con 0x7fc47c0b7960 2026-02-22T21:35:28.596 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.592+0000 7fc484181640 1 -- 10.20.193.23:0/1503443636 >> v1:10.20.193.23:6789/0 conn(0x7fc47c0b7960 legacy=0x7fc47c0b7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:35:28.596 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.592+0000 7fc484181640 1 -- 10.20.193.23:0/1503443636 shutdown_connections 2026-02-22T21:35:28.596 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.592+0000 7fc484181640 1 -- 10.20.193.23:0/1503443636 >> 10.20.193.23:0/1503443636 conn(0x7fc47c06c870 msgr2=0x7fc47c06cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:35:28.596 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.592+0000 7fc484181640 1 -- 10.20.193.23:0/1503443636 shutdown_connections 2026-02-22T21:35:28.597 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.592+0000 7fc484181640 1 -- 10.20.193.23:0/1503443636 wait complete. 2026-02-22T21:35:28.597 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.592+0000 7fc484181640 1 Processor -- start 2026-02-22T21:35:28.597 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.592+0000 7fc484181640 1 -- start start 2026-02-22T21:35:28.598 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.592+0000 7fc484181640 1 -- --> v1:10.20.193.23:6789/0 -- auth(proto 0 28 bytes epoch 0) -- 0x7fc47c1d1d00 con 0x7fc47c0b7960 2026-02-22T21:35:28.598 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.592+0000 7fc481ef6640 1 --1- >> v1:10.20.193.23:6789/0 conn(0x7fc47c0b7960 0x7fc47c1d2570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.23:6789/0 says I am v1:10.20.193.23:43686/0 (socket says 10.20.193.23:43686) 2026-02-22T21:35:28.598 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.592+0000 7fc481ef6640 1 -- 10.20.193.23:0/3586713692 learned_addr learned my addr 10.20.193.23:0/3586713692 (peer_addr_for_me v1:10.20.193.23:0/0) 2026-02-22T21:35:28.599 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.592+0000 7fc46affd640 1 -- 10.20.193.23:0/3586713692 <== mon.0 v1:10.20.193.23:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3829502163 0 0) 0x7fc47c1d1d00 con 0x7fc47c0b7960 2026-02-22T21:35:28.599 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.592+0000 7fc46affd640 1 -- 10.20.193.23:0/3586713692 --> v1:10.20.193.23:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc458003630 con 0x7fc47c0b7960 2026-02-22T21:35:28.599 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.592+0000 7fc46affd640 1 -- 10.20.193.23:0/3586713692 <== mon.0 v1:10.20.193.23:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 732+0+0 (unknown 94566025 0 0) 0x7fc458003630 con 0x7fc47c0b7960 2026-02-22T21:35:28.599 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.592+0000 7fc46affd640 1 -- 10.20.193.23:0/3586713692 --> v1:10.20.193.23:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc47c1d1d00 con 0x7fc47c0b7960 2026-02-22T21:35:28.599 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.592+0000 7fc46affd640 1 -- 10.20.193.23:0/3586713692 <== mon.0 v1:10.20.193.23:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7fc46c002bd0 con 0x7fc47c0b7960 2026-02-22T21:35:28.599 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.592+0000 7fc46affd640 1 -- 10.20.193.23:0/3586713692 <== mon.0 v1:10.20.193.23:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 548+0+0 (unknown 3730300390 0 0) 0x7fc47c1d1d00 con 0x7fc47c0b7960 2026-02-22T21:35:28.599 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.592+0000 7fc46affd640 1 -- 10.20.193.23:0/3586713692 --> v1:10.20.193.23:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc47c1d18f0 con 0x7fc47c0b7960 2026-02-22T21:35:28.599 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.592+0000 7fc46affd640 1 -- 10.20.193.23:0/3586713692 --> v1:10.20.193.23:6789/0 -- auth(proto 2 2 bytes epoch 0) -- 0x7fc458003630 con 0x7fc47c0b7960 2026-02-22T21:35:28.599 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.592+0000 7fc484181640 1 -- 10.20.193.23:0/3586713692 --> v1:10.20.193.23:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc47c0ae6f0 con 0x7fc47c0b7960 2026-02-22T21:35:28.599 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.592+0000 7fc484181640 1 -- 10.20.193.23:0/3586713692 --> v1:10.20.193.23:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc47c0aeaf0 con 0x7fc47c0b7960 2026-02-22T21:35:28.599 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.592+0000 7fc46affd640 1 -- 10.20.193.23:0/3586713692 <== mon.0 v1:10.20.193.23:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc46c004c00 con 0x7fc47c0b7960 2026-02-22T21:35:28.599 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.592+0000 7fc46affd640 1 -- 10.20.193.23:0/3586713692 <== mon.0 v1:10.20.193.23:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 686778309 0 0) 0x7fc46c004fc0 con 0x7fc47c0b7960 2026-02-22T21:35:28.599 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.592+0000 7fc46affd640 1 -- 10.20.193.23:0/3586713692 <== mon.0 v1:10.20.193.23:6789/0 7 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (unknown 1815969311 0 0) 0x7fc47c0ae6f0 con 0x7fc47c0b7960 2026-02-22T21:35:28.599 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.592+0000 7fc484181640 1 -- 10.20.193.23:0/3586713692 --> v1:10.20.193.23:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc47c1d3070 con 0x7fc47c0b7960 2026-02-22T21:35:28.599 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.592+0000 7fc46affd640 1 -- 10.20.193.23:0/3586713692 <== mon.0 v1:10.20.193.23:6789/0 8 ==== mgrmap(e 4) ==== 47400+0+0 (unknown 1603120368 0 0) 0x7fc46c0053d0 con 0x7fc47c0b7960 2026-02-22T21:35:28.599 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.592+0000 7fc46affd640 1 -- 10.20.193.23:0/3586713692 <== mon.0 v1:10.20.193.23:6789/0 9 ==== osd_map(14..14 src has 1..14) ==== 2160+0+0 (unknown 946035718 0 0) 0x7fc46c048cd0 con 0x7fc47c0b7960 2026-02-22T21:35:28.603 INFO:tasks.workunit.client.0.trial023.stderr:2026-02-22T21:35:28.596+0000 7fc46affd640 1 -- 10.20.193.23:0/3586713692 <== mon.0 v1:10.20.193.23:6789/0 10 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (unknown 1092875540 0 3570997608) 0x7fc46c016960 con 0x7fc47c0b7960 2026-02-22T21:35:28.761 INFO:tasks.workunit.client.0.trial023.stderr:no valid command found; 10 closest matches: 2026-02-22T21:35:28.762 INFO:tasks.workunit.client.0.trial023.stderr:pg stat 2026-02-22T21:35:28.762 INFO:tasks.workunit.client.0.trial023.stderr:pg getmap 2026-02-22T21:35:28.762 INFO:tasks.workunit.client.0.trial023.stderr:pg dump [...] 2026-02-22T21:35:28.762 INFO:tasks.workunit.client.0.trial023.stderr:pg dump_json [...] 2026-02-22T21:35:28.762 INFO:tasks.workunit.client.0.trial023.stderr:pg dump_pools_json 2026-02-22T21:35:28.762 INFO:tasks.workunit.client.0.trial023.stderr:pg ls-by-pool [...] 2026-02-22T21:35:28.762 INFO:tasks.workunit.client.0.trial023.stderr:pg ls-by-primary [] [...] 2026-02-22T21:35:28.762 INFO:tasks.workunit.client.0.trial023.stderr:pg ls-by-osd [] [...] 2026-02-22T21:35:28.762 INFO:tasks.workunit.client.0.trial023.stderr:pg ls [] [...] 2026-02-22T21:35:28.762 INFO:tasks.workunit.client.0.trial023.stderr:pg dump_stuck [...] [] 2026-02-22T21:35:28.762 INFO:tasks.workunit.client.0.trial023.stderr:Error EINVAL: invalid command 2026-02-22T21:35:28.765 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:28.765 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.prefix_aa config-key ls 2026-02-22T21:35:28.766 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:28.766 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.prefix_aa config-key ls 2026-02-22T21:35:28.938 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:28.941 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:28.942 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.prefix_aa config-key get daemon-private/osd.123/test-foo 2026-02-22T21:35:28.942 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:28.942 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.prefix_aa config-key get daemon-private/osd.123/test-foo 2026-02-22T21:35:32.113 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:32.117 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:32.117 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.prefix_aa config-key set test/bar 2026-02-22T21:35:32.118 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:32.118 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.prefix_aa config-key set test/bar 2026-02-22T21:35:32.292 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:32.296 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:32.296 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.prefix_aa config-key set client/client.prefix_aa/foo 2026-02-22T21:35:32.296 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:32.296 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.prefix_aa config-key set client/client.prefix_aa/foo 2026-02-22T21:35:32.471 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:32.475 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:32.475 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.allow_bb config-key set client/client.prefix_aa/foo 2026-02-22T21:35:32.728 INFO:tasks.workunit.client.0.trial023.stderr:set client/client.prefix_aa/foo 2026-02-22T21:35:32.737 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.prefix_aa config-key get client/client.prefix_aa/foo 2026-02-22T21:35:33.013 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.prefix_bb config-key set client/client.prefix_aa/bar 2026-02-22T21:35:33.282 INFO:tasks.workunit.client.0.trial023.stderr:set client/client.prefix_aa/bar 2026-02-22T21:35:33.291 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.prefix_aa config-key get client/client.prefix_aa/bar 2026-02-22T21:35:33.570 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.prefix_bb config-key set client/client.prefix_bb/foo 2026-02-22T21:35:33.841 INFO:tasks.workunit.client.0.trial023.stderr:set client/client.prefix_bb/foo 2026-02-22T21:35:33.850 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.prefix_bb config-key get client/client.prefix_bb/foo 2026-02-22T21:35:34.124 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.prefix_bb config-key get client/client.prefix_aa/bar 2026-02-22T21:35:34.124 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:34.125 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.prefix_bb config-key get client/client.prefix_aa/bar 2026-02-22T21:35:34.315 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:34.319 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:34.319 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.prefix_bb config-key ls 2026-02-22T21:35:34.319 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:34.319 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.prefix_bb config-key ls 2026-02-22T21:35:34.491 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:34.496 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:34.496 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.prefix_bb config-key get daemon-private/osd.123/test-foo 2026-02-22T21:35:34.496 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:34.496 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.prefix_bb config-key get daemon-private/osd.123/test-foo 2026-02-22T21:35:34.669 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:34.673 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:34.673 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.prefix_bb config-key get mgr/test-foo 2026-02-22T21:35:34.673 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:34.673 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.prefix_bb config-key get mgr/test-foo 2026-02-22T21:35:34.847 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:34.852 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:34.853 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.prefix_bb config-key get device/test-foo 2026-02-22T21:35:34.853 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:34.853 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.prefix_bb config-key get device/test-foo 2026-02-22T21:35:35.030 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:35.034 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:35.034 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.prefix_bb config-key get test/bar 2026-02-22T21:35:35.034 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:35.035 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.prefix_bb config-key get test/bar 2026-02-22T21:35:35.208 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:35.212 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:35.212 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.prefix_bb config-key set test/bar 2026-02-22T21:35:35.212 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:35.212 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.prefix_bb config-key set test/bar 2026-02-22T21:35:35.389 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:35.393 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:35.393 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.prefix_cc config-key set client/client.match_aa/foo 2026-02-22T21:35:35.647 INFO:tasks.workunit.client.0.trial023.stderr:set client/client.match_aa/foo 2026-02-22T21:35:35.656 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.prefix_cc config-key set client/client.match_bb/foo 2026-02-22T21:35:35.927 INFO:tasks.workunit.client.0.trial023.stderr:set client/client.match_bb/foo 2026-02-22T21:35:35.936 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.prefix_cc config-key get client/client.match_aa/foo 2026-02-22T21:35:36.194 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.prefix_cc config-key get client/client.match_bb/foo 2026-02-22T21:35:36.463 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.prefix_cc config-key set other/prefix 2026-02-22T21:35:36.464 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:36.464 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.prefix_cc config-key set other/prefix 2026-02-22T21:35:36.653 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:36.657 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:36.658 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.prefix_cc config-key get mgr/test-foo 2026-02-22T21:35:36.658 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:36.658 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.prefix_cc config-key get mgr/test-foo 2026-02-22T21:35:36.828 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:36.831 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:36.831 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.prefix_cc config-key ls 2026-02-22T21:35:37.094 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.match_aa config-key get client/client.match_aa/foo 2026-02-22T21:35:37.374 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.match_aa config-key get client/client.match_bb/foo 2026-02-22T21:35:37.374 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:37.375 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.match_aa config-key get client/client.match_bb/foo 2026-02-22T21:35:37.567 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:37.571 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:37.571 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.match_aa config-key set client/client.match_aa/foo 2026-02-22T21:35:37.571 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:37.571 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.match_aa config-key set client/client.match_aa/foo 2026-02-22T21:35:37.743 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:37.746 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:37.746 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.match_bb config-key get client/client.match_bb/foo 2026-02-22T21:35:38.001 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.match_bb config-key set client/client.match_bb/foo 2026-02-22T21:35:38.271 INFO:tasks.workunit.client.0.trial023.stderr:set client/client.match_bb/foo 2026-02-22T21:35:38.279 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.match_bb config-key get client/client.match_aa/foo 2026-02-22T21:35:38.280 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:38.280 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.match_bb config-key get client/client.match_aa/foo 2026-02-22T21:35:38.470 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:38.474 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:38.474 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.match_bb config-key set client/client.match_aa/foo 2026-02-22T21:35:38.474 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:38.474 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.match_bb config-key set client/client.match_aa/foo 2026-02-22T21:35:38.648 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:38.652 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:38.652 INFO:tasks.workunit.client.0.trial023.stderr:+ keys=(daemon-private/osd.123/test-foo mgr/test-foo device/test-foo test/foo client/$prefix_aa/foo client/$prefix_bb/foo client/$match_aa/foo client/$match_bb/foo) 2026-02-22T21:35:38.652 INFO:tasks.workunit.client.0.trial023.stderr:+ for c in $fail_aa $fail_bb $fail_cc $fail_dd $fail_ee $fail_ff $fail_gg 2026-02-22T21:35:38.652 INFO:tasks.workunit.client.0.trial023.stderr:+ for m in get set 2026-02-22T21:35:38.653 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:35:38.653 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_aa config-key get daemon-private/osd.123/test-foo 2026-02-22T21:35:38.653 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:38.653 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_aa config-key get daemon-private/osd.123/test-foo 2026-02-22T21:35:38.825 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:38.830 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:38.830 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:35:38.830 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_aa config-key get mgr/test-foo 2026-02-22T21:35:38.830 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:38.830 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_aa config-key get mgr/test-foo 2026-02-22T21:35:39.004 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:39.007 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:39.008 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:35:39.008 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_aa config-key get device/test-foo 2026-02-22T21:35:39.008 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:39.008 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_aa config-key get device/test-foo 2026-02-22T21:35:39.178 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:39.182 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:39.183 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:35:39.183 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_aa config-key get test/foo 2026-02-22T21:35:39.183 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:39.183 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_aa config-key get test/foo 2026-02-22T21:35:39.354 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:39.357 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:39.357 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:35:39.357 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_aa config-key get client/client.prefix_aa/foo 2026-02-22T21:35:39.357 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:39.357 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_aa config-key get client/client.prefix_aa/foo 2026-02-22T21:35:39.530 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:39.534 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:39.534 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:35:39.534 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_aa config-key get client/client.prefix_bb/foo 2026-02-22T21:35:39.535 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:39.535 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_aa config-key get client/client.prefix_bb/foo 2026-02-22T21:35:39.710 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:39.713 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:39.713 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:35:39.713 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_aa config-key get client/client.match_aa/foo 2026-02-22T21:35:39.713 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:39.713 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_aa config-key get client/client.match_aa/foo 2026-02-22T21:35:39.888 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:39.892 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:39.892 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:35:39.892 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_aa config-key get client/client.match_bb/foo 2026-02-22T21:35:39.892 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:39.892 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_aa config-key get client/client.match_bb/foo 2026-02-22T21:35:40.065 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:40.068 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:40.068 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:35:40.068 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_aa config-key get client/client.prefix_aa/foo 2026-02-22T21:35:40.068 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:40.068 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_aa config-key get client/client.prefix_aa/foo 2026-02-22T21:35:40.242 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:40.246 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:40.246 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:35:40.246 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_aa config-key get client/client.prefix_bb/foo 2026-02-22T21:35:40.246 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:40.246 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_aa config-key get client/client.prefix_bb/foo 2026-02-22T21:35:40.419 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:40.423 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:40.423 INFO:tasks.workunit.client.0.trial023.stderr:+ for m in get set 2026-02-22T21:35:40.423 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:35:40.423 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_aa config-key set daemon-private/osd.123/test-foo 2026-02-22T21:35:40.423 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:40.424 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_aa config-key set daemon-private/osd.123/test-foo 2026-02-22T21:35:43.600 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:43.604 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:43.604 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:35:43.604 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_aa config-key set mgr/test-foo 2026-02-22T21:35:43.604 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:43.604 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_aa config-key set mgr/test-foo 2026-02-22T21:35:43.778 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:43.783 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:43.783 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:35:43.783 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_aa config-key set device/test-foo 2026-02-22T21:35:43.783 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:43.783 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_aa config-key set device/test-foo 2026-02-22T21:35:46.957 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:46.960 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:46.960 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:35:46.960 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_aa config-key set test/foo 2026-02-22T21:35:46.960 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:46.960 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_aa config-key set test/foo 2026-02-22T21:35:47.141 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:47.146 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:47.146 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:35:47.146 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_aa config-key set client/client.prefix_aa/foo 2026-02-22T21:35:47.146 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:47.146 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_aa config-key set client/client.prefix_aa/foo 2026-02-22T21:35:50.323 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:50.327 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:50.328 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:35:50.328 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_aa config-key set client/client.prefix_bb/foo 2026-02-22T21:35:50.328 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:50.328 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_aa config-key set client/client.prefix_bb/foo 2026-02-22T21:35:50.501 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:50.505 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:50.505 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:35:50.505 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_aa config-key set client/client.match_aa/foo 2026-02-22T21:35:50.505 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:50.505 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_aa config-key set client/client.match_aa/foo 2026-02-22T21:35:50.680 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:50.684 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:50.684 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:35:50.684 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_aa config-key set client/client.match_bb/foo 2026-02-22T21:35:50.684 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:50.684 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_aa config-key set client/client.match_bb/foo 2026-02-22T21:35:50.861 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:50.864 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:50.864 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:35:50.864 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_aa config-key set client/client.prefix_aa/foo 2026-02-22T21:35:50.864 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:50.864 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_aa config-key set client/client.prefix_aa/foo 2026-02-22T21:35:54.037 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:54.041 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:54.041 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:35:54.042 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_aa config-key set client/client.prefix_bb/foo 2026-02-22T21:35:54.042 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:54.042 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_aa config-key set client/client.prefix_bb/foo 2026-02-22T21:35:54.216 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:54.221 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:54.221 INFO:tasks.workunit.client.0.trial023.stderr:+ for c in $fail_aa $fail_bb $fail_cc $fail_dd $fail_ee $fail_ff $fail_gg 2026-02-22T21:35:54.221 INFO:tasks.workunit.client.0.trial023.stderr:+ for m in get set 2026-02-22T21:35:54.221 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:35:54.221 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_bb config-key get daemon-private/osd.123/test-foo 2026-02-22T21:35:54.221 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:54.221 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_bb config-key get daemon-private/osd.123/test-foo 2026-02-22T21:35:54.394 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:54.398 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:54.399 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:35:54.399 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_bb config-key get mgr/test-foo 2026-02-22T21:35:54.399 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:54.399 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_bb config-key get mgr/test-foo 2026-02-22T21:35:54.575 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:54.579 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:54.579 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:35:54.579 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_bb config-key get device/test-foo 2026-02-22T21:35:54.579 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:54.579 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_bb config-key get device/test-foo 2026-02-22T21:35:54.752 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:54.755 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:54.755 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:35:54.755 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_bb config-key get test/foo 2026-02-22T21:35:54.755 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:54.755 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_bb config-key get test/foo 2026-02-22T21:35:54.926 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:54.931 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:54.931 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:35:54.931 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_bb config-key get client/client.prefix_aa/foo 2026-02-22T21:35:54.931 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:54.931 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_bb config-key get client/client.prefix_aa/foo 2026-02-22T21:35:55.107 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:55.110 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:55.110 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:35:55.110 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_bb config-key get client/client.prefix_bb/foo 2026-02-22T21:35:55.110 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:55.110 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_bb config-key get client/client.prefix_bb/foo 2026-02-22T21:35:55.285 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:55.288 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:55.288 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:35:55.288 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_bb config-key get client/client.match_aa/foo 2026-02-22T21:35:55.288 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:55.288 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_bb config-key get client/client.match_aa/foo 2026-02-22T21:35:55.476 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:55.479 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:55.479 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:35:55.479 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_bb config-key get client/client.match_bb/foo 2026-02-22T21:35:55.479 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:55.479 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_bb config-key get client/client.match_bb/foo 2026-02-22T21:35:55.653 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:55.657 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:55.657 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:35:55.657 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_bb config-key get client/client.prefix_aa/foo 2026-02-22T21:35:55.657 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:55.657 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_bb config-key get client/client.prefix_aa/foo 2026-02-22T21:35:55.829 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:55.833 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:55.833 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:35:55.833 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_bb config-key get client/client.prefix_bb/foo 2026-02-22T21:35:55.833 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:55.834 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_bb config-key get client/client.prefix_bb/foo 2026-02-22T21:35:56.006 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:56.010 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:56.010 INFO:tasks.workunit.client.0.trial023.stderr:+ for m in get set 2026-02-22T21:35:56.010 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:35:56.010 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_bb config-key set daemon-private/osd.123/test-foo 2026-02-22T21:35:56.010 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:56.010 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_bb config-key set daemon-private/osd.123/test-foo 2026-02-22T21:35:56.183 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:56.187 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:56.188 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:35:56.188 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_bb config-key set mgr/test-foo 2026-02-22T21:35:56.188 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:56.188 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_bb config-key set mgr/test-foo 2026-02-22T21:35:56.361 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:56.365 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:56.365 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:35:56.365 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_bb config-key set device/test-foo 2026-02-22T21:35:56.365 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:56.365 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_bb config-key set device/test-foo 2026-02-22T21:35:59.537 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:59.542 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:59.542 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:35:59.542 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_bb config-key set test/foo 2026-02-22T21:35:59.542 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:59.542 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_bb config-key set test/foo 2026-02-22T21:35:59.717 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:59.721 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:59.721 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:35:59.722 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_bb config-key set client/client.prefix_aa/foo 2026-02-22T21:35:59.722 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:59.722 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_bb config-key set client/client.prefix_aa/foo 2026-02-22T21:35:59.894 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:35:59.898 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:35:59.898 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:35:59.898 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_bb config-key set client/client.prefix_bb/foo 2026-02-22T21:35:59.898 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:35:59.898 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_bb config-key set client/client.prefix_bb/foo 2026-02-22T21:36:00.069 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:00.073 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:00.073 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:00.073 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_bb config-key set client/client.match_aa/foo 2026-02-22T21:36:00.073 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:00.073 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_bb config-key set client/client.match_aa/foo 2026-02-22T21:36:00.248 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:00.252 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:00.253 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:00.253 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_bb config-key set client/client.match_bb/foo 2026-02-22T21:36:00.253 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:00.253 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_bb config-key set client/client.match_bb/foo 2026-02-22T21:36:00.425 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:00.429 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:00.429 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:00.429 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_bb config-key set client/client.prefix_aa/foo 2026-02-22T21:36:00.429 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:00.429 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_bb config-key set client/client.prefix_aa/foo 2026-02-22T21:36:00.603 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:00.607 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:00.607 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:00.607 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_bb config-key set client/client.prefix_bb/foo 2026-02-22T21:36:00.607 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:00.607 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_bb config-key set client/client.prefix_bb/foo 2026-02-22T21:36:00.780 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:00.784 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:00.784 INFO:tasks.workunit.client.0.trial023.stderr:+ for c in $fail_aa $fail_bb $fail_cc $fail_dd $fail_ee $fail_ff $fail_gg 2026-02-22T21:36:00.784 INFO:tasks.workunit.client.0.trial023.stderr:+ for m in get set 2026-02-22T21:36:00.784 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:00.784 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_cc config-key get daemon-private/osd.123/test-foo 2026-02-22T21:36:00.784 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:00.784 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_cc config-key get daemon-private/osd.123/test-foo 2026-02-22T21:36:00.958 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:00.961 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:00.961 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:00.961 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_cc config-key get mgr/test-foo 2026-02-22T21:36:00.962 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:00.962 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_cc config-key get mgr/test-foo 2026-02-22T21:36:01.135 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:01.138 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:01.138 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:01.138 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_cc config-key get device/test-foo 2026-02-22T21:36:01.138 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:01.138 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_cc config-key get device/test-foo 2026-02-22T21:36:01.311 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:01.315 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:01.315 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:01.316 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_cc config-key get test/foo 2026-02-22T21:36:01.316 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:01.316 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_cc config-key get test/foo 2026-02-22T21:36:01.487 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:01.491 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:01.491 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:01.491 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_cc config-key get client/client.prefix_aa/foo 2026-02-22T21:36:01.491 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:01.491 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_cc config-key get client/client.prefix_aa/foo 2026-02-22T21:36:01.660 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:01.665 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:01.665 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:01.665 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_cc config-key get client/client.prefix_bb/foo 2026-02-22T21:36:01.665 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:01.665 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_cc config-key get client/client.prefix_bb/foo 2026-02-22T21:36:01.840 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:01.843 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:01.843 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:01.843 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_cc config-key get client/client.match_aa/foo 2026-02-22T21:36:01.843 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:01.843 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_cc config-key get client/client.match_aa/foo 2026-02-22T21:36:02.017 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:02.021 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:02.021 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:02.021 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_cc config-key get client/client.match_bb/foo 2026-02-22T21:36:02.022 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:02.022 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_cc config-key get client/client.match_bb/foo 2026-02-22T21:36:02.196 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:02.200 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:02.200 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:02.200 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_cc config-key get client/client.prefix_aa/foo 2026-02-22T21:36:02.200 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:02.201 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_cc config-key get client/client.prefix_aa/foo 2026-02-22T21:36:02.369 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:02.373 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:02.373 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:02.373 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_cc config-key get client/client.prefix_bb/foo 2026-02-22T21:36:02.374 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:02.374 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_cc config-key get client/client.prefix_bb/foo 2026-02-22T21:36:02.547 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:02.551 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:02.551 INFO:tasks.workunit.client.0.trial023.stderr:+ for m in get set 2026-02-22T21:36:02.551 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:02.551 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_cc config-key set daemon-private/osd.123/test-foo 2026-02-22T21:36:02.551 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:02.551 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_cc config-key set daemon-private/osd.123/test-foo 2026-02-22T21:36:02.720 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:02.722 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:02.722 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:02.722 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_cc config-key set mgr/test-foo 2026-02-22T21:36:02.722 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:02.723 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_cc config-key set mgr/test-foo 2026-02-22T21:36:02.893 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:02.898 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:02.898 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:02.898 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_cc config-key set device/test-foo 2026-02-22T21:36:02.898 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:02.898 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_cc config-key set device/test-foo 2026-02-22T21:36:03.068 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:03.073 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:03.073 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:03.073 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_cc config-key set test/foo 2026-02-22T21:36:03.073 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:03.073 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_cc config-key set test/foo 2026-02-22T21:36:03.247 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:03.251 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:03.251 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:03.251 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_cc config-key set client/client.prefix_aa/foo 2026-02-22T21:36:03.251 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:03.252 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_cc config-key set client/client.prefix_aa/foo 2026-02-22T21:36:03.423 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:03.427 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:03.427 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:03.427 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_cc config-key set client/client.prefix_bb/foo 2026-02-22T21:36:03.427 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:03.427 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_cc config-key set client/client.prefix_bb/foo 2026-02-22T21:36:03.596 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:03.601 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:03.601 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:03.601 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_cc config-key set client/client.match_aa/foo 2026-02-22T21:36:03.601 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:03.601 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_cc config-key set client/client.match_aa/foo 2026-02-22T21:36:03.773 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:03.777 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:03.778 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:03.778 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_cc config-key set client/client.match_bb/foo 2026-02-22T21:36:03.778 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:03.778 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_cc config-key set client/client.match_bb/foo 2026-02-22T21:36:03.951 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:03.955 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:03.955 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:03.955 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_cc config-key set client/client.prefix_aa/foo 2026-02-22T21:36:03.955 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:03.955 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_cc config-key set client/client.prefix_aa/foo 2026-02-22T21:36:04.126 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:04.130 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:04.130 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:04.131 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_cc config-key set client/client.prefix_bb/foo 2026-02-22T21:36:04.131 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:04.131 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_cc config-key set client/client.prefix_bb/foo 2026-02-22T21:36:04.305 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:04.310 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:04.310 INFO:tasks.workunit.client.0.trial023.stderr:+ for c in $fail_aa $fail_bb $fail_cc $fail_dd $fail_ee $fail_ff $fail_gg 2026-02-22T21:36:04.310 INFO:tasks.workunit.client.0.trial023.stderr:+ for m in get set 2026-02-22T21:36:04.311 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:04.311 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_dd config-key get daemon-private/osd.123/test-foo 2026-02-22T21:36:04.311 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:04.311 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_dd config-key get daemon-private/osd.123/test-foo 2026-02-22T21:36:04.682 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:04.686 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:04.686 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:04.686 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_dd config-key get mgr/test-foo 2026-02-22T21:36:04.686 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:04.686 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_dd config-key get mgr/test-foo 2026-02-22T21:36:05.057 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:05.061 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:05.061 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:05.061 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_dd config-key get device/test-foo 2026-02-22T21:36:05.061 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:05.061 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_dd config-key get device/test-foo 2026-02-22T21:36:05.230 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:05.234 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:05.234 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:05.234 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_dd config-key get test/foo 2026-02-22T21:36:05.234 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:05.235 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_dd config-key get test/foo 2026-02-22T21:36:05.409 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:05.412 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:05.413 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:05.413 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_dd config-key get client/client.prefix_aa/foo 2026-02-22T21:36:05.413 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:05.413 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_dd config-key get client/client.prefix_aa/foo 2026-02-22T21:36:05.588 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:05.591 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:05.591 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:05.591 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_dd config-key get client/client.prefix_bb/foo 2026-02-22T21:36:05.591 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:05.592 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_dd config-key get client/client.prefix_bb/foo 2026-02-22T21:36:05.766 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:05.770 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:05.770 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:05.770 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_dd config-key get client/client.match_aa/foo 2026-02-22T21:36:05.770 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:05.771 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_dd config-key get client/client.match_aa/foo 2026-02-22T21:36:05.945 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:05.949 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:05.949 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:05.949 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_dd config-key get client/client.match_bb/foo 2026-02-22T21:36:05.949 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:05.949 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_dd config-key get client/client.match_bb/foo 2026-02-22T21:36:09.143 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:09.148 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:09.148 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:09.148 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_dd config-key get client/client.prefix_aa/foo 2026-02-22T21:36:09.148 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:09.148 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_dd config-key get client/client.prefix_aa/foo 2026-02-22T21:36:09.320 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:09.324 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:09.324 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:09.324 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_dd config-key get client/client.prefix_bb/foo 2026-02-22T21:36:09.324 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:09.324 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_dd config-key get client/client.prefix_bb/foo 2026-02-22T21:36:09.495 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:09.499 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:09.499 INFO:tasks.workunit.client.0.trial023.stderr:+ for m in get set 2026-02-22T21:36:09.500 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:09.500 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_dd config-key set daemon-private/osd.123/test-foo 2026-02-22T21:36:09.500 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:09.500 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_dd config-key set daemon-private/osd.123/test-foo 2026-02-22T21:36:09.671 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:09.675 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:09.676 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:09.676 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_dd config-key set mgr/test-foo 2026-02-22T21:36:09.676 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:09.676 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_dd config-key set mgr/test-foo 2026-02-22T21:36:09.846 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:09.850 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:09.850 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:09.850 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_dd config-key set device/test-foo 2026-02-22T21:36:09.851 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:09.851 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_dd config-key set device/test-foo 2026-02-22T21:36:10.025 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:10.029 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:10.030 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:10.030 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_dd config-key set test/foo 2026-02-22T21:36:10.030 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:10.030 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_dd config-key set test/foo 2026-02-22T21:36:10.200 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:10.204 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:10.204 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:10.204 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_dd config-key set client/client.prefix_aa/foo 2026-02-22T21:36:10.204 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:10.204 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_dd config-key set client/client.prefix_aa/foo 2026-02-22T21:36:10.379 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:10.383 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:10.383 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:10.383 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_dd config-key set client/client.prefix_bb/foo 2026-02-22T21:36:10.384 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:10.384 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_dd config-key set client/client.prefix_bb/foo 2026-02-22T21:36:10.553 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:10.557 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:10.558 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:10.558 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_dd config-key set client/client.match_aa/foo 2026-02-22T21:36:10.558 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:10.558 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_dd config-key set client/client.match_aa/foo 2026-02-22T21:36:10.733 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:10.736 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:10.736 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:10.736 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_dd config-key set client/client.match_bb/foo 2026-02-22T21:36:10.736 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:10.736 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_dd config-key set client/client.match_bb/foo 2026-02-22T21:36:10.914 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:10.918 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:10.919 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:10.919 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_dd config-key set client/client.prefix_aa/foo 2026-02-22T21:36:10.919 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:10.919 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_dd config-key set client/client.prefix_aa/foo 2026-02-22T21:36:11.097 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:11.101 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:11.101 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:11.101 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_dd config-key set client/client.prefix_bb/foo 2026-02-22T21:36:11.101 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:11.101 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_dd config-key set client/client.prefix_bb/foo 2026-02-22T21:36:11.274 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:11.278 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:11.278 INFO:tasks.workunit.client.0.trial023.stderr:+ for c in $fail_aa $fail_bb $fail_cc $fail_dd $fail_ee $fail_ff $fail_gg 2026-02-22T21:36:11.278 INFO:tasks.workunit.client.0.trial023.stderr:+ for m in get set 2026-02-22T21:36:11.279 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:11.279 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ee config-key get daemon-private/osd.123/test-foo 2026-02-22T21:36:11.279 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:11.279 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ee config-key get daemon-private/osd.123/test-foo 2026-02-22T21:36:11.453 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:11.457 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:11.457 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:11.457 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ee config-key get mgr/test-foo 2026-02-22T21:36:11.457 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:11.457 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ee config-key get mgr/test-foo 2026-02-22T21:36:14.634 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:14.639 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:14.639 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:14.639 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ee config-key get device/test-foo 2026-02-22T21:36:14.639 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:14.639 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ee config-key get device/test-foo 2026-02-22T21:36:14.813 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:14.817 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:14.817 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:14.817 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ee config-key get test/foo 2026-02-22T21:36:14.817 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:14.817 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ee config-key get test/foo 2026-02-22T21:36:17.995 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:18.000 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:18.000 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:18.000 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ee config-key get client/client.prefix_aa/foo 2026-02-22T21:36:18.000 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:18.000 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ee config-key get client/client.prefix_aa/foo 2026-02-22T21:36:18.171 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:18.176 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:18.176 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:18.176 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ee config-key get client/client.prefix_bb/foo 2026-02-22T21:36:18.176 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:18.177 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ee config-key get client/client.prefix_bb/foo 2026-02-22T21:36:18.349 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:18.353 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:18.353 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:18.353 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ee config-key get client/client.match_aa/foo 2026-02-22T21:36:18.354 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:18.354 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ee config-key get client/client.match_aa/foo 2026-02-22T21:36:18.526 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:18.530 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:18.530 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:18.530 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ee config-key get client/client.match_bb/foo 2026-02-22T21:36:18.530 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:18.530 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ee config-key get client/client.match_bb/foo 2026-02-22T21:36:18.701 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:18.705 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:18.705 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:18.705 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ee config-key get client/client.prefix_aa/foo 2026-02-22T21:36:18.705 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:18.705 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ee config-key get client/client.prefix_aa/foo 2026-02-22T21:36:18.879 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:18.883 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:18.883 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:18.883 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ee config-key get client/client.prefix_bb/foo 2026-02-22T21:36:18.883 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:18.883 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ee config-key get client/client.prefix_bb/foo 2026-02-22T21:36:19.053 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:19.058 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:19.058 INFO:tasks.workunit.client.0.trial023.stderr:+ for m in get set 2026-02-22T21:36:19.058 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:19.058 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ee config-key set daemon-private/osd.123/test-foo 2026-02-22T21:36:19.058 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:19.058 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ee config-key set daemon-private/osd.123/test-foo 2026-02-22T21:36:19.230 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:19.234 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:19.235 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:19.235 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ee config-key set mgr/test-foo 2026-02-22T21:36:19.235 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:19.235 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ee config-key set mgr/test-foo 2026-02-22T21:36:19.405 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:19.408 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:19.408 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:19.408 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ee config-key set device/test-foo 2026-02-22T21:36:19.408 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:19.408 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ee config-key set device/test-foo 2026-02-22T21:36:19.583 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:19.587 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:19.587 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:19.587 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ee config-key set test/foo 2026-02-22T21:36:19.587 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:19.587 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ee config-key set test/foo 2026-02-22T21:36:19.758 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:19.763 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:19.763 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:19.763 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ee config-key set client/client.prefix_aa/foo 2026-02-22T21:36:19.763 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:19.763 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ee config-key set client/client.prefix_aa/foo 2026-02-22T21:36:22.936 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:22.940 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:22.940 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:22.940 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ee config-key set client/client.prefix_bb/foo 2026-02-22T21:36:22.941 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:22.941 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ee config-key set client/client.prefix_bb/foo 2026-02-22T21:36:29.115 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:29.119 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:29.120 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:29.120 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ee config-key set client/client.match_aa/foo 2026-02-22T21:36:29.120 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:29.120 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ee config-key set client/client.match_aa/foo 2026-02-22T21:36:29.294 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:29.298 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:29.298 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:29.298 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ee config-key set client/client.match_bb/foo 2026-02-22T21:36:29.298 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:29.298 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ee config-key set client/client.match_bb/foo 2026-02-22T21:36:29.470 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:29.474 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:29.475 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:29.475 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ee config-key set client/client.prefix_aa/foo 2026-02-22T21:36:29.475 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:29.475 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ee config-key set client/client.prefix_aa/foo 2026-02-22T21:36:29.645 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:29.649 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:29.649 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:29.649 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ee config-key set client/client.prefix_bb/foo 2026-02-22T21:36:29.649 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:29.649 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ee config-key set client/client.prefix_bb/foo 2026-02-22T21:36:29.823 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:29.827 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:29.828 INFO:tasks.workunit.client.0.trial023.stderr:+ for c in $fail_aa $fail_bb $fail_cc $fail_dd $fail_ee $fail_ff $fail_gg 2026-02-22T21:36:29.828 INFO:tasks.workunit.client.0.trial023.stderr:+ for m in get set 2026-02-22T21:36:29.828 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:29.828 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ff config-key get daemon-private/osd.123/test-foo 2026-02-22T21:36:29.828 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:29.828 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ff config-key get daemon-private/osd.123/test-foo 2026-02-22T21:36:29.999 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:30.003 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:30.003 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:30.003 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ff config-key get mgr/test-foo 2026-02-22T21:36:30.003 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:30.003 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ff config-key get mgr/test-foo 2026-02-22T21:36:30.176 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:30.179 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:30.179 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:30.179 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ff config-key get device/test-foo 2026-02-22T21:36:30.179 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:30.179 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ff config-key get device/test-foo 2026-02-22T21:36:30.349 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:30.352 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:30.352 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:30.352 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ff config-key get test/foo 2026-02-22T21:36:30.352 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:30.352 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ff config-key get test/foo 2026-02-22T21:36:30.524 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:30.529 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:30.529 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:30.529 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ff config-key get client/client.prefix_aa/foo 2026-02-22T21:36:30.529 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:30.529 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ff config-key get client/client.prefix_aa/foo 2026-02-22T21:36:30.702 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:30.706 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:30.706 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:30.706 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ff config-key get client/client.prefix_bb/foo 2026-02-22T21:36:30.706 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:30.706 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ff config-key get client/client.prefix_bb/foo 2026-02-22T21:36:30.882 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:30.887 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:30.887 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:30.887 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ff config-key get client/client.match_aa/foo 2026-02-22T21:36:30.888 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:30.888 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ff config-key get client/client.match_aa/foo 2026-02-22T21:36:31.061 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:31.064 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:31.064 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:31.064 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ff config-key get client/client.match_bb/foo 2026-02-22T21:36:31.064 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:31.064 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ff config-key get client/client.match_bb/foo 2026-02-22T21:36:31.237 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:31.240 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:31.240 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:31.240 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ff config-key get client/client.prefix_aa/foo 2026-02-22T21:36:31.240 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:31.240 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ff config-key get client/client.prefix_aa/foo 2026-02-22T21:36:31.415 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:31.419 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:31.419 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:31.420 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ff config-key get client/client.prefix_bb/foo 2026-02-22T21:36:31.420 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:31.420 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ff config-key get client/client.prefix_bb/foo 2026-02-22T21:36:31.593 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:31.597 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:31.598 INFO:tasks.workunit.client.0.trial023.stderr:+ for m in get set 2026-02-22T21:36:31.598 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:31.598 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ff config-key set daemon-private/osd.123/test-foo 2026-02-22T21:36:31.598 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:31.598 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ff config-key set daemon-private/osd.123/test-foo 2026-02-22T21:36:31.769 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:31.772 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:31.772 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:31.772 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ff config-key set mgr/test-foo 2026-02-22T21:36:31.772 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:31.772 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ff config-key set mgr/test-foo 2026-02-22T21:36:31.945 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:31.949 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:31.949 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:31.949 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ff config-key set device/test-foo 2026-02-22T21:36:31.949 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:31.949 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ff config-key set device/test-foo 2026-02-22T21:36:32.122 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:32.125 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:32.125 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:32.126 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ff config-key set test/foo 2026-02-22T21:36:32.126 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:32.126 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ff config-key set test/foo 2026-02-22T21:36:32.297 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:32.301 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:32.301 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:32.301 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ff config-key set client/client.prefix_aa/foo 2026-02-22T21:36:32.301 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:32.301 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ff config-key set client/client.prefix_aa/foo 2026-02-22T21:36:32.473 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:32.476 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:32.477 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:32.477 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ff config-key set client/client.prefix_bb/foo 2026-02-22T21:36:32.477 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:32.477 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ff config-key set client/client.prefix_bb/foo 2026-02-22T21:36:32.646 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:32.650 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:32.651 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:32.651 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ff config-key set client/client.match_aa/foo 2026-02-22T21:36:32.651 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:32.651 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ff config-key set client/client.match_aa/foo 2026-02-22T21:36:32.826 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:32.830 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:32.831 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:32.831 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ff config-key set client/client.match_bb/foo 2026-02-22T21:36:32.831 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:32.831 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ff config-key set client/client.match_bb/foo 2026-02-22T21:36:33.005 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:33.009 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:33.009 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:33.009 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ff config-key set client/client.prefix_aa/foo 2026-02-22T21:36:33.009 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:33.009 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ff config-key set client/client.prefix_aa/foo 2026-02-22T21:36:33.181 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:33.185 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:33.185 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:33.185 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ff config-key set client/client.prefix_bb/foo 2026-02-22T21:36:33.185 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:33.185 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_ff config-key set client/client.prefix_bb/foo 2026-02-22T21:36:33.360 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:33.364 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:33.365 INFO:tasks.workunit.client.0.trial023.stderr:+ for c in $fail_aa $fail_bb $fail_cc $fail_dd $fail_ee $fail_ff $fail_gg 2026-02-22T21:36:33.365 INFO:tasks.workunit.client.0.trial023.stderr:+ for m in get set 2026-02-22T21:36:33.365 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:33.365 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_gg config-key get daemon-private/osd.123/test-foo 2026-02-22T21:36:33.365 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:33.365 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_gg config-key get daemon-private/osd.123/test-foo 2026-02-22T21:36:33.540 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:33.544 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:33.544 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:33.544 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_gg config-key get mgr/test-foo 2026-02-22T21:36:33.544 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:33.544 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_gg config-key get mgr/test-foo 2026-02-22T21:36:33.717 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:33.721 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:33.721 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:33.721 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_gg config-key get device/test-foo 2026-02-22T21:36:33.721 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:33.721 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_gg config-key get device/test-foo 2026-02-22T21:36:33.893 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:33.898 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:33.898 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:33.898 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_gg config-key get test/foo 2026-02-22T21:36:33.898 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:33.898 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_gg config-key get test/foo 2026-02-22T21:36:34.072 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:34.076 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:34.076 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:34.076 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_gg config-key get client/client.prefix_aa/foo 2026-02-22T21:36:34.076 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:34.076 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_gg config-key get client/client.prefix_aa/foo 2026-02-22T21:36:34.246 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:34.250 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:34.250 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:34.251 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_gg config-key get client/client.prefix_bb/foo 2026-02-22T21:36:34.251 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:34.251 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_gg config-key get client/client.prefix_bb/foo 2026-02-22T21:36:34.420 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:34.424 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:34.424 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:34.425 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_gg config-key get client/client.match_aa/foo 2026-02-22T21:36:34.425 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:34.425 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_gg config-key get client/client.match_aa/foo 2026-02-22T21:36:34.595 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:34.599 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:34.599 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:34.599 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_gg config-key get client/client.match_bb/foo 2026-02-22T21:36:34.599 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:34.599 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_gg config-key get client/client.match_bb/foo 2026-02-22T21:36:34.770 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:34.774 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:34.774 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:34.774 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_gg config-key get client/client.prefix_aa/foo 2026-02-22T21:36:34.775 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:34.775 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_gg config-key get client/client.prefix_aa/foo 2026-02-22T21:36:34.946 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:34.950 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:34.951 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:34.951 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_gg config-key get client/client.prefix_bb/foo 2026-02-22T21:36:34.951 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:34.951 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_gg config-key get client/client.prefix_bb/foo 2026-02-22T21:36:35.125 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:35.129 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:35.129 INFO:tasks.workunit.client.0.trial023.stderr:+ for m in get set 2026-02-22T21:36:35.129 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:35.130 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_gg config-key set daemon-private/osd.123/test-foo 2026-02-22T21:36:35.130 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:35.130 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_gg config-key set daemon-private/osd.123/test-foo 2026-02-22T21:36:35.309 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:35.313 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:35.313 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:35.313 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_gg config-key set mgr/test-foo 2026-02-22T21:36:35.313 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:35.313 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_gg config-key set mgr/test-foo 2026-02-22T21:36:35.486 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:35.490 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:35.490 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:35.490 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_gg config-key set device/test-foo 2026-02-22T21:36:35.490 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:35.490 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_gg config-key set device/test-foo 2026-02-22T21:36:35.664 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:35.667 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:35.668 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:35.668 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_gg config-key set test/foo 2026-02-22T21:36:35.668 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:35.668 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_gg config-key set test/foo 2026-02-22T21:36:35.841 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:35.845 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:35.845 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:35.845 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_gg config-key set client/client.prefix_aa/foo 2026-02-22T21:36:35.845 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:35.845 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_gg config-key set client/client.prefix_aa/foo 2026-02-22T21:36:36.022 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:36.026 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:36.026 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:36.027 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_gg config-key set client/client.prefix_bb/foo 2026-02-22T21:36:36.027 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:36.027 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_gg config-key set client/client.prefix_bb/foo 2026-02-22T21:36:36.201 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:36.204 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:36.204 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:36.205 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_gg config-key set client/client.match_aa/foo 2026-02-22T21:36:36.205 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:36.205 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_gg config-key set client/client.match_aa/foo 2026-02-22T21:36:36.379 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:36.383 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:36.383 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:36.384 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_gg config-key set client/client.match_bb/foo 2026-02-22T21:36:36.384 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:36.384 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_gg config-key set client/client.match_bb/foo 2026-02-22T21:36:36.559 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:36.564 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:36.564 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:36.564 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_gg config-key set client/client.prefix_aa/foo 2026-02-22T21:36:36.564 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:36.564 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_gg config-key set client/client.prefix_aa/foo 2026-02-22T21:36:36.738 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:36.742 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:36.742 INFO:tasks.workunit.client.0.trial023.stderr:+ for key in ${keys[*]} client/$prefix_aa/foo client/$prefix_bb/foo 2026-02-22T21:36:36.742 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_gg config-key set client/client.prefix_bb/foo 2026-02-22T21:36:36.742 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:36.742 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_gg config-key set client/client.prefix_bb/foo 2026-02-22T21:36:36.914 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:36.917 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:36.917 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_writes config-key set client/client.match_aa/foo 2026-02-22T21:36:36.917 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:36.917 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_writes config-key set client/client.match_aa/foo 2026-02-22T21:36:37.091 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:37.095 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:37.095 INFO:tasks.workunit.client.0.trial023.stderr:+ expect_false ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_writes config-key set test/foo 2026-02-22T21:36:37.095 INFO:tasks.workunit.client.0.trial023.stderr:+ set -x 2026-02-22T21:36:37.096 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_writes config-key set test/foo 2026-02-22T21:36:37.266 INFO:tasks.workunit.client.0.trial023.stderr:Error EACCES: access denied 2026-02-22T21:36:37.269 INFO:tasks.workunit.client.0.trial023.stderr:+ return 0 2026-02-22T21:36:37.269 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_writes config-key ls 2026-02-22T21:36:37.523 INFO:tasks.workunit.client.0.trial023.stdout:[ 2026-02-22T21:36:37.523 INFO:tasks.workunit.client.0.trial023.stdout: "client/client.match_aa/foo", 2026-02-22T21:36:37.523 INFO:tasks.workunit.client.0.trial023.stdout: "client/client.match_bb/foo", 2026-02-22T21:36:37.523 INFO:tasks.workunit.client.0.trial023.stdout: "client/client.prefix_aa/bar", 2026-02-22T21:36:37.523 INFO:tasks.workunit.client.0.trial023.stdout: "client/client.prefix_aa/foo", 2026-02-22T21:36:37.523 INFO:tasks.workunit.client.0.trial023.stdout: "client/client.prefix_bb/foo", 2026-02-22T21:36:37.524 INFO:tasks.workunit.client.0.trial023.stdout: "config-history/2/", 2026-02-22T21:36:37.524 INFO:tasks.workunit.client.0.trial023.stdout: "config-history/2/+mgr/mgr_pool", 2026-02-22T21:36:37.524 INFO:tasks.workunit.client.0.trial023.stdout: "config/mgr/mgr_pool", 2026-02-22T21:36:37.524 INFO:tasks.workunit.client.0.trial023.stdout: "daemon-private/osd.100/test-foo", 2026-02-22T21:36:37.524 INFO:tasks.workunit.client.0.trial023.stdout: "daemon-private/osd.123/test-foo", 2026-02-22T21:36:37.524 INFO:tasks.workunit.client.0.trial023.stdout: "daemon-private/osd.200/test-foo", 2026-02-22T21:36:37.524 INFO:tasks.workunit.client.0.trial023.stdout: "device/test-foo", 2026-02-22T21:36:37.524 INFO:tasks.workunit.client.0.trial023.stdout: "mgr/telemetry/collection", 2026-02-22T21:36:37.524 INFO:tasks.workunit.client.0.trial023.stdout: "mgr/telemetry/report_id", 2026-02-22T21:36:37.524 INFO:tasks.workunit.client.0.trial023.stdout: "mgr/telemetry/salt", 2026-02-22T21:36:37.525 INFO:tasks.workunit.client.0.trial023.stdout: "mgr/test-foo", 2026-02-22T21:36:37.525 INFO:tasks.workunit.client.0.trial023.stdout: "test/foo" 2026-02-22T21:36:37.525 INFO:tasks.workunit.client.0.trial023.stdout:] 2026-02-22T21:36:37.533 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_writes config-key get client/client.match_aa/foo 2026-02-22T21:36:37.795 INFO:tasks.workunit.client.0.trial023.stderr:+ ceph -k /tmp/test_mon_config_key_caps.oiHJL/keyring --name client.fail_writes config-key get daemon-private/osd.123/test-foo 2026-02-22T21:36:38.070 INFO:tasks.workunit.client.0.trial023.stderr:+ echo OK 2026-02-22T21:36:38.070 INFO:tasks.workunit.client.0.trial023.stdout:OK 2026-02-22T21:36:38.070 INFO:tasks.workunit.client.0.trial023.stderr:+ cleanup 2026-02-22T21:36:38.070 INFO:tasks.workunit.client.0.trial023.stderr:+ set +e 2026-02-22T21:36:38.070 INFO:tasks.workunit.client.0.trial023.stderr:+ set +x 2026-02-22T21:36:46.206 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-22T21:36:46.206 DEBUG:teuthology.orchestra.run.trial023:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-22T21:36:46.256 INFO:tasks.workunit:Stopping ['mon/test_config_key_caps.sh'] on client.0... 2026-02-22T21:36:46.256 DEBUG:teuthology.orchestra.run.trial023:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-22T21:36:46.590 DEBUG:teuthology.parallel:result is None 2026-02-22T21:36:46.590 DEBUG:teuthology.orchestra.run.trial023:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2026-02-22T21:36:46.598 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2026-02-22T21:36:46.598 DEBUG:teuthology.orchestra.run.trial023:> rmdir -- /home/ubuntu/cephtest/mnt.0 2026-02-22T21:36:46.644 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2026-02-22T21:36:46.644 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-22T21:36:46.658 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-22T21:36:46.658 DEBUG:teuthology.orchestra.run.trial023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T21:36:46.824 INFO:teuthology.orchestra.run.trial023.stdout: 2026-02-22T21:36:46.824 INFO:teuthology.orchestra.run.trial023.stderr:dumped all 2026-02-22T21:36:46.834 INFO:teuthology.orchestra.run.trial023.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2026-02-22T21:36:45.871423+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81284,"kb_used_data":392,"kb_used_omap":4,"kb_used_meta":80827,"kb_avail":283034236,"statfs":{"total":289910292480,"available":289827057664,"internally_reserved":0,"allocated":401408,"data_stored":94607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":82767186},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001253"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":23,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T21:35:30.135381+0000","last_change":"2026-02-22T21:34:38.965382+0000","last_active":"2026-02-22T21:35:30.135381+0000","last_peered":"2026-02-22T21:35:30.135381+0000","last_clean":"2026-02-22T21:35:30.135381+0000","last_became_active":"2026-02-22T21:34:36.963312+0000","last_became_peered":"2026-02-22T21:34:36.963312+0000","last_unstale":"2026-02-22T21:35:30.135381+0000","last_undegraded":"2026-02-22T21:35:30.135381+0000","last_fullsized":"2026-02-22T21:35:30.135381+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_clean_scrub_stamp":"2026-02-22T21:34:35.955313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:37:28.247229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049982599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":23,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T21:35:30.135395+0000","last_change":"2026-02-22T21:34:38.965537+0000","last_active":"2026-02-22T21:35:30.135395+0000","last_peered":"2026-02-22T21:35:30.135395+0000","last_clean":"2026-02-22T21:35:30.135395+0000","last_became_active":"2026-02-22T21:34:36.963610+0000","last_became_peered":"2026-02-22T21:34:36.963610+0000","last_unstale":"2026-02-22T21:35:30.135395+0000","last_undegraded":"2026-02-22T21:35:30.135395+0000","last_fullsized":"2026-02-22T21:35:30.135395+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_clean_scrub_stamp":"2026-02-22T21:34:35.955313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:16:04.530029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064584699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":24,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T21:35:31.925894+0000","last_change":"2026-02-22T21:34:39.232521+0000","last_active":"2026-02-22T21:35:31.925894+0000","last_peered":"2026-02-22T21:35:31.925894+0000","last_clean":"2026-02-22T21:35:31.925894+0000","last_became_active":"2026-02-22T21:34:36.963683+0000","last_became_peered":"2026-02-22T21:34:36.963683+0000","last_unstale":"2026-02-22T21:35:31.925894+0000","last_undegraded":"2026-02-22T21:35:31.925894+0000","last_fullsized":"2026-02-22T21:35:31.925894+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_clean_scrub_stamp":"2026-02-22T21:34:35.955313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:47:07.759565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035308399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":24,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T21:35:30.135417+0000","last_change":"2026-02-22T21:34:38.965157+0000","last_active":"2026-02-22T21:35:30.135417+0000","last_peered":"2026-02-22T21:35:30.135417+0000","last_clean":"2026-02-22T21:35:30.135417+0000","last_became_active":"2026-02-22T21:34:36.963644+0000","last_became_peered":"2026-02-22T21:34:36.963644+0000","last_unstale":"2026-02-22T21:35:30.135417+0000","last_undegraded":"2026-02-22T21:35:30.135417+0000","last_fullsized":"2026-02-22T21:35:30.135417+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_clean_scrub_stamp":"2026-02-22T21:34:35.955313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T05:03:08.985147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031839999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"11'1","reported_seq":25,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T21:35:30.135400+0000","last_change":"2026-02-22T21:34:38.965365+0000","last_active":"2026-02-22T21:35:30.135400+0000","last_peered":"2026-02-22T21:35:30.135400+0000","last_clean":"2026-02-22T21:35:30.135400+0000","last_became_active":"2026-02-22T21:34:36.963701+0000","last_became_peered":"2026-02-22T21:34:36.963701+0000","last_unstale":"2026-02-22T21:35:30.135400+0000","last_undegraded":"2026-02-22T21:35:30.135400+0000","last_fullsized":"2026-02-22T21:35:30.135400+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_clean_scrub_stamp":"2026-02-22T21:34:35.955313+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:46:14.398511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049378499999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"13'2","reported_seq":26,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T21:35:30.051995+0000","last_change":"2026-02-22T21:34:38.963841+0000","last_active":"2026-02-22T21:35:30.051995+0000","last_peered":"2026-02-22T21:35:30.051995+0000","last_clean":"2026-02-22T21:35:30.051995+0000","last_became_active":"2026-02-22T21:34:36.962995+0000","last_became_peered":"2026-02-22T21:34:36.962995+0000","last_unstale":"2026-02-22T21:35:30.051995+0000","last_undegraded":"2026-02-22T21:35:30.051995+0000","last_fullsized":"2026-02-22T21:35:30.051995+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_clean_scrub_stamp":"2026-02-22T21:34:35.955313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:58:59.891021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059288799999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":24,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T21:35:31.925906+0000","last_change":"2026-02-22T21:34:39.232477+0000","last_active":"2026-02-22T21:35:31.925906+0000","last_peered":"2026-02-22T21:35:31.925906+0000","last_clean":"2026-02-22T21:35:31.925906+0000","last_became_active":"2026-02-22T21:34:36.963686+0000","last_became_peered":"2026-02-22T21:34:36.963686+0000","last_unstale":"2026-02-22T21:35:31.925906+0000","last_undegraded":"2026-02-22T21:35:31.925906+0000","last_fullsized":"2026-02-22T21:35:31.925906+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_clean_scrub_stamp":"2026-02-22T21:34:35.955313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:14:55.770097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031342099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":24,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T21:35:30.135408+0000","last_change":"2026-02-22T21:34:38.965195+0000","last_active":"2026-02-22T21:35:30.135408+0000","last_peered":"2026-02-22T21:35:30.135408+0000","last_clean":"2026-02-22T21:35:30.135408+0000","last_became_active":"2026-02-22T21:34:36.963656+0000","last_became_peered":"2026-02-22T21:34:36.963656+0000","last_unstale":"2026-02-22T21:35:30.135408+0000","last_undegraded":"2026-02-22T21:35:30.135408+0000","last_fullsized":"2026-02-22T21:35:30.135408+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_clean_scrub_stamp":"2026-02-22T21:34:35.955313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:46:09.679467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036378400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":0,"up_from":8,"seq":34359738396,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27096,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344744,"statfs":{"total":96636764160,"available":96609017856,"internally_reserved":0,"allocated":135168,"data_stored":31542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738396,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27092,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344748,"statfs":{"total":96636764160,"available":96609021952,"internally_reserved":0,"allocated":131072,"data_stored":31523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738397,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27096,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344744,"statfs":{"total":96636764160,"available":96609017856,"internally_reserved":0,"allocated":135168,"data_stored":31542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T21:36:46.835 DEBUG:teuthology.orchestra.run.trial023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T21:36:46.976 INFO:teuthology.orchestra.run.trial023.stdout: 2026-02-22T21:36:46.976 INFO:teuthology.orchestra.run.trial023.stderr:dumped all 2026-02-22T21:36:46.986 INFO:teuthology.orchestra.run.trial023.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2026-02-22T21:36:45.871423+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81284,"kb_used_data":392,"kb_used_omap":4,"kb_used_meta":80827,"kb_avail":283034236,"statfs":{"total":289910292480,"available":289827057664,"internally_reserved":0,"allocated":401408,"data_stored":94607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":82767186},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001253"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":23,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T21:35:30.135381+0000","last_change":"2026-02-22T21:34:38.965382+0000","last_active":"2026-02-22T21:35:30.135381+0000","last_peered":"2026-02-22T21:35:30.135381+0000","last_clean":"2026-02-22T21:35:30.135381+0000","last_became_active":"2026-02-22T21:34:36.963312+0000","last_became_peered":"2026-02-22T21:34:36.963312+0000","last_unstale":"2026-02-22T21:35:30.135381+0000","last_undegraded":"2026-02-22T21:35:30.135381+0000","last_fullsized":"2026-02-22T21:35:30.135381+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_clean_scrub_stamp":"2026-02-22T21:34:35.955313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:37:28.247229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049982599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":23,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T21:35:30.135395+0000","last_change":"2026-02-22T21:34:38.965537+0000","last_active":"2026-02-22T21:35:30.135395+0000","last_peered":"2026-02-22T21:35:30.135395+0000","last_clean":"2026-02-22T21:35:30.135395+0000","last_became_active":"2026-02-22T21:34:36.963610+0000","last_became_peered":"2026-02-22T21:34:36.963610+0000","last_unstale":"2026-02-22T21:35:30.135395+0000","last_undegraded":"2026-02-22T21:35:30.135395+0000","last_fullsized":"2026-02-22T21:35:30.135395+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_clean_scrub_stamp":"2026-02-22T21:34:35.955313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:16:04.530029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064584699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":24,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T21:35:31.925894+0000","last_change":"2026-02-22T21:34:39.232521+0000","last_active":"2026-02-22T21:35:31.925894+0000","last_peered":"2026-02-22T21:35:31.925894+0000","last_clean":"2026-02-22T21:35:31.925894+0000","last_became_active":"2026-02-22T21:34:36.963683+0000","last_became_peered":"2026-02-22T21:34:36.963683+0000","last_unstale":"2026-02-22T21:35:31.925894+0000","last_undegraded":"2026-02-22T21:35:31.925894+0000","last_fullsized":"2026-02-22T21:35:31.925894+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_clean_scrub_stamp":"2026-02-22T21:34:35.955313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:47:07.759565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035308399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":24,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T21:35:30.135417+0000","last_change":"2026-02-22T21:34:38.965157+0000","last_active":"2026-02-22T21:35:30.135417+0000","last_peered":"2026-02-22T21:35:30.135417+0000","last_clean":"2026-02-22T21:35:30.135417+0000","last_became_active":"2026-02-22T21:34:36.963644+0000","last_became_peered":"2026-02-22T21:34:36.963644+0000","last_unstale":"2026-02-22T21:35:30.135417+0000","last_undegraded":"2026-02-22T21:35:30.135417+0000","last_fullsized":"2026-02-22T21:35:30.135417+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_clean_scrub_stamp":"2026-02-22T21:34:35.955313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T05:03:08.985147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031839999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"11'1","reported_seq":25,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T21:35:30.135400+0000","last_change":"2026-02-22T21:34:38.965365+0000","last_active":"2026-02-22T21:35:30.135400+0000","last_peered":"2026-02-22T21:35:30.135400+0000","last_clean":"2026-02-22T21:35:30.135400+0000","last_became_active":"2026-02-22T21:34:36.963701+0000","last_became_peered":"2026-02-22T21:34:36.963701+0000","last_unstale":"2026-02-22T21:35:30.135400+0000","last_undegraded":"2026-02-22T21:35:30.135400+0000","last_fullsized":"2026-02-22T21:35:30.135400+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_clean_scrub_stamp":"2026-02-22T21:34:35.955313+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:46:14.398511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049378499999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"13'2","reported_seq":26,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T21:35:30.051995+0000","last_change":"2026-02-22T21:34:38.963841+0000","last_active":"2026-02-22T21:35:30.051995+0000","last_peered":"2026-02-22T21:35:30.051995+0000","last_clean":"2026-02-22T21:35:30.051995+0000","last_became_active":"2026-02-22T21:34:36.962995+0000","last_became_peered":"2026-02-22T21:34:36.962995+0000","last_unstale":"2026-02-22T21:35:30.051995+0000","last_undegraded":"2026-02-22T21:35:30.051995+0000","last_fullsized":"2026-02-22T21:35:30.051995+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_clean_scrub_stamp":"2026-02-22T21:34:35.955313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:58:59.891021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059288799999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":24,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T21:35:31.925906+0000","last_change":"2026-02-22T21:34:39.232477+0000","last_active":"2026-02-22T21:35:31.925906+0000","last_peered":"2026-02-22T21:35:31.925906+0000","last_clean":"2026-02-22T21:35:31.925906+0000","last_became_active":"2026-02-22T21:34:36.963686+0000","last_became_peered":"2026-02-22T21:34:36.963686+0000","last_unstale":"2026-02-22T21:35:31.925906+0000","last_undegraded":"2026-02-22T21:35:31.925906+0000","last_fullsized":"2026-02-22T21:35:31.925906+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_clean_scrub_stamp":"2026-02-22T21:34:35.955313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:14:55.770097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031342099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":24,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T21:35:30.135408+0000","last_change":"2026-02-22T21:34:38.965195+0000","last_active":"2026-02-22T21:35:30.135408+0000","last_peered":"2026-02-22T21:35:30.135408+0000","last_clean":"2026-02-22T21:35:30.135408+0000","last_became_active":"2026-02-22T21:34:36.963656+0000","last_became_peered":"2026-02-22T21:34:36.963656+0000","last_unstale":"2026-02-22T21:35:30.135408+0000","last_undegraded":"2026-02-22T21:35:30.135408+0000","last_fullsized":"2026-02-22T21:35:30.135408+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_clean_scrub_stamp":"2026-02-22T21:34:35.955313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:46:09.679467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036378400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":0,"up_from":8,"seq":34359738396,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27096,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344744,"statfs":{"total":96636764160,"available":96609017856,"internally_reserved":0,"allocated":135168,"data_stored":31542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738396,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27092,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344748,"statfs":{"total":96636764160,"available":96609021952,"internally_reserved":0,"allocated":131072,"data_stored":31523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738397,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27096,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344744,"statfs":{"total":96636764160,"available":96609017856,"internally_reserved":0,"allocated":135168,"data_stored":31542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T21:36:46.987 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-22T21:36:46.987 DEBUG:teuthology.orchestra.run.trial023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T21:36:47.130 INFO:teuthology.orchestra.run.trial023.stdout: 2026-02-22T21:36:47.130 INFO:teuthology.orchestra.run.trial023.stderr:dumped all 2026-02-22T21:36:47.139 INFO:teuthology.orchestra.run.trial023.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2026-02-22T21:36:45.871423+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81284,"kb_used_data":392,"kb_used_omap":4,"kb_used_meta":80827,"kb_avail":283034236,"statfs":{"total":289910292480,"available":289827057664,"internally_reserved":0,"allocated":401408,"data_stored":94607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":82767186},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001253"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":23,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T21:35:30.135381+0000","last_change":"2026-02-22T21:34:38.965382+0000","last_active":"2026-02-22T21:35:30.135381+0000","last_peered":"2026-02-22T21:35:30.135381+0000","last_clean":"2026-02-22T21:35:30.135381+0000","last_became_active":"2026-02-22T21:34:36.963312+0000","last_became_peered":"2026-02-22T21:34:36.963312+0000","last_unstale":"2026-02-22T21:35:30.135381+0000","last_undegraded":"2026-02-22T21:35:30.135381+0000","last_fullsized":"2026-02-22T21:35:30.135381+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_clean_scrub_stamp":"2026-02-22T21:34:35.955313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:37:28.247229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049982599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":23,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T21:35:30.135395+0000","last_change":"2026-02-22T21:34:38.965537+0000","last_active":"2026-02-22T21:35:30.135395+0000","last_peered":"2026-02-22T21:35:30.135395+0000","last_clean":"2026-02-22T21:35:30.135395+0000","last_became_active":"2026-02-22T21:34:36.963610+0000","last_became_peered":"2026-02-22T21:34:36.963610+0000","last_unstale":"2026-02-22T21:35:30.135395+0000","last_undegraded":"2026-02-22T21:35:30.135395+0000","last_fullsized":"2026-02-22T21:35:30.135395+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_clean_scrub_stamp":"2026-02-22T21:34:35.955313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:16:04.530029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064584699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":24,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T21:35:31.925894+0000","last_change":"2026-02-22T21:34:39.232521+0000","last_active":"2026-02-22T21:35:31.925894+0000","last_peered":"2026-02-22T21:35:31.925894+0000","last_clean":"2026-02-22T21:35:31.925894+0000","last_became_active":"2026-02-22T21:34:36.963683+0000","last_became_peered":"2026-02-22T21:34:36.963683+0000","last_unstale":"2026-02-22T21:35:31.925894+0000","last_undegraded":"2026-02-22T21:35:31.925894+0000","last_fullsized":"2026-02-22T21:35:31.925894+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_clean_scrub_stamp":"2026-02-22T21:34:35.955313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:47:07.759565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035308399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":24,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T21:35:30.135417+0000","last_change":"2026-02-22T21:34:38.965157+0000","last_active":"2026-02-22T21:35:30.135417+0000","last_peered":"2026-02-22T21:35:30.135417+0000","last_clean":"2026-02-22T21:35:30.135417+0000","last_became_active":"2026-02-22T21:34:36.963644+0000","last_became_peered":"2026-02-22T21:34:36.963644+0000","last_unstale":"2026-02-22T21:35:30.135417+0000","last_undegraded":"2026-02-22T21:35:30.135417+0000","last_fullsized":"2026-02-22T21:35:30.135417+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_clean_scrub_stamp":"2026-02-22T21:34:35.955313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T05:03:08.985147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031839999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"11'1","reported_seq":25,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T21:35:30.135400+0000","last_change":"2026-02-22T21:34:38.965365+0000","last_active":"2026-02-22T21:35:30.135400+0000","last_peered":"2026-02-22T21:35:30.135400+0000","last_clean":"2026-02-22T21:35:30.135400+0000","last_became_active":"2026-02-22T21:34:36.963701+0000","last_became_peered":"2026-02-22T21:34:36.963701+0000","last_unstale":"2026-02-22T21:35:30.135400+0000","last_undegraded":"2026-02-22T21:35:30.135400+0000","last_fullsized":"2026-02-22T21:35:30.135400+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_clean_scrub_stamp":"2026-02-22T21:34:35.955313+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:46:14.398511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049378499999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"13'2","reported_seq":26,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T21:35:30.051995+0000","last_change":"2026-02-22T21:34:38.963841+0000","last_active":"2026-02-22T21:35:30.051995+0000","last_peered":"2026-02-22T21:35:30.051995+0000","last_clean":"2026-02-22T21:35:30.051995+0000","last_became_active":"2026-02-22T21:34:36.962995+0000","last_became_peered":"2026-02-22T21:34:36.962995+0000","last_unstale":"2026-02-22T21:35:30.051995+0000","last_undegraded":"2026-02-22T21:35:30.051995+0000","last_fullsized":"2026-02-22T21:35:30.051995+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_clean_scrub_stamp":"2026-02-22T21:34:35.955313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:58:59.891021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059288799999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":24,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T21:35:31.925906+0000","last_change":"2026-02-22T21:34:39.232477+0000","last_active":"2026-02-22T21:35:31.925906+0000","last_peered":"2026-02-22T21:35:31.925906+0000","last_clean":"2026-02-22T21:35:31.925906+0000","last_became_active":"2026-02-22T21:34:36.963686+0000","last_became_peered":"2026-02-22T21:34:36.963686+0000","last_unstale":"2026-02-22T21:35:31.925906+0000","last_undegraded":"2026-02-22T21:35:31.925906+0000","last_fullsized":"2026-02-22T21:35:31.925906+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_clean_scrub_stamp":"2026-02-22T21:34:35.955313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:14:55.770097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031342099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":24,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T21:35:30.135408+0000","last_change":"2026-02-22T21:34:38.965195+0000","last_active":"2026-02-22T21:35:30.135408+0000","last_peered":"2026-02-22T21:35:30.135408+0000","last_clean":"2026-02-22T21:35:30.135408+0000","last_became_active":"2026-02-22T21:34:36.963656+0000","last_became_peered":"2026-02-22T21:34:36.963656+0000","last_unstale":"2026-02-22T21:35:30.135408+0000","last_undegraded":"2026-02-22T21:35:30.135408+0000","last_fullsized":"2026-02-22T21:35:30.135408+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_clean_scrub_stamp":"2026-02-22T21:34:35.955313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:46:09.679467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036378400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":0,"up_from":8,"seq":34359738396,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27096,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344744,"statfs":{"total":96636764160,"available":96609017856,"internally_reserved":0,"allocated":135168,"data_stored":31542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738396,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27092,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344748,"statfs":{"total":96636764160,"available":96609021952,"internally_reserved":0,"allocated":131072,"data_stored":31523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738397,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27096,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344744,"statfs":{"total":96636764160,"available":96609017856,"internally_reserved":0,"allocated":135168,"data_stored":31542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T21:36:47.141 DEBUG:teuthology.orchestra.run.trial023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-22T21:36:50.302 INFO:teuthology.orchestra.run.trial023.stdout: 2026-02-22T21:36:50.302 INFO:teuthology.orchestra.run.trial023.stdout:{"epoch":15,"fsid":"e2dd7ed3-13e8-4519-aab8-5d5a54f80255","created":"2026-02-22T21:34:21.785434+0000","modified":"2026-02-22T21:35:30.048434+0000","last_up_change":"2026-02-22T21:34:31.949151+0000","last_in_change":"2026-02-22T21:34:22.372890+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-22T21:34:35.945401+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":13,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"870c022b-b636-466f-8421-e3830c92377c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.23:6806","nonce":623336197}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.23:6809","nonce":623336197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.23:6812","nonce":623336197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.23:6811","nonce":623336197}]},"public_addr":"10.20.193.23:6806/623336197","cluster_addr":"10.20.193.23:6809/623336197","heartbeat_back_addr":"10.20.193.23:6812/623336197","heartbeat_front_addr":"10.20.193.23:6811/623336197","state":["exists","up"]},{"osd":1,"uuid":"6e16d5b5-ec7e-4144-8d71-68175ef54eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.23:6805","nonce":42095765}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.23:6807","nonce":42095765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.23:6810","nonce":42095765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.23:6808","nonce":42095765}]},"public_addr":"10.20.193.23:6805/42095765","cluster_addr":"10.20.193.23:6807/42095765","heartbeat_back_addr":"10.20.193.23:6810/42095765","heartbeat_front_addr":"10.20.193.23:6808/42095765","state":["exists","up"]},{"osd":2,"uuid":"46858b82-1822-4a04-a25d-97c7e96f97e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.23:6801","nonce":2701368670}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.23:6802","nonce":2701368670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.23:6804","nonce":2701368670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.23:6803","nonce":2701368670}]},"public_addr":"10.20.193.23:6801/2701368670","cluster_addr":"10.20.193.23:6802/2701368670","heartbeat_back_addr":"10.20.193.23:6804/2701368670","heartbeat_front_addr":"10.20.193.23:6803/2701368670","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T21:34:30.393976+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T21:34:30.328939+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T21:34:30.199802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T21:36:51.314 INFO:tasks.ceph:Scrubbing osd.0 2026-02-22T21:36:51.315 DEBUG:teuthology.orchestra.run.trial023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-22T21:36:51.396 INFO:teuthology.orchestra.run.trial023.stdout:{ 2026-02-22T21:36:51.396 INFO:teuthology.orchestra.run.trial023.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-22T21:36:51.396 INFO:teuthology.orchestra.run.trial023.stdout:} 2026-02-22T21:36:51.404 DEBUG:teuthology.orchestra.run.trial023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-22T21:36:51.546 INFO:teuthology.orchestra.run.trial023.stderr:instructed osd(s) 0 to deep-scrub 2026-02-22T21:36:51.556 INFO:tasks.ceph:Scrubbing osd.1 2026-02-22T21:36:51.556 DEBUG:teuthology.orchestra.run.trial023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-22T21:36:51.628 INFO:teuthology.orchestra.run.trial023.stdout:{ 2026-02-22T21:36:51.629 INFO:teuthology.orchestra.run.trial023.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-22T21:36:51.629 INFO:teuthology.orchestra.run.trial023.stdout:} 2026-02-22T21:36:51.637 DEBUG:teuthology.orchestra.run.trial023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-22T21:36:51.984 INFO:teuthology.orchestra.run.trial023.stderr:instructed osd(s) 1 to deep-scrub 2026-02-22T21:36:51.995 INFO:tasks.ceph:Scrubbing osd.2 2026-02-22T21:36:51.996 DEBUG:teuthology.orchestra.run.trial023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2026-02-22T21:36:52.067 INFO:teuthology.orchestra.run.trial023.stdout:{ 2026-02-22T21:36:52.067 INFO:teuthology.orchestra.run.trial023.stdout: "success": "" 2026-02-22T21:36:52.067 INFO:teuthology.orchestra.run.trial023.stdout:} 2026-02-22T21:36:52.075 DEBUG:teuthology.orchestra.run.trial023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2026-02-22T21:36:52.225 INFO:teuthology.orchestra.run.trial023.stderr:instructed osd(s) 2 to deep-scrub 2026-02-22T21:36:52.235 DEBUG:teuthology.orchestra.run.trial023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T21:36:52.383 INFO:teuthology.orchestra.run.trial023.stdout: 2026-02-22T21:36:52.383 INFO:teuthology.orchestra.run.trial023.stderr:dumped all 2026-02-22T21:36:52.392 INFO:teuthology.orchestra.run.trial023.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2026-02-22T21:36:51.872107+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81284,"kb_used_data":392,"kb_used_omap":4,"kb_used_meta":80827,"kb_avail":283034236,"statfs":{"total":289910292480,"available":289827057664,"internally_reserved":0,"allocated":401408,"data_stored":94607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":82767186},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001302"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":24,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T21:35:30.135427+0000","last_change":"2026-02-22T21:34:38.965382+0000","last_active":"2026-02-22T21:35:30.135427+0000","last_peered":"2026-02-22T21:35:30.135427+0000","last_clean":"2026-02-22T21:35:30.135427+0000","last_became_active":"2026-02-22T21:34:36.963312+0000","last_became_peered":"2026-02-22T21:34:36.963312+0000","last_unstale":"2026-02-22T21:35:30.135427+0000","last_undegraded":"2026-02-22T21:35:30.135427+0000","last_fullsized":"2026-02-22T21:35:30.135427+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_clean_scrub_stamp":"2026-02-22T21:34:35.955313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:37:28.247229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049982599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":24,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T21:35:30.135442+0000","last_change":"2026-02-22T21:34:38.965537+0000","last_active":"2026-02-22T21:35:30.135442+0000","last_peered":"2026-02-22T21:35:30.135442+0000","last_clean":"2026-02-22T21:35:30.135442+0000","last_became_active":"2026-02-22T21:34:36.963610+0000","last_became_peered":"2026-02-22T21:34:36.963610+0000","last_unstale":"2026-02-22T21:35:30.135442+0000","last_undegraded":"2026-02-22T21:35:30.135442+0000","last_fullsized":"2026-02-22T21:35:30.135442+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_clean_scrub_stamp":"2026-02-22T21:34:35.955313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:16:04.530029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064584699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":24,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T21:35:31.925894+0000","last_change":"2026-02-22T21:34:39.232521+0000","last_active":"2026-02-22T21:35:31.925894+0000","last_peered":"2026-02-22T21:35:31.925894+0000","last_clean":"2026-02-22T21:35:31.925894+0000","last_became_active":"2026-02-22T21:34:36.963683+0000","last_became_peered":"2026-02-22T21:34:36.963683+0000","last_unstale":"2026-02-22T21:35:31.925894+0000","last_undegraded":"2026-02-22T21:35:31.925894+0000","last_fullsized":"2026-02-22T21:35:31.925894+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_clean_scrub_stamp":"2026-02-22T21:34:35.955313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:47:07.759565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035308399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":24,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T21:35:30.135417+0000","last_change":"2026-02-22T21:34:38.965157+0000","last_active":"2026-02-22T21:35:30.135417+0000","last_peered":"2026-02-22T21:35:30.135417+0000","last_clean":"2026-02-22T21:35:30.135417+0000","last_became_active":"2026-02-22T21:34:36.963644+0000","last_became_peered":"2026-02-22T21:34:36.963644+0000","last_unstale":"2026-02-22T21:35:30.135417+0000","last_undegraded":"2026-02-22T21:35:30.135417+0000","last_fullsized":"2026-02-22T21:35:30.135417+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_clean_scrub_stamp":"2026-02-22T21:34:35.955313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T05:03:08.985147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031839999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"11'1","reported_seq":25,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T21:35:30.135400+0000","last_change":"2026-02-22T21:34:38.965365+0000","last_active":"2026-02-22T21:35:30.135400+0000","last_peered":"2026-02-22T21:35:30.135400+0000","last_clean":"2026-02-22T21:35:30.135400+0000","last_became_active":"2026-02-22T21:34:36.963701+0000","last_became_peered":"2026-02-22T21:34:36.963701+0000","last_unstale":"2026-02-22T21:35:30.135400+0000","last_undegraded":"2026-02-22T21:35:30.135400+0000","last_fullsized":"2026-02-22T21:35:30.135400+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_clean_scrub_stamp":"2026-02-22T21:34:35.955313+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:46:14.398511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049378499999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"13'2","reported_seq":26,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T21:35:30.051995+0000","last_change":"2026-02-22T21:34:38.963841+0000","last_active":"2026-02-22T21:35:30.051995+0000","last_peered":"2026-02-22T21:35:30.051995+0000","last_clean":"2026-02-22T21:35:30.051995+0000","last_became_active":"2026-02-22T21:34:36.962995+0000","last_became_peered":"2026-02-22T21:34:36.962995+0000","last_unstale":"2026-02-22T21:35:30.051995+0000","last_undegraded":"2026-02-22T21:35:30.051995+0000","last_fullsized":"2026-02-22T21:35:30.051995+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_clean_scrub_stamp":"2026-02-22T21:34:35.955313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:58:59.891021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059288799999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":24,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T21:35:31.925906+0000","last_change":"2026-02-22T21:34:39.232477+0000","last_active":"2026-02-22T21:35:31.925906+0000","last_peered":"2026-02-22T21:35:31.925906+0000","last_clean":"2026-02-22T21:35:31.925906+0000","last_became_active":"2026-02-22T21:34:36.963686+0000","last_became_peered":"2026-02-22T21:34:36.963686+0000","last_unstale":"2026-02-22T21:35:31.925906+0000","last_undegraded":"2026-02-22T21:35:31.925906+0000","last_fullsized":"2026-02-22T21:35:31.925906+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_clean_scrub_stamp":"2026-02-22T21:34:35.955313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:14:55.770097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031342099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":24,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T21:35:30.135408+0000","last_change":"2026-02-22T21:34:38.965195+0000","last_active":"2026-02-22T21:35:30.135408+0000","last_peered":"2026-02-22T21:35:30.135408+0000","last_clean":"2026-02-22T21:35:30.135408+0000","last_became_active":"2026-02-22T21:34:36.963656+0000","last_became_peered":"2026-02-22T21:34:36.963656+0000","last_unstale":"2026-02-22T21:35:30.135408+0000","last_undegraded":"2026-02-22T21:35:30.135408+0000","last_fullsized":"2026-02-22T21:35:30.135408+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:34:35.955313+0000","last_clean_scrub_stamp":"2026-02-22T21:34:35.955313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:46:09.679467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036378400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":0,"up_from":8,"seq":34359738397,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27096,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344744,"statfs":{"total":96636764160,"available":96609017856,"internally_reserved":0,"allocated":135168,"data_stored":31542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738397,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27092,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344748,"statfs":{"total":96636764160,"available":96609021952,"internally_reserved":0,"allocated":131072,"data_stored":31523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738398,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27096,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344744,"statfs":{"total":96636764160,"available":96609017856,"internally_reserved":0,"allocated":135168,"data_stored":31542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T21:36:52.395 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2026-02-22T21:34:35.955313+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=21, tm_min=34, tm_sec=35, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=21, tm_min=36, tm_sec=50, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T21:36:52.395 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2026-02-22T21:34:35.955313+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=21, tm_min=34, tm_sec=35, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=21, tm_min=36, tm_sec=50, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T21:36:52.395 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2026-02-22T21:34:35.955313+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=21, tm_min=34, tm_sec=35, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=21, tm_min=36, tm_sec=50, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T21:36:52.395 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2026-02-22T21:34:35.955313+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=21, tm_min=34, tm_sec=35, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=21, tm_min=36, tm_sec=50, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T21:36:52.395 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2026-02-22T21:34:35.955313+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=21, tm_min=34, tm_sec=35, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=21, tm_min=36, tm_sec=50, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T21:36:52.396 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2026-02-22T21:34:35.955313+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=21, tm_min=34, tm_sec=35, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=21, tm_min=36, tm_sec=50, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T21:36:52.396 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2026-02-22T21:34:35.955313+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=21, tm_min=34, tm_sec=35, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=21, tm_min=36, tm_sec=50, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T21:36:52.396 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2026-02-22T21:34:35.955313+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=21, tm_min=34, tm_sec=35, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=21, tm_min=36, tm_sec=50, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T21:36:52.396 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2026-02-22T21:37:12.396 DEBUG:teuthology.orchestra.run.trial023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T21:37:12.543 INFO:teuthology.orchestra.run.trial023.stdout: 2026-02-22T21:37:12.543 INFO:teuthology.orchestra.run.trial023.stderr:dumped all 2026-02-22T21:37:12.553 INFO:teuthology.orchestra.run.trial023.stdout:{"pg_ready":true,"pg_map":{"version":92,"stamp":"2026-02-22T21:37:11.874005+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81272,"kb_used_data":392,"kb_used_omap":4,"kb_used_meta":80827,"kb_avail":283034248,"statfs":{"total":289910292480,"available":289827069952,"internally_reserved":0,"allocated":401408,"data_stored":94607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":82767186},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001008"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":33,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T21:36:52.514011+0000","last_change":"2026-02-22T21:36:52.514043+0000","last_active":"2026-02-22T21:36:52.514011+0000","last_peered":"2026-02-22T21:36:52.514011+0000","last_clean":"2026-02-22T21:36:52.514011+0000","last_became_active":"2026-02-22T21:34:36.963312+0000","last_became_peered":"2026-02-22T21:34:36.963312+0000","last_unstale":"2026-02-22T21:36:52.514011+0000","last_undegraded":"2026-02-22T21:36:52.514011+0000","last_fullsized":"2026-02-22T21:36:52.514011+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:36:52.513892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:36:52.513892+0000","last_clean_scrub_stamp":"2026-02-22T21:36:52.513892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:03:50.575086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049982599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":33,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T21:36:54.540211+0000","last_change":"2026-02-22T21:36:54.540232+0000","last_active":"2026-02-22T21:36:54.540211+0000","last_peered":"2026-02-22T21:36:54.540211+0000","last_clean":"2026-02-22T21:36:54.540211+0000","last_became_active":"2026-02-22T21:34:36.963610+0000","last_became_peered":"2026-02-22T21:34:36.963610+0000","last_unstale":"2026-02-22T21:36:54.540211+0000","last_undegraded":"2026-02-22T21:36:54.540211+0000","last_fullsized":"2026-02-22T21:36:54.540211+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:36:54.540140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:36:54.540140+0000","last_clean_scrub_stamp":"2026-02-22T21:36:54.540140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:04:37.188826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064584699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":33,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T21:36:52.843714+0000","last_change":"2026-02-22T21:36:52.843731+0000","last_active":"2026-02-22T21:36:52.843714+0000","last_peered":"2026-02-22T21:36:52.843714+0000","last_clean":"2026-02-22T21:36:52.843714+0000","last_became_active":"2026-02-22T21:34:36.963683+0000","last_became_peered":"2026-02-22T21:34:36.963683+0000","last_unstale":"2026-02-22T21:36:52.843714+0000","last_undegraded":"2026-02-22T21:36:52.843714+0000","last_fullsized":"2026-02-22T21:36:52.843714+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:36:52.843657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:36:52.843657+0000","last_clean_scrub_stamp":"2026-02-22T21:36:52.843657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:41:56.311403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035308399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":33,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T21:36:53.506653+0000","last_change":"2026-02-22T21:36:53.506669+0000","last_active":"2026-02-22T21:36:53.506653+0000","last_peered":"2026-02-22T21:36:53.506653+0000","last_clean":"2026-02-22T21:36:53.506653+0000","last_became_active":"2026-02-22T21:34:36.963644+0000","last_became_peered":"2026-02-22T21:34:36.963644+0000","last_unstale":"2026-02-22T21:36:53.506653+0000","last_undegraded":"2026-02-22T21:36:53.506653+0000","last_fullsized":"2026-02-22T21:36:53.506653+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:36:53.506598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:36:53.506598+0000","last_clean_scrub_stamp":"2026-02-22T21:36:53.506598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:38:31.146665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031839999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"15'2","reported_seq":35,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T21:36:56.535322+0000","last_change":"2026-02-22T21:36:56.535352+0000","last_active":"2026-02-22T21:36:56.535322+0000","last_peered":"2026-02-22T21:36:56.535322+0000","last_clean":"2026-02-22T21:36:56.535322+0000","last_became_active":"2026-02-22T21:34:36.963701+0000","last_became_peered":"2026-02-22T21:34:36.963701+0000","last_unstale":"2026-02-22T21:36:56.535322+0000","last_undegraded":"2026-02-22T21:36:56.535322+0000","last_fullsized":"2026-02-22T21:36:56.535322+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'2","last_scrub_stamp":"2026-02-22T21:36:56.535256+0000","last_deep_scrub":"15'2","last_deep_scrub_stamp":"2026-02-22T21:36:56.535256+0000","last_clean_scrub_stamp":"2026-02-22T21:36:56.535256+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:56:22.627800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049378499999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"15'3","reported_seq":36,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T21:36:52.406080+0000","last_change":"2026-02-22T21:36:52.406101+0000","last_active":"2026-02-22T21:36:52.406080+0000","last_peered":"2026-02-22T21:36:52.406080+0000","last_clean":"2026-02-22T21:36:52.406080+0000","last_became_active":"2026-02-22T21:34:36.962995+0000","last_became_peered":"2026-02-22T21:34:36.962995+0000","last_unstale":"2026-02-22T21:36:52.406080+0000","last_undegraded":"2026-02-22T21:36:52.406080+0000","last_fullsized":"2026-02-22T21:36:52.406080+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'3","last_scrub_stamp":"2026-02-22T21:36:52.406025+0000","last_deep_scrub":"15'3","last_deep_scrub_stamp":"2026-02-22T21:36:52.406025+0000","last_clean_scrub_stamp":"2026-02-22T21:36:52.406025+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:24:37.672494+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00059288799999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":33,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T21:36:53.834271+0000","last_change":"2026-02-22T21:36:53.834287+0000","last_active":"2026-02-22T21:36:53.834271+0000","last_peered":"2026-02-22T21:36:53.834271+0000","last_clean":"2026-02-22T21:36:53.834271+0000","last_became_active":"2026-02-22T21:34:36.963686+0000","last_became_peered":"2026-02-22T21:34:36.963686+0000","last_unstale":"2026-02-22T21:36:53.834271+0000","last_undegraded":"2026-02-22T21:36:53.834271+0000","last_fullsized":"2026-02-22T21:36:53.834271+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:36:53.834216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:36:53.834216+0000","last_clean_scrub_stamp":"2026-02-22T21:36:53.834216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T05:05:26.840454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031342099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":33,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T21:36:55.505965+0000","last_change":"2026-02-22T21:36:55.505990+0000","last_active":"2026-02-22T21:36:55.505965+0000","last_peered":"2026-02-22T21:36:55.505965+0000","last_clean":"2026-02-22T21:36:55.505965+0000","last_became_active":"2026-02-22T21:34:36.963656+0000","last_became_peered":"2026-02-22T21:34:36.963656+0000","last_unstale":"2026-02-22T21:36:55.505965+0000","last_undegraded":"2026-02-22T21:36:55.505965+0000","last_fullsized":"2026-02-22T21:36:55.505965+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:36:55.505894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:36:55.505894+0000","last_clean_scrub_stamp":"2026-02-22T21:36:55.505894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:44:16.452324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036378400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":0,"up_from":8,"seq":34359738401,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27092,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344748,"statfs":{"total":96636764160,"available":96609021952,"internally_reserved":0,"allocated":135168,"data_stored":31542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738402,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27088,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344752,"statfs":{"total":96636764160,"available":96609026048,"internally_reserved":0,"allocated":131072,"data_stored":31523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738402,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27092,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344748,"statfs":{"total":96636764160,"available":96609021952,"internally_reserved":0,"allocated":135168,"data_stored":31542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T21:37:12.555 DEBUG:teuthology.orchestra.run.trial023:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-22T21:37:12.711 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-22T21:37:12.711 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-22T21:37:12.712 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-22T21:37:12.712 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T21:37:12.781 INFO:tasks.ceph.osd.0:Stopped 2026-02-22T21:37:12.782 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-22T21:37:12.782 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T21:37:12.845 INFO:tasks.ceph.osd.1:Stopped 2026-02-22T21:37:12.846 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-22T21:37:12.846 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T21:37:12.938 INFO:tasks.ceph.osd.2:Stopped 2026-02-22T21:37:12.938 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-22T21:37:12.938 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-22T21:37:12.938 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T21:37:12.965 INFO:tasks.ceph.mgr.x:Stopped 2026-02-22T21:37:12.966 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-22T21:37:12.966 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-22T21:37:12.966 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T21:37:13.021 INFO:tasks.ceph.mon.a:Stopped 2026-02-22T21:37:13.021 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-22T21:37:13.022 DEBUG:teuthology.orchestra.run.trial023:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'overall HEALTH_' | egrep -v '\(AUTH_BAD_CAPS\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v '\(MON_DOWN\)' | head -n 1 2026-02-22T21:37:13.075 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial023.front.sepia.ceph.com 2026-02-22T21:37:13.075 DEBUG:teuthology.orchestra.run.trial023:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-22T21:37:13.133 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial023.front.sepia.ceph.com 2026-02-22T21:37:13.133 DEBUG:teuthology.orchestra.run.trial023:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-22T21:37:13.188 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial023.front.sepia.ceph.com 2026-02-22T21:37:13.188 DEBUG:teuthology.orchestra.run.trial023:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-22T21:37:13.239 INFO:tasks.ceph:Archiving mon data... 2026-02-22T21:37:13.241 DEBUG:teuthology.misc:Transferring archived files from trial023:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64059/data/mon.a.tgz 2026-02-22T21:37:13.241 DEBUG:teuthology.orchestra.run.trial023:> mktemp 2026-02-22T21:37:13.285 INFO:teuthology.orchestra.run.trial023.stdout:/tmp/tmp.WV7l1hBhSK 2026-02-22T21:37:13.285 DEBUG:teuthology.orchestra.run.trial023:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.WV7l1hBhSK 2026-02-22T21:37:13.358 DEBUG:teuthology.orchestra.run.trial023:> sudo chmod 0666 /tmp/tmp.WV7l1hBhSK 2026-02-22T21:37:13.459 DEBUG:teuthology.orchestra.remote:trial023:/tmp/tmp.WV7l1hBhSK is 165KB 2026-02-22T21:37:13.469 DEBUG:teuthology.orchestra.run.trial023:> rm -fr /tmp/tmp.WV7l1hBhSK 2026-02-22T21:37:13.472 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-22T21:37:13.472 DEBUG:teuthology.orchestra.run.trial023:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-22T21:37:13.565 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-22T21:37:13.565 INFO:tasks.ceph:Archiving crash dumps... 2026-02-22T21:37:13.567 DEBUG:teuthology.misc:Transferring archived files from trial023:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64059/remote/trial023/crash 2026-02-22T21:37:13.568 DEBUG:teuthology.orchestra.run.trial023:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-22T21:37:13.617 INFO:tasks.ceph:Compressing logs... 2026-02-22T21:37:13.617 DEBUG:teuthology.orchestra.run.trial023:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-22T21:37:13.669 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_dd.23027.log 2026-02-22T21:37:13.669 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.allow_aa.20247.log 2026-02-22T21:37:13.670 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_dd.23027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_bb.22147.log 2026-02-22T21:37:13.670 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_dd.23027.log.gz 2026-02-22T21:37:13.670 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.match_bb.21661.log 2026-02-22T21:37:13.671 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.allow_aa.20247.log: /var/log/ceph/ceph-client.fail_bb.22147.log: 0.0% -- replaced with /var/log/ceph/ceph-client.allow_aa.20247.log.gz 2026-02-22T21:37:13.671 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_bb.22147.log.gz 2026-02-22T21:37:13.671 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25666.log 2026-02-22T21:37:13.671 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_ff.23911.log 2026-02-22T21:37:13.671 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.match_bb.21661.log: 0.0% -- replaced with /var/log/ceph/ceph-client.match_bb.21661.log.gz 2026-02-22T21:37:13.671 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.25666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_cc.22939.log 2026-02-22T21:37:13.672 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25666.log.gz 2026-02-22T21:37:13.672 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_ff.23911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19346.log 2026-02-22T21:37:13.672 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_ff.23911.log.gz 2026-02-22T21:37:13.672 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_cc.22939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_gg.24593.log 2026-02-22T21:37:13.672 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_cc.22939.log.gz 2026-02-22T21:37:13.672 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.19346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_bb.22213.log 2026-02-22T21:37:13.672 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19346.log.gz 2026-02-22T21:37:13.673 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_gg.24593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_gg.24351.log 2026-02-22T21:37:13.673 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_gg.24593.log.gz 2026-02-22T21:37:13.673 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_bb.22213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19131.log 2026-02-22T21:37:13.674 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_bb.22213.log.gz 2026-02-22T21:37:13.674 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_ee.23779.log 2026-02-22T21:37:13.674 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_gg.24351.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_gg.24351.log.gz 2026-02-22T21:37:13.674 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.19131.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19131.log.gz 2026-02-22T21:37:13.674 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_gg.24637.log 2026-02-22T21:37:13.674 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_dd.23291.log 2026-02-22T21:37:13.674 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_ee.23779.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_ee.23779.log.gz 2026-02-22T21:37:13.675 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_dd.23405.log 2026-02-22T21:37:13.675 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_gg.24637.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_gg.24637.log.gz 2026-02-22T21:37:13.675 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_dd.23291.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_dd.23291.log.gz 2026-02-22T21:37:13.675 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_cc.22587.log 2026-02-22T21:37:13.678 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.allow_bb.21059.log 2026-02-22T21:37:13.678 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_dd.23405.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_dd.23405.log.gz 2026-02-22T21:37:13.679 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_cc.22587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_ee.23845.log 2026-02-22T21:37:13.679 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_cc.22587.log.gz 2026-02-22T21:37:13.679 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.allow_bb.21059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25406.log 2026-02-22T21:37:13.679 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.allow_bb.21059.log.gz 2026-02-22T21:37:13.679 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.prefix_aa.21083.log 2026-02-22T21:37:13.679 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_ee.23845.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_ee.23845.log.gz 2026-02-22T21:37:13.679 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.25406.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25406.log.gz 2026-02-22T21:37:13.679 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_ff.24153.log 2026-02-22T21:37:13.679 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.prefix_aa.21083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_dd.23093.log 2026-02-22T21:37:13.679 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.prefix_aa.21083.log.gz 2026-02-22T21:37:13.679 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_ff.24153.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_ff.24153.log.gz 2026-02-22T21:37:13.679 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19085.log 2026-02-22T21:37:13.679 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_dd.23093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.prefix_cc.21477.log 2026-02-22T21:37:13.679 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_dd.23093.log.gz 2026-02-22T21:37:13.679 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.19085.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19085.log.gz 2026-02-22T21:37:13.680 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_dd.23269.log 2026-02-22T21:37:13.680 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19575.log 2026-02-22T21:37:13.680 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.prefix_cc.21477.log: /var/log/ceph/ceph-client.fail_dd.23269.log: 0.0% -- replaced with /var/log/ceph/ceph-client.prefix_cc.21477.log.gz 2026-02-22T21:37:13.680 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_dd.23269.log.gz 2026-02-22T21:37:13.680 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19269.log 2026-02-22T21:37:13.680 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_gg.24703.log 2026-02-22T21:37:13.680 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.19575.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19575.log.gz 2026-02-22T21:37:13.680 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.19269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25510.log 2026-02-22T21:37:13.680 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19269.log.gz 2026-02-22T21:37:13.683 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_gg.24703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_gg.24747.log 2026-02-22T21:37:13.683 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_gg.24703.log.gz 2026-02-22T21:37:13.683 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.25510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_ee.23801.log 2026-02-22T21:37:13.683 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25510.log.gz 2026-02-22T21:37:13.683 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_gg.24747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19671.log 2026-02-22T21:37:13.683 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_gg.24747.log.gz 2026-02-22T21:37:13.683 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_ee.23801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20031.log 2026-02-22T21:37:13.683 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_ee.23801.log.gz 2026-02-22T21:37:13.684 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.19671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_aa.21816.log 2026-02-22T21:37:13.684 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19671.log.gz 2026-02-22T21:37:13.684 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19190.log 2026-02-22T21:37:13.684 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.20031.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20031.log.gz 2026-02-22T21:37:13.684 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_aa.21816.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_aa.21816.log.gz 2026-02-22T21:37:13.684 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.allow_bb.20295.log 2026-02-22T21:37:13.684 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_bb.22169.log 2026-02-22T21:37:13.684 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.19190.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19190.log.gz 2026-02-22T21:37:13.684 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_ff.23977.log 2026-02-22T21:37:13.684 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.allow_bb.20295.log: 0.0% -- replaced with /var/log/ceph/ceph-client.allow_bb.20295.log.gz 2026-02-22T21:37:13.684 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_bb.22169.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_bb.22169.log.gz 2026-02-22T21:37:13.684 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.prefix_cc.21429.log 2026-02-22T21:37:13.684 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_aa.21706.log 2026-02-22T21:37:13.684 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_ff.23977.log: /var/log/ceph/ceph-client.prefix_cc.21429.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_ff.23977.log.gz 2026-02-22T21:37:13.684 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.prefix_cc.21429.log.gz 2026-02-22T21:37:13.684 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_writes.24813.log 2026-02-22T21:37:13.684 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16375.log 2026-02-22T21:37:13.684 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_aa.21706.log: /var/log/ceph/ceph-client.fail_writes.24813.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_aa.21706.log.gz 2026-02-22T21:37:13.684 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_writes.24813.log.gz 2026-02-22T21:37:13.684 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.match_aa.21523.log 2026-02-22T21:37:13.684 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.16375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_dd.23225.log 2026-02-22T21:37:13.685 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.16375.log.gz 2026-02-22T21:37:13.685 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.match_aa.21523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19347.log 2026-02-22T21:37:13.685 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.match_aa.21523.log.gz 2026-02-22T21:37:13.687 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_dd.23225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.allow_bb.20319.log 2026-02-22T21:37:13.687 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_dd.23225.log.gz 2026-02-22T21:37:13.687 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.19347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_gg.24483.log 2026-02-22T21:37:13.687 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19347.log.gz 2026-02-22T21:37:13.687 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.allow_bb.20319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.prefix_bb.21203.log 2026-02-22T21:37:13.687 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.allow_bb.20319.log.gz 2026-02-22T21:37:13.687 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_gg.24483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19959.log 2026-02-22T21:37:13.687 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_gg.24483.log.gz 2026-02-22T21:37:13.687 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.prefix_bb.21203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19551.log 2026-02-22T21:37:13.687 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.prefix_bb.21203.log.gz 2026-02-22T21:37:13.687 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.19959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_bb.22301.log 2026-02-22T21:37:13.687 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19959.log.gz 2026-02-22T21:37:13.687 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.19551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_bb.22499.log 2026-02-22T21:37:13.687 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19551.log.gz 2026-02-22T21:37:13.687 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_bb.22301.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.fail_bb.22301.log.gz 2026-02-22T21:37:13.687 INFO:teuthology.orchestra.run.trial023.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.19105.log 2026-02-22T21:37:13.687 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_ff.24307.log 2026-02-22T21:37:13.687 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_bb.22499.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_bb.22499.log.gz 2026-02-22T21:37:13.687 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.19105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_ff.23933.log 2026-02-22T21:37:13.687 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19105.log.gz 2026-02-22T21:37:13.688 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_ff.24307.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_ff.24307.log.gz 2026-02-22T21:37:13.688 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19268.log 2026-02-22T21:37:13.691 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_aa.21728.log 2026-02-22T21:37:13.691 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_ff.23933.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_ff.23933.log.gz 2026-02-22T21:37:13.691 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.19268.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19268.log.gz 2026-02-22T21:37:13.691 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_cc.22741.log 2026-02-22T21:37:13.691 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_aa.21728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24890.log 2026-02-22T21:37:13.691 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_aa.21728.log.gz 2026-02-22T21:37:13.691 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25380.log 2026-02-22T21:37:13.691 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_cc.22741.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_cc.22741.log.gz 2026-02-22T21:37:13.691 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.24890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20079.log 2026-02-22T21:37:13.692 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24890.log.gz 2026-02-22T21:37:13.692 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.25380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25458.log 2026-02-22T21:37:13.692 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25380.log.gz 2026-02-22T21:37:13.692 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.20079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.prefix_bb.21269.log 2026-02-22T21:37:13.692 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20079.log.gz 2026-02-22T21:37:13.692 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.allow_cc.20391.log 2026-02-22T21:37:13.692 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.25458.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25458.log.gz 2026-02-22T21:37:13.692 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.prefix_bb.21269.log: 0.0% -- replaced with /var/log/ceph/ceph-client.prefix_bb.21269.log.gz 2026-02-22T21:37:13.692 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_aa.22059.log 2026-02-22T21:37:13.692 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18383.log 2026-02-22T21:37:13.692 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.allow_cc.20391.log: 0.0% -- replaced with /var/log/ceph/ceph-client.allow_cc.20391.log.gz 2026-02-22T21:37:13.692 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_dd.23383.log 2026-02-22T21:37:13.692 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_aa.22059.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_aa.22059.log.gz 2026-02-22T21:37:13.692 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.18383.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18383.log.gz 2026-02-22T21:37:13.693 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_cc.22565.log 2026-02-22T21:37:13.693 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_gg.24681.log 2026-02-22T21:37:13.693 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_dd.23383.log: /var/log/ceph/ceph-client.fail_cc.22565.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_dd.23383.log.gz 2026-02-22T21:37:13.693 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_cc.22565.log.gz 2026-02-22T21:37:13.693 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19339.log 2026-02-22T21:37:13.697 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_ee.23603.log 2026-02-22T21:37:13.697 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_gg.24681.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_gg.24681.log.gz 2026-02-22T21:37:13.697 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.19339.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19339.log.gz 2026-02-22T21:37:13.697 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16169.log 2026-02-22T21:37:13.697 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_ee.23603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.prefix_bb.21247.log 2026-02-22T21:37:13.697 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_ee.23603.log.gz 2026-02-22T21:37:13.697 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.16169.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.fail_aa.22103.log 2026-02-22T21:37:13.697 INFO:teuthology.orchestra.run.trial023.stderr: -- replaced with /var/log/ceph/ceph-client.admin.16169.log.gz 2026-02-22T21:37:13.697 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.prefix_bb.21247.log: 0.0% -- replaced with /var/log/ceph/ceph-client.prefix_bb.21247.log.gz 2026-02-22T21:37:13.697 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.allow_cc.20439.log 2026-02-22T21:37:13.697 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_aa.22103.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-22T21:37:13.698 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_aa.22103.log.gz 2026-02-22T21:37:13.698 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.allow_cc.20439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_ff.23999.log 2026-02-22T21:37:13.698 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.allow_cc.20439.log.gz 2026-02-22T21:37:13.698 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_bb.22235.log/var/log/ceph/ceph-mgr.x.log: 2026-02-22T21:37:13.698 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_ff.23999.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_ff.23999.log.gz 2026-02-22T21:37:13.698 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19647.log 2026-02-22T21:37:13.698 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_bb.22235.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_bb.22235.log.gz 2026-02-22T21:37:13.698 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_ff.24285.log 2026-02-22T21:37:13.698 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.19647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_ee.23823.log 2026-02-22T21:37:13.698 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19647.log.gz 2026-02-22T21:37:13.698 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_gg.24395.log 2026-02-22T21:37:13.698 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_ff.24285.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_ff.24285.log.gz 2026-02-22T21:37:13.698 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_ee.23823.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_ee.23823.log.gz 2026-02-22T21:37:13.698 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16103.log 2026-02-22T21:37:13.698 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_gg.24395.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_gg.24395.log.gz 2026-02-22T21:37:13.698 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_ee.23449.log 2026-02-22T21:37:13.698 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_gg.24549.log 2026-02-22T21:37:13.698 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.16103.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.16103.log.gz 2026-02-22T21:37:13.698 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_ee.23449.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.fail_ee.23449.log.gz 2026-02-22T21:37:13.698 INFO:teuthology.orchestra.run.trial023.stderr: -5 --verbose -- /var/log/ceph/ceph-client.fail_ff.24131.log 2026-02-22T21:37:13.698 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_gg.24549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_bb.22323.log 2026-02-22T21:37:13.699 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_gg.24549.log.gz 2026-02-22T21:37:13.699 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_ff.24131.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_ff.24131.log.gz 2026-02-22T21:37:13.699 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_bb.22455.log 2026-02-22T21:37:13.699 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_bb.22323.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_bb.22323.log.gz 2026-02-22T21:37:13.699 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_aa.22037.log 2026-02-22T21:37:13.699 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_bb.22455.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.fail_bb.22455.log.gz -5 2026-02-22T21:37:13.699 INFO:teuthology.orchestra.run.trial023.stderr: --verbose -- /var/log/ceph/ceph-client.admin.20103.log 2026-02-22T21:37:13.702 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_aa.22037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_ee.23867.log 2026-02-22T21:37:13.702 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_aa.22037.log.gz 2026-02-22T21:37:13.702 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.20103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_cc.22895.log 2026-02-22T21:37:13.702 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20103.log.gz 2026-02-22T21:37:13.702 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_ee.23867.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_ee.23867.log.gz 2026-02-22T21:37:13.702 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_gg.24527.log 2026-02-22T21:37:13.702 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_cc.22895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_aa.22015.log 2026-02-22T21:37:13.702 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_cc.22895.log.gz 2026-02-22T21:37:13.702 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_gg.24527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.match_aa.21547.log 2026-02-22T21:37:13.703 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_gg.24527.log.gz 2026-02-22T21:37:13.703 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_aa.22015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19695.log 2026-02-22T21:37:13.703 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_aa.22015.log.gz 2026-02-22T21:37:13.703 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.match_aa.21547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_ee.23625.log 2026-02-22T21:37:13.703 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.match_aa.21547.log.gz 2026-02-22T21:37:13.703 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.19695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_gg.24417.log 2026-02-22T21:37:13.703 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19695.log.gz 2026-02-22T21:37:13.703 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_ee.23625.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_ee.23625.log.gz 2026-02-22T21:37:13.703 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19887.log 2026-02-22T21:37:13.703 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_gg.24571.log 2026-02-22T21:37:13.703 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_gg.24417.log: /var/log/ceph/ceph-client.admin.19887.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_gg.24417.log.gz 2026-02-22T21:37:13.703 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19887.log.gz 2026-02-22T21:37:13.703 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_writes.24791.log 2026-02-22T21:37:13.703 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_gg.24571.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_gg.24571.log.gz 2026-02-22T21:37:13.703 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19767.log 2026-02-22T21:37:13.703 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_writes.24769.log 2026-02-22T21:37:13.704 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_writes.24791.log: /var/log/ceph/ceph-client.admin.19767.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_writes.24791.log.gz 2026-02-22T21:37:13.704 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19767.log.gz 2026-02-22T21:37:13.704 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25082.log 2026-02-22T21:37:13.704 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_writes.24769.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_writes.24769.log.gz 2026-02-22T21:37:13.704 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19911.log 2026-02-22T21:37:13.706 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.25082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.prefix_bb.21107.log 2026-02-22T21:37:13.706 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25082.log.gz 2026-02-22T21:37:13.706 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.19911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_bb.22477.log 2026-02-22T21:37:13.706 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19911.log.gz 2026-02-22T21:37:13.706 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.prefix_bb.21107.log: 0.0% -- replaced with /var/log/ceph/ceph-client.prefix_bb.21107.log.gz 2026-02-22T21:37:13.706 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20055.log 2026-02-22T21:37:13.706 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_bb.22477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_aa.21882.log 2026-02-22T21:37:13.706 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_bb.22477.log.gz 2026-02-22T21:37:13.706 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.20055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_dd.23203.log 2026-02-22T21:37:13.706 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20055.log.gz 2026-02-22T21:37:13.706 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_aa.21882.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_aa.21882.log.gz 2026-02-22T21:37:13.706 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-22T21:37:13.706 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_dd.23203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_ee.23537.log 2026-02-22T21:37:13.706 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_dd.23203.log.gz 2026-02-22T21:37:13.707 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16247.log 2026-02-22T21:37:13.707 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_ee.23537.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_ee.23537.log.gz 2026-02-22T21:37:13.707 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25202.log 2026-02-22T21:37:13.707 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.16247.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.16247.log.gz 2026-02-22T21:37:13.707 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.allow_aa.20223.log 2026-02-22T21:37:13.709 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.25202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_aa.21971.log 2026-02-22T21:37:13.709 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25202.log.gz 2026-02-22T21:37:13.709 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.allow_aa.20223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.prefix_bb.21225.log 2026-02-22T21:37:13.710 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.allow_aa.20223.log.gz 2026-02-22T21:37:13.710 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_aa.21971.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_aa.21971.log.gz 2026-02-22T21:37:13.710 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.allow_aa.20199.log 2026-02-22T21:37:13.710 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.prefix_bb.21225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.allow_aa.20271.log 2026-02-22T21:37:13.710 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.prefix_bb.21225.log.gz 2026-02-22T21:37:13.710 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.allow_aa.20199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_ff.24263.log 2026-02-22T21:37:13.710 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.allow_aa.20199.log.gz 2026-02-22T21:37:13.710 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.allow_aa.20271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.match_bb.21591.log 2026-02-22T21:37:13.710 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.allow_aa.20271.log.gz 2026-02-22T21:37:13.710 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_ff.24263.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_ff.24263.log.gz 2026-02-22T21:37:13.710 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19191.log 2026-02-22T21:37:13.710 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.match_bb.21591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25562.log 2026-02-22T21:37:13.710 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.match_bb.21591.log.gz 2026-02-22T21:37:13.710 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.19191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_dd.23005.log 2026-02-22T21:37:13.710 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19191.log.gz 2026-02-22T21:37:13.714 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.25562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_gg.24615.log 2026-02-22T21:37:13.714 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25562.log.gz 2026-02-22T21:37:13.714 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_dd.23005.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_dd.23005.log.gz 2026-02-22T21:37:13.714 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_dd.23071.log 2026-02-22T21:37:13.714 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_gg.24615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24938.log 2026-02-22T21:37:13.714 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_gg.24615.log.gz 2026-02-22T21:37:13.714 INFO:teuthology.orchestra.run.trial023.stderr: 90.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-22T21:37:13.714 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_dd.23071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19469.log 2026-02-22T21:37:13.714 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_dd.23071.log.gz 2026-02-22T21:37:13.714 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_bb.22411.log 2026-02-22T21:37:13.714 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.24938.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24938.log.gz 2026-02-22T21:37:13.714 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.19469.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19469.log.gz 2026-02-22T21:37:13.714 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.prefix_aa.21015.log 2026-02-22T21:37:13.714 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_aa.21838.log 2026-02-22T21:37:13.714 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_bb.22411.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_bb.22411.log.gz 2026-02-22T21:37:13.714 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_ff.24109.log 2026-02-22T21:37:13.714 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.prefix_aa.21015.log: 0.0% -- replaced with /var/log/ceph/ceph-client.prefix_aa.21015.log.gz 2026-02-22T21:37:13.714 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_aa.21838.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_aa.21838.log.gz 2026-02-22T21:37:13.715 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16271.log 2026-02-22T21:37:13.715 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_cc.22653.log 2026-02-22T21:37:13.715 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_ff.24109.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_ff.24109.log.gz 2026-02-22T21:37:13.715 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.16271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_aa.21993.log 2026-02-22T21:37:13.715 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.16271.log.gz 2026-02-22T21:37:13.715 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_cc.22653.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_cc.22653.log.gz 2026-02-22T21:37:13.715 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.prefix_cc.21499.log 2026-02-22T21:37:13.715 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_aa.21993.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.fail_aa.21993.log.gz --verbose 2026-02-22T21:37:13.715 INFO:teuthology.orchestra.run.trial023.stderr: -- /var/log/ceph/ceph-client.admin.25298.log 2026-02-22T21:37:13.717 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19157.log 2026-02-22T21:37:13.717 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.prefix_cc.21499.log: 0.0% -- replaced with /var/log/ceph/ceph-client.prefix_cc.21499.log.gz 2026-02-22T21:37:13.717 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.25298.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25298.log.gz 2026-02-22T21:37:13.717 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_bb.22279.log 2026-02-22T21:37:13.717 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.19157.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19157.log.gz 2026-02-22T21:37:13.717 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_gg.24505.log 2026-02-22T21:37:13.717 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_bb.22279.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_bb.22279.log.gz 2026-02-22T21:37:13.717 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_bb.22191.log 2026-02-22T21:37:13.717 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_gg.24505.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_gg.24505.log.gz 2026-02-22T21:37:13.717 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24914.log 2026-02-22T21:37:13.717 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_gg.24439.log 2026-02-22T21:37:13.717 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_bb.22191.log: /var/log/ceph/ceph-client.admin.24914.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_bb.22191.log.gz 2026-02-22T21:37:13.717 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24914.log.gz 2026-02-22T21:37:13.717 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19623.log 2026-02-22T21:37:13.717 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_gg.24439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25274.log 2026-02-22T21:37:13.717 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_gg.24439.log.gz 2026-02-22T21:37:13.718 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.19623.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19623.log.gz 2026-02-22T21:37:13.718 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_bb.22543.log 2026-02-22T21:37:13.718 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_dd.23313.log 2026-02-22T21:37:13.718 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.25274.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25274.log.gz 2026-02-22T21:37:13.719 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_bb.22543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_ff.24043.log 2026-02-22T21:37:13.719 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_bb.22543.log.gz 2026-02-22T21:37:13.719 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_dd.23313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_ff.24065.log 2026-02-22T21:37:13.719 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_dd.23313.log.gz 2026-02-22T21:37:13.719 INFO:teuthology.orchestra.run.trial023.stderr:gzip/var/log/ceph/ceph-client.fail_ff.24043.log: -5 --verbose -- /var/log/ceph/ceph-client.fail_bb.22345.log 2026-02-22T21:37:13.719 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_ff.24043.log.gz 2026-02-22T21:37:13.719 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_ff.24065.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_ff.24065.log.gz 2026-02-22T21:37:13.720 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.allow_bb.20367.log 2026-02-22T21:37:13.720 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_bb.22345.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_bb.22345.log.gz 2026-02-22T21:37:13.720 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25058.log 2026-02-22T21:37:13.720 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_cc.22851.log 2026-02-22T21:37:13.720 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.allow_bb.20367.log: 0.0% -- replaced with /var/log/ceph/ceph-client.allow_bb.20367.log.gz 2026-02-22T21:37:13.720 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.25058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19261.log 2026-02-22T21:37:13.720 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25058.log.gz 2026-02-22T21:37:13.725 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_cc.22851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_dd.23159.log 2026-02-22T21:37:13.725 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_cc.22851.log.gz 2026-02-22T21:37:13.725 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_writes.24861.log 2026-02-22T21:37:13.725 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.19261.log: /var/log/ceph/ceph-client.fail_dd.23159.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19261.log.gz 2026-02-22T21:37:13.725 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_dd.23159.log.gz 2026-02-22T21:37:13.725 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_ee.23669.log 2026-02-22T21:37:13.725 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_writes.24861.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_writes.24861.log.gz 2026-02-22T21:37:13.725 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_bb.22257.log 2026-02-22T21:37:13.725 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_ee.23757.log 2026-02-22T21:37:13.725 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_ee.23669.log: /var/log/ceph/ceph-client.fail_bb.22257.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_ee.23669.log.gz 2026-02-22T21:37:13.725 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_bb.22257.log.gz 2026-02-22T21:37:13.725 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_aa.21683.log 2026-02-22T21:37:13.725 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_bb.22389.log 2026-02-22T21:37:13.726 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_ee.23757.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_ee.23757.log.gz 2026-02-22T21:37:13.726 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_aa.21683.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_aa.21683.log.gz 2026-02-22T21:37:13.726 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_gg.24373.log 2026-02-22T21:37:13.726 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_dd.23335.log 2026-02-22T21:37:13.726 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_bb.22389.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_bb.22389.log.gz 2026-02-22T21:37:13.726 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_gg.24373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.prefix_bb.21155.log 2026-02-22T21:37:13.726 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_gg.24373.log.gz 2026-02-22T21:37:13.726 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_dd.23335.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_dd.23335.log.gz 2026-02-22T21:37:13.726 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_cc.22675.log 2026-02-22T21:37:13.726 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_ee.23691.log 2026-02-22T21:37:13.726 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.prefix_bb.21155.log: 0.0% -- replaced with /var/log/ceph/ceph-client.prefix_bb.21155.log.gz 2026-02-22T21:37:13.726 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_cc.22675.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_cc.22675.log.gz 2026-02-22T21:37:13.726 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_cc.22631.log 2026-02-22T21:37:13.726 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_ee.23691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_cc.22785.log 2026-02-22T21:37:13.726 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_ee.23691.log.gz 2026-02-22T21:37:13.726 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_cc.22631.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_cc.22631.log.gz 2026-02-22T21:37:13.726 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19863.log 2026-02-22T21:37:13.726 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_cc.22785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_cc.22763.log 2026-02-22T21:37:13.727 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_cc.22785.log.gz 2026-02-22T21:37:13.727 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.19863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_cc.22961.log 2026-02-22T21:37:13.727 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19863.log.gz 2026-02-22T21:37:13.727 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_cc.22763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_aa.21750.log 2026-02-22T21:37:13.727 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_cc.22763.log.gz 2026-02-22T21:37:13.729 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.match_aa.21569.log 2026-02-22T21:37:13.729 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_cc.22961.log: /var/log/ceph/ceph-client.fail_aa.21750.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_cc.22961.log.gz 2026-02-22T21:37:13.729 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_aa.21750.log.gz 2026-02-22T21:37:13.729 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_gg.24659.log 2026-02-22T21:37:13.729 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.match_aa.21569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_cc.22983.log 2026-02-22T21:37:13.729 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.match_aa.21569.log.gz 2026-02-22T21:37:13.729 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_gg.24659.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_gg.24659.log.gz 2026-02-22T21:37:13.729 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25640.log 2026-02-22T21:37:13.730 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_cc.22983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_ee.23713.log 2026-02-22T21:37:13.730 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_cc.22983.log.gz 2026-02-22T21:37:13.730 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.25640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_aa.21794.log 2026-02-22T21:37:13.730 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25640.log.gz 2026-02-22T21:37:13.730 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_ee.23713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_cc.22609.log 2026-02-22T21:37:13.730 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_ee.23713.log.gz 2026-02-22T21:37:13.730 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_writes.24837.log 2026-02-22T21:37:13.730 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_aa.21794.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_aa.21794.log.gz 2026-02-22T21:37:13.730 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_cc.22609.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_cc.22609.log.gz 2026-02-22T21:37:13.730 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25034.log 2026-02-22T21:37:13.730 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_writes.24837.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_writes.24837.log.gz 2026-02-22T21:37:13.730 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_ff.24175.log 2026-02-22T21:37:13.730 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_cc.22829.log 2026-02-22T21:37:13.730 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.25034.log: /var/log/ceph/ceph-client.fail_ff.24175.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25034.log.gz 2026-02-22T21:37:13.730 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_ff.24175.log.gz 2026-02-22T21:37:13.730 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-22T21:37:13.730 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_cc.22829.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_cc.22829.log.gz 2026-02-22T21:37:13.730 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_cc.22719.log 2026-02-22T21:37:13.732 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_aa.22081.log 2026-02-22T21:37:13.732 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-22T21:37:13.732 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_cc.22719.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_cc.22719.log.gz 2026-02-22T21:37:13.732 INFO:teuthology.orchestra.run.trial023.stderr: 89.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-22T21:37:13.732 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_aa.22081.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_aa.22081.log.gz 2026-02-22T21:37:13.732 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24986.log 2026-02-22T21:37:13.732 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_cc.22697.log 2026-02-22T21:37:13.732 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.24986.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.24986.log.gz /var/log/ceph/ceph-client.admin.19719.log 2026-02-22T21:37:13.732 INFO:teuthology.orchestra.run.trial023.stderr: 2026-02-22T21:37:13.732 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_cc.22697.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_cc.22697.log.gz 2026-02-22T21:37:13.732 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19060.log 2026-02-22T21:37:13.732 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.19719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_dd.23181.log 2026-02-22T21:37:13.732 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19719.log.gz 2026-02-22T21:37:13.732 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.19060.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19060.log.gz 2026-02-22T21:37:13.732 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_dd.23427.log 2026-02-22T21:37:13.735 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_dd.23181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_aa.21949.log 2026-02-22T21:37:13.736 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_dd.23181.log.gz 2026-02-22T21:37:13.736 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_dd.23427.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_dd.23427.log.gz 2026-02-22T21:37:13.736 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.prefix_aa.20971.log 2026-02-22T21:37:13.736 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_aa.21949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19791.log 2026-02-22T21:37:13.736 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_aa.21949.log.gz 2026-02-22T21:37:13.736 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.prefix_aa.20971.log: 0.0% -- replaced with /var/log/ceph/ceph-client.prefix_aa.20971.log.gz 2026-02-22T21:37:13.736 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-22T21:37:13.736 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.19791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25588.log 2026-02-22T21:37:13.736 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19791.log.gz 2026-02-22T21:37:13.736 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_ee.23515.log 2026-02-22T21:37:13.736 INFO:teuthology.orchestra.run.trial023.stderr: 86.6% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-22T21:37:13.736 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.25588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.prefix_aa.20993.log 2026-02-22T21:37:13.736 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25588.log.gz 2026-02-22T21:37:13.737 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_ee.23515.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_ee.23515.log.gz 2026-02-22T21:37:13.737 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_cc.22807.log 2026-02-22T21:37:13.737 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.prefix_aa.20993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_dd.23137.log 2026-02-22T21:37:13.737 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.prefix_aa.20993.log.gz 2026-02-22T21:37:13.737 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_cc.22807.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_cc.22807.log.gz 2026-02-22T21:37:13.737 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.prefix_cc.21405.log 2026-02-22T21:37:13.737 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_dd.23137.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.fail_dd.23137.log.gz -- 2026-02-22T21:37:13.737 INFO:teuthology.orchestra.run.trial023.stderr: /var/log/ceph/ceph-client.admin.19935.log 2026-02-22T21:37:13.738 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.prefix_cc.21405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.prefix_bb.21335.log 2026-02-22T21:37:13.739 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.prefix_cc.21405.log.gz 2026-02-22T21:37:13.739 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.19935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19983.log 2026-02-22T21:37:13.739 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19935.log.gz 2026-02-22T21:37:13.739 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.prefix_bb.21335.log: 0.0% -- replaced with /var/log/ceph/ceph-client.prefix_bb.21335.log.gz 2026-02-22T21:37:13.739 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_dd.23049.log 2026-02-22T21:37:13.739 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.19983.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19983.log.gz 2026-02-22T21:37:13.739 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.prefix_cc.21381.log 2026-02-22T21:37:13.739 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_dd.23049.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_dd.23049.log.gz 2026-02-22T21:37:13.739 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24962.log 2026-02-22T21:37:13.739 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.prefix_cc.21381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_cc.22873.log 2026-02-22T21:37:13.739 INFO:teuthology.orchestra.run.trial023.stderr: 0.0%/var/log/ceph/ceph-client.admin.24962.log: -- replaced with /var/log/ceph/ceph-client.prefix_cc.21381.log.gz 2026-02-22T21:37:13.739 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24962.log.gz 2026-02-22T21:37:13.739 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.prefix_bb.21179.log 2026-02-22T21:37:13.739 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.prefix_cc.21453.log 2026-02-22T21:37:13.739 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_cc.22873.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_cc.22873.log.gz 2026-02-22T21:37:13.739 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.prefix_bb.21179.log: 0.0% -- replaced with /var/log/ceph/ceph-client.prefix_bb.21179.log.gz 2026-02-22T21:37:13.739 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20007.log 2026-02-22T21:37:13.739 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.prefix_cc.21453.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.25154.log 2026-02-22T21:37:13.739 INFO:teuthology.orchestra.run.trial023.stderr: -- replaced with /var/log/ceph/ceph-client.prefix_cc.21453.log.gz 2026-02-22T21:37:13.741 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.20007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25226.log 2026-02-22T21:37:13.741 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20007.log.gz 2026-02-22T21:37:13.741 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.25154.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25154.log.gz 2026-02-22T21:37:13.742 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25178.log 2026-02-22T21:37:13.742 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.25226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25690.log 2026-02-22T21:37:13.742 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25226.log.gz 2026-02-22T21:37:13.742 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.25178.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25178.log.gz 2026-02-22T21:37:13.742 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_ee.23647.log 2026-02-22T21:37:13.742 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.25690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_ff.24087.log 2026-02-22T21:37:13.742 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25690.log.gz 2026-02-22T21:37:13.742 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_ee.23647.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_ee.23647.log.gz 2026-02-22T21:37:13.742 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25536.log 2026-02-22T21:37:13.742 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_ff.24087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_ff.23955.log 2026-02-22T21:37:13.742 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_ff.24087.log.gz 2026-02-22T21:37:13.742 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.25536.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25536.log.gz 2026-02-22T21:37:13.742 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.allow_bb.20343.log 2026-02-22T21:37:13.744 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_ff.23955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20151.log 2026-02-22T21:37:13.745 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_ff.23955.log.gz 2026-02-22T21:37:13.745 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.allow_bb.20343.log: 0.0% -- replaced with /var/log/ceph/ceph-client.allow_bb.20343.log.gz 2026-02-22T21:37:13.745 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.allow_cc.20463.log 2026-02-22T21:37:13.745 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.prefix_bb.21291.log 2026-02-22T21:37:13.745 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.20151.log: /var/log/ceph/ceph-client.allow_cc.20463.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20151.log.gz 2026-02-22T21:37:13.745 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.allow_cc.20463.log.gz 2026-02-22T21:37:13.745 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19815.log 2026-02-22T21:37:13.745 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.prefix_bb.21291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.prefix_bb.21313.log 2026-02-22T21:37:13.745 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.prefix_bb.21291.log.gz 2026-02-22T21:37:13.745 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.19815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20127.log 2026-02-22T21:37:13.745 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19815.log.gz 2026-02-22T21:37:13.745 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.prefix_bb.21313.log: 0.0% -- replaced with /var/log/ceph/ceph-client.prefix_bb.21313.log.gz 2026-02-22T21:37:13.745 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.prefix_cc.21357.log 2026-02-22T21:37:13.745 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.20127.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20127.log.gz 2026-02-22T21:37:13.745 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_ee.23735.log 2026-02-22T21:37:13.745 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.prefix_cc.21357.log: 0.0% -- replaced with /var/log/ceph/ceph-client.prefix_cc.21357.log.gz 2026-02-22T21:37:13.745 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_ff.23889.log 2026-02-22T21:37:13.745 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_ee.23735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19443.log 2026-02-22T21:37:13.745 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_ee.23735.log.gz 2026-02-22T21:37:13.745 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_ff.23889.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_ff.23889.log.gz 2026-02-22T21:37:13.747 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_gg.24329.log 2026-02-22T21:37:13.747 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.19443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_ee.23493.log 2026-02-22T21:37:13.747 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19443.log.gz 2026-02-22T21:37:13.747 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_gg.24329.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_gg.24329.log.gz 2026-02-22T21:37:13.747 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_bb.22521.log 2026-02-22T21:37:13.747 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_ee.23493.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_ee.23493.log.gzgzip 2026-02-22T21:37:13.747 INFO:teuthology.orchestra.run.trial023.stderr: -5 --verbose -- /var/log/ceph/ceph-client.fail_gg.24461.log 2026-02-22T21:37:13.747 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_bb.22521.log: gzip -5 --verbose 0.0% -- /var/log/ceph/ceph-client.admin.25322.log -- replaced with /var/log/ceph/ceph-client.fail_bb.22521.log.gz 2026-02-22T21:37:13.747 INFO:teuthology.orchestra.run.trial023.stderr: 2026-02-22T21:37:13.747 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_gg.24461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_ee.23471.log 2026-02-22T21:37:13.747 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_gg.24461.log.gz 2026-02-22T21:37:13.747 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.25322.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25322.log.gz 2026-02-22T21:37:13.747 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_ff.24021.log 2026-02-22T21:37:13.749 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_ee.23471.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-22T21:37:13.749 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_ee.23471.log.gz 2026-02-22T21:37:13.749 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_ff.24021.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_ff.24021.log.gz 2026-02-22T21:37:13.749 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_aa.21904.log 2026-02-22T21:37:13.749 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_dd.23247.log 2026-02-22T21:37:13.749 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.fail_aa.21904.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_aa.21904.log.gz 2026-02-22T21:37:13.749 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_aa.21772.log 2026-02-22T21:37:13.749 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_ff.24241.log 2026-02-22T21:37:13.749 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_dd.23247.log: /var/log/ceph/ceph-client.fail_aa.21772.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_dd.23247.log.gz 2026-02-22T21:37:13.749 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_aa.21772.log.gz 2026-02-22T21:37:13.749 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.allow_cc.20415.log 2026-02-22T21:37:13.749 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_ff.24241.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_ff.24241.log.gz 2026-02-22T21:37:13.752 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25346.log 2026-02-22T21:37:13.752 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.allow_cc.20415.log: 0.0% -- replaced with /var/log/ceph/ceph-client.allow_cc.20415.log.gz 2026-02-22T21:37:13.752 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_cc.22917.log 2026-02-22T21:37:13.752 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.25346.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25346.log.gz 2026-02-22T21:37:13.752 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_dd.23115.log 2026-02-22T21:37:13.752 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_cc.22917.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_cc.22917.log.gz 2026-02-22T21:37:13.752 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20175.log 2026-02-22T21:37:13.752 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_dd.23115.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_dd.23115.log.gz 2026-02-22T21:37:13.752 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.match_bb.21639.log 2026-02-22T21:37:13.752 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.20175.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20175.log.gz 2026-02-22T21:37:13.752 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25130.log 2026-02-22T21:37:13.752 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.match_bb.21639.log: 0.0% -- replaced with /var/log/ceph/ceph-client.match_bb.21639.log.gz 2026-02-22T21:37:13.753 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16223.log 2026-02-22T21:37:13.753 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.25130.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25130.log.gz 2026-02-22T21:37:13.753 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25484.log 2026-02-22T21:37:13.753 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.16223.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.16223.log.gz 2026-02-22T21:37:13.753 INFO:teuthology.orchestra.run.trial023.stderr: -5 --verbose -- /var/log/ceph/ceph-client.fail_bb.22125.log 2026-02-22T21:37:13.753 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.25484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19189.log 2026-02-22T21:37:13.753 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25484.log.gz 2026-02-22T21:37:13.756 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_bb.22125.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.fail_bb.22125.log.gz /var/log/ceph/ceph-client.admin.25614.log 2026-02-22T21:37:13.756 INFO:teuthology.orchestra.run.trial023.stderr: 2026-02-22T21:37:13.756 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.19189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25010.log 2026-02-22T21:37:13.756 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19189.log.gz 2026-02-22T21:37:13.756 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.25614.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25614.log.gz 2026-02-22T21:37:13.756 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_ee.23581.log 2026-02-22T21:37:13.756 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.25010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19743.log 2026-02-22T21:37:13.756 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25010.log.gz 2026-02-22T21:37:13.757 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_ee.23581.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-22T21:37:13.757 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_ee.23581.log.gz 2026-02-22T21:37:13.757 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.19743.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19743.log.gz 2026-02-22T21:37:13.757 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_ff.24219.log 2026-02-22T21:37:13.757 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_gg.24725.log 2026-02-22T21:37:13.757 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_ff.24219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25432.log 2026-02-22T21:37:13.757 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_ff.24219.log.gz 2026-02-22T21:37:13.757 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_gg.24725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19035.log 2026-02-22T21:37:13.757 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_gg.24725.log.gz 2026-02-22T21:37:13.757 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.25432.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25432.log.gz 2026-02-22T21:37:13.757 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_aa.21927.log 2026-02-22T21:37:13.757 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.19035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_bb.22367.log 2026-02-22T21:37:13.757 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19035.log.gz 2026-02-22T21:37:13.757 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_dd.23357.log 2026-02-22T21:37:13.757 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_aa.21927.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_aa.21927.log.gz 2026-02-22T21:37:13.757 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_bb.22367.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_bb.22367.log.gz 2026-02-22T21:37:13.757 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_aa.21860.log 2026-02-22T21:37:13.759 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_dd.23357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19839.log 2026-02-22T21:37:13.759 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_dd.23357.log.gz 2026-02-22T21:37:13.759 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_aa.21860.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_aa.21860.log.gz 2026-02-22T21:37:13.759 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19417.log 2026-02-22T21:37:13.759 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.19839.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.12482.log 2026-02-22T21:37:13.759 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19839.log.gz 2026-02-22T21:37:13.759 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.19417.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19417.log.gz 2026-02-22T21:37:13.759 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_ff.24197.log 2026-02-22T21:37:13.760 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.prefix_aa.21037.log 2026-02-22T21:37:13.760 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph.tmp-client.admin.12482.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.12482.log.gz 2026-02-22T21:37:13.760 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_ff.24197.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_ff.24197.log.gz 2026-02-22T21:37:13.760 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19599.log 2026-02-22T21:37:13.760 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.prefix_aa.21131.log 2026-02-22T21:37:13.760 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.prefix_aa.21037.log: /var/log/ceph/ceph-client.admin.19599.log: 0.0% -- replaced with /var/log/ceph/ceph-client.prefix_aa.21037.log.gz 2026-02-22T21:37:13.760 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19599.log.gz 2026-02-22T21:37:13.760 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.match_bb.21615.log 2026-02-22T21:37:13.760 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_bb.22433.log 2026-02-22T21:37:13.760 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.prefix_aa.21131.log: 0.0%/var/log/ceph/ceph-client.match_bb.21615.log: -- replaced with /var/log/ceph/ceph-client.prefix_aa.21131.log.gz 2026-02-22T21:37:13.760 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.match_bb.21615.log.gz 2026-02-22T21:37:13.760 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16306.log 2026-02-22T21:37:13.761 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_bb.22433.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_bb.22433.log.gz 2026-02-22T21:37:13.761 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25250.log 2026-02-22T21:37:13.761 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.16306.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.16306.log.gz 2026-02-22T21:37:13.761 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.fail_ee.23559.log 2026-02-22T21:37:13.761 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.25250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25106.log 2026-02-22T21:37:13.761 INFO:teuthology.orchestra.run.trial023.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25250.log.gz 2026-02-22T21:37:13.761 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.fail_ee.23559.log: 0.0% -- replaced with /var/log/ceph/ceph-client.fail_ee.23559.log.gz 2026-02-22T21:37:13.761 INFO:teuthology.orchestra.run.trial023.stderr:/var/log/ceph/ceph-client.admin.25106.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25106.log.gz 2026-02-22T21:37:13.763 INFO:teuthology.orchestra.run.trial023.stderr: 92.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-22T21:37:13.783 INFO:teuthology.orchestra.run.trial023.stderr: 92.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-22T21:37:13.789 INFO:teuthology.orchestra.run.trial023.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-22T21:37:13.792 INFO:teuthology.orchestra.run.trial023.stderr: 92.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-22T21:37:13.793 INFO:teuthology.orchestra.run.trial023.stderr: 2026-02-22T21:37:13.793 INFO:teuthology.orchestra.run.trial023.stderr:real 0m0.129s 2026-02-22T21:37:13.793 INFO:teuthology.orchestra.run.trial023.stderr:user 0m0.370s 2026-02-22T21:37:13.793 INFO:teuthology.orchestra.run.trial023.stderr:sys 0m0.073s 2026-02-22T21:37:13.794 INFO:tasks.ceph:Archiving logs... 2026-02-22T21:37:13.794 DEBUG:teuthology.misc:Transferring archived files from trial023:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64059/remote/trial023/log 2026-02-22T21:37:13.795 DEBUG:teuthology.orchestra.run.trial023:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-22T21:37:14.047 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-22T21:37:14.066 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-22T21:37:14.066 DEBUG:teuthology.orchestra.run.trial023:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-22T21:37:14.141 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-22T21:37:14.157 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-22T21:37:14.157 DEBUG:teuthology.orchestra.run.trial023:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-22T21:37:14.190 INFO:teuthology.orchestra.run.trial023.stdout: remote refid st t when poll reach delay offset jitter 2026-02-22T21:37:14.191 INFO:teuthology.orchestra.run.trial023.stdout:============================================================================== 2026-02-22T21:37:14.191 INFO:teuthology.orchestra.run.trial023.stdout: 139-177-202-26. 82.43.52.28 2 u 15 64 17 23.656 +9.054 1.376 2026-02-22T21:37:14.191 INFO:teuthology.orchestra.run.trial023.stdout:*38.45.64.130 129.134.25.123 2 u 18 64 17 24.257 -1.980 0.899 2026-02-22T21:37:14.191 INFO:teuthology.orchestra.run.trial023.stdout: 216.82.35.115 129.6.15.25 2 u 17 64 17 25.726 -1.756 0.482 2026-02-22T21:37:14.191 INFO:teuthology.orchestra.run.trial023.stdout: host-131-239-5- 130.207.244.240 2 u 15 64 17 31.416 -0.590 1.138 2026-02-22T21:37:14.191 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-22T21:37:14.203 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-22T21:37:14.203 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-22T21:37:14.228 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-22T21:37:14.240 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-22T21:37:14.255 INFO:teuthology.task.internal:Duration was 361.915593 seconds 2026-02-22T21:37:14.256 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-22T21:37:14.270 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-22T21:37:14.270 DEBUG:teuthology.orchestra.run.trial023:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-22T21:37:14.298 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-22T21:37:14.298 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial023.front.sepia.ceph.com 2026-02-22T21:37:14.298 DEBUG:teuthology.orchestra.run.trial023:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-22T21:37:14.347 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-22T21:37:14.348 DEBUG:teuthology.orchestra.run.trial023:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-22T21:37:14.612 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-22T21:37:14.612 DEBUG:teuthology.orchestra.run.trial023:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-22T21:37:14.621 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-22T21:37:14.623 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-22T21:37:14.623 INFO:teuthology.orchestra.run.trial023.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-22T21:37:14.623 INFO:teuthology.orchestra.run.trial023.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-22T21:37:14.623 INFO:teuthology.orchestra.run.trial023.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-22T21:37:14.691 INFO:teuthology.orchestra.run.trial023.stderr: 81.4% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-22T21:37:14.693 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-22T21:37:14.712 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-22T21:37:14.713 DEBUG:teuthology.orchestra.run.trial023:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-22T21:37:14.742 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-22T21:37:14.758 DEBUG:teuthology.orchestra.run.trial023:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-22T21:37:14.793 INFO:teuthology.orchestra.run.trial023.stdout:kernel.core_pattern = core 2026-02-22T21:37:14.802 DEBUG:teuthology.orchestra.run.trial023:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-22T21:37:14.848 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T21:37:14.849 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-22T21:37:14.864 INFO:teuthology.task.internal:Transferring archived files... 2026-02-22T21:37:14.865 DEBUG:teuthology.misc:Transferring archived files from trial023:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64059/remote/trial023 2026-02-22T21:37:14.865 DEBUG:teuthology.orchestra.run.trial023:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-22T21:37:14.927 INFO:teuthology.task.internal:Removing archive directory... 2026-02-22T21:37:14.927 DEBUG:teuthology.orchestra.run.trial023:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-22T21:37:14.957 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-22T21:37:14.974 INFO:teuthology.task.internal:Not uploading archives. 2026-02-22T21:37:14.974 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-22T21:37:14.985 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-22T21:37:14.985 DEBUG:teuthology.orchestra.run.trial023:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-22T21:37:15.001 INFO:teuthology.orchestra.run.trial023.stdout: 1179671 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 22 21:37 /home/ubuntu/cephtest 2026-02-22T21:37:15.002 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-22T21:37:15.018 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-22T21:37:15.055 INFO:teuthology.run:Summary data: description: rados/singleton/{all/mon-config-key-caps mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} duration: 361.91559314727783 flavor: default owner: scheduled_yuriw@soko04.front.sepia.ceph.com success: true 2026-02-22T21:37:15.055 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-22T21:37:15.180 INFO:teuthology.run:pass