2026-02-17T05:19:47.562 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-17T05:19:47.575 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T05:19:47.652 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/skanta-2026-02-17_03:53:03-rados-wip-bharath18-testing-2026-02-13-0856-distro-default-trial/50998 branch: wip-bharath18-testing-2026-02-13-0856 description: rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd} email: skanta@redhat.com first_in_suite: false flavor: default job_id: '50998' kernel: branch: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: trial name: skanta-2026-02-17_03:53:03-rados-wip-bharath18-testing-2026-02-13-0856-distro-default-trial no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-bharath18-testing-2026-02-13-0856 ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 325850157d309f65985eea9ec9bb9f1d56726fee ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 325850157d309f65985eea9ec9bb9f1d56726fee workunit: branch: wip-bharath18-testing-2026-02-13-0856 sha1: 325850157d309f65985eea9ec9bb9f1d56726fee owner: scheduled_skanta@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 7109 sha1: 325850157d309f65985eea9ec9bb9f1d56726fee sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-bharath18-testing-2026-02-13-0856 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_325850157d309f65985eea9ec9bb9f1d56726fee/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 325850157d309f65985eea9ec9bb9f1d56726fee targets: trial030.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIFuBBssmJMjSgtJW2Jgm6YHG6rxa3NnrzG25+2OQvTfp9VaiqA7FlCZQ2B0rUOQXoNc51CX6rj/UmNmftCjY9M= tasks: - install: null - workunit: basedir: qa/standalone clients: all: - osd teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-17_03:53:03 tube: trial user: skanta verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682 2026-02-17T05:19:47.652 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_325850157d309f65985eea9ec9bb9f1d56726fee/qa; will attempt to use it 2026-02-17T05:19:47.652 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_325850157d309f65985eea9ec9bb9f1d56726fee/qa/tasks 2026-02-17T05:19:47.652 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-17T05:19:47.654 INFO:teuthology.task.internal:Checking packages... 2026-02-17T05:19:47.654 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '325850157d309f65985eea9ec9bb9f1d56726fee' 2026-02-17T05:19:47.654 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-17T05:19:47.654 INFO:teuthology.packaging:ref: None 2026-02-17T05:19:47.654 INFO:teuthology.packaging:tag: None 2026-02-17T05:19:47.654 INFO:teuthology.packaging:branch: wip-bharath18-testing-2026-02-13-0856 2026-02-17T05:19:47.654 INFO:teuthology.packaging:sha1: 325850157d309f65985eea9ec9bb9f1d56726fee 2026-02-17T05:19:47.654 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-bharath18-testing-2026-02-13-0856 2026-02-17T05:19:47.770 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5271-g32585015-1jammy 2026-02-17T05:19:47.771 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-17T05:19:47.786 INFO:teuthology.task.internal:no buildpackages task found 2026-02-17T05:19:47.786 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-17T05:19:47.798 INFO:teuthology.task.internal:Saving configuration 2026-02-17T05:19:47.807 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-17T05:19:47.818 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-17T05:19:47.898 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial030.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/skanta-2026-02-17_03:53:03-rados-wip-bharath18-testing-2026-02-13-0856-distro-default-trial/50998', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-17 05:16:19.316449', 'locked_by': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIF4ubdtgmB809rb/bYz3LhzZp++vAeIbLJb81EXabopg'} 2026-02-17T05:19:47.898 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-17T05:19:47.909 INFO:teuthology.task.internal:roles: ubuntu@trial030.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2026-02-17T05:19:47.909 INFO:teuthology.run_tasks:Running task console_log... 2026-02-17T05:19:48.000 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7d875effbce0>, signals=[15]) 2026-02-17T05:19:48.001 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-17T05:19:48.010 INFO:teuthology.task.internal:Opening connections... 2026-02-17T05:19:48.010 DEBUG:teuthology.task.internal:connecting to ubuntu@trial030.front.sepia.ceph.com 2026-02-17T05:19:48.011 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial030.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T05:19:48.076 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-17T05:19:48.087 DEBUG:teuthology.orchestra.run.trial030:> uname -m 2026-02-17T05:19:48.154 INFO:teuthology.orchestra.run.trial030.stdout:x86_64 2026-02-17T05:19:48.154 DEBUG:teuthology.orchestra.run.trial030:> cat /etc/os-release 2026-02-17T05:19:48.200 INFO:teuthology.orchestra.run.trial030.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS" 2026-02-17T05:19:48.200 INFO:teuthology.orchestra.run.trial030.stdout:NAME="Ubuntu" 2026-02-17T05:19:48.200 INFO:teuthology.orchestra.run.trial030.stdout:VERSION_ID="22.04" 2026-02-17T05:19:48.200 INFO:teuthology.orchestra.run.trial030.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)" 2026-02-17T05:19:48.200 INFO:teuthology.orchestra.run.trial030.stdout:VERSION_CODENAME=jammy 2026-02-17T05:19:48.200 INFO:teuthology.orchestra.run.trial030.stdout:ID=ubuntu 2026-02-17T05:19:48.200 INFO:teuthology.orchestra.run.trial030.stdout:ID_LIKE=debian 2026-02-17T05:19:48.200 INFO:teuthology.orchestra.run.trial030.stdout:HOME_URL="https://www.ubuntu.com/" 2026-02-17T05:19:48.201 INFO:teuthology.orchestra.run.trial030.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2026-02-17T05:19:48.201 INFO:teuthology.orchestra.run.trial030.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2026-02-17T05:19:48.201 INFO:teuthology.orchestra.run.trial030.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2026-02-17T05:19:48.201 INFO:teuthology.orchestra.run.trial030.stdout:UBUNTU_CODENAME=jammy 2026-02-17T05:19:48.201 INFO:teuthology.lock.ops:Updating trial030.front.sepia.ceph.com on lock server 2026-02-17T05:19:48.285 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-17T05:19:48.297 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-17T05:19:48.307 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-17T05:19:48.307 DEBUG:teuthology.orchestra.run.trial030:> test '!' -e /home/ubuntu/cephtest 2026-02-17T05:19:48.310 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-17T05:19:48.319 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-17T05:19:48.320 DEBUG:teuthology.orchestra.run.trial030:> test -z $(ls -A /var/lib/ceph) 2026-02-17T05:19:48.356 INFO:teuthology.orchestra.run.trial030.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-17T05:19:48.357 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-17T05:19:48.467 INFO:teuthology.run_tasks:Running task kernel... 2026-02-17T05:19:48.486 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-17T05:19:48.486 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-17T05:19:48.486 DEBUG:teuthology.orchestra.run.trial030:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-17T05:19:48.489 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T05:19:48.490 DEBUG:teuthology.orchestra.run.trial030:> uname -r 2026-02-17T05:19:48.536 INFO:teuthology.orchestra.run.trial030.stdout:5.15.0-164-generic 2026-02-17T05:19:48.536 INFO:teuthology.task.kernel:Running kernel on trial030: 5.15.0-164-generic 2026-02-17T05:19:48.536 DEBUG:teuthology.orchestra.run.trial030:> sudo apt-get clean 2026-02-17T05:19:48.595 DEBUG:teuthology.orchestra.run.trial030:> sudo apt-get update 2026-02-17T05:19:48.793 INFO:teuthology.orchestra.run.trial030.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-17T05:19:48.802 INFO:teuthology.orchestra.run.trial030.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2026-02-17T05:19:48.849 INFO:teuthology.orchestra.run.trial030.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2026-02-17T05:19:48.866 INFO:teuthology.orchestra.run.trial030.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2026-02-17T05:19:48.929 INFO:teuthology.orchestra.run.trial030.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [3237 kB] 2026-02-17T05:19:48.995 INFO:teuthology.orchestra.run.trial030.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [493 kB] 2026-02-17T05:19:48.997 INFO:teuthology.orchestra.run.trial030.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [19.1 kB] 2026-02-17T05:19:48.998 INFO:teuthology.orchestra.run.trial030.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1255 kB] 2026-02-17T05:19:49.005 INFO:teuthology.orchestra.run.trial030.stdout:Get:9 https://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [313 kB] 2026-02-17T05:19:49.007 INFO:teuthology.orchestra.run.trial030.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [30.3 kB] 2026-02-17T05:19:49.008 INFO:teuthology.orchestra.run.trial030.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [5287 kB] 2026-02-17T05:19:49.034 INFO:teuthology.orchestra.run.trial030.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [997 kB] 2026-02-17T05:19:49.037 INFO:teuthology.orchestra.run.trial030.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 Packages [2966 kB] 2026-02-17T05:19:49.046 INFO:teuthology.orchestra.run.trial030.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy-security/main Translation-en [426 kB] 2026-02-17T05:19:49.048 INFO:teuthology.orchestra.run.trial030.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [14.1 kB] 2026-02-17T05:19:49.048 INFO:teuthology.orchestra.run.trial030.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [1017 kB] 2026-02-17T05:19:49.051 INFO:teuthology.orchestra.run.trial030.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy-security/universe Translation-en [224 kB] 2026-02-17T05:19:49.052 INFO:teuthology.orchestra.run.trial030.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [22.6 kB] 2026-02-17T05:19:49.052 INFO:teuthology.orchestra.run.trial030.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [5096 kB] 2026-02-17T05:19:49.069 INFO:teuthology.orchestra.run.trial030.stdout:Get:20 https://archive.ubuntu.com/ubuntu jammy-security/restricted Translation-en [964 kB] 2026-02-17T05:19:52.736 INFO:teuthology.orchestra.run.trial030.stdout:Fetched 22.7 MB in 2s (13.6 MB/s) 2026-02-17T05:19:53.255 INFO:teuthology.orchestra.run.trial030.stdout:Reading package lists... 2026-02-17T05:19:53.268 DEBUG:teuthology.orchestra.run.trial030:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-17T05:19:53.302 INFO:teuthology.orchestra.run.trial030.stdout:Reading package lists... 2026-02-17T05:19:53.411 INFO:teuthology.orchestra.run.trial030.stdout:Building dependency tree... 2026-02-17T05:19:53.411 INFO:teuthology.orchestra.run.trial030.stdout:Reading state information... 2026-02-17T05:19:53.497 INFO:teuthology.orchestra.run.trial030.stdout:The following packages were automatically installed and are no longer required: 2026-02-17T05:19:53.497 INFO:teuthology.orchestra.run.trial030.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-17T05:19:53.497 INFO:teuthology.orchestra.run.trial030.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-17T05:19:53.497 INFO:teuthology.orchestra.run.trial030.stdout: sg3-utils-udev 2026-02-17T05:19:53.497 INFO:teuthology.orchestra.run.trial030.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-17T05:19:53.498 INFO:teuthology.orchestra.run.trial030.stdout:The following additional packages will be installed: 2026-02-17T05:19:53.498 INFO:teuthology.orchestra.run.trial030.stdout: linux-generic linux-headers-5.15.0-170 linux-headers-5.15.0-170-generic 2026-02-17T05:19:53.498 INFO:teuthology.orchestra.run.trial030.stdout: linux-headers-generic linux-image-5.15.0-170-generic 2026-02-17T05:19:53.498 INFO:teuthology.orchestra.run.trial030.stdout: linux-modules-5.15.0-170-generic linux-modules-extra-5.15.0-170-generic 2026-02-17T05:19:53.498 INFO:teuthology.orchestra.run.trial030.stdout:Suggested packages: 2026-02-17T05:19:53.498 INFO:teuthology.orchestra.run.trial030.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2026-02-17T05:19:53.511 INFO:teuthology.orchestra.run.trial030.stdout:The following NEW packages will be installed: 2026-02-17T05:19:53.511 INFO:teuthology.orchestra.run.trial030.stdout: linux-headers-5.15.0-170 linux-headers-5.15.0-170-generic 2026-02-17T05:19:53.511 INFO:teuthology.orchestra.run.trial030.stdout: linux-image-5.15.0-170-generic linux-modules-5.15.0-170-generic 2026-02-17T05:19:53.512 INFO:teuthology.orchestra.run.trial030.stdout: linux-modules-extra-5.15.0-170-generic 2026-02-17T05:19:53.512 INFO:teuthology.orchestra.run.trial030.stdout:The following packages will be upgraded: 2026-02-17T05:19:53.512 INFO:teuthology.orchestra.run.trial030.stdout: linux-generic linux-headers-generic linux-image-generic 2026-02-17T05:19:53.610 INFO:teuthology.orchestra.run.trial030.stdout:3 upgraded, 5 newly installed, 0 to remove and 51 not upgraded. 2026-02-17T05:19:53.610 INFO:teuthology.orchestra.run.trial030.stdout:Need to get 113 MB of archives. 2026-02-17T05:19:53.610 INFO:teuthology.orchestra.run.trial030.stdout:After this operation, 585 MB of additional disk space will be used. 2026-02-17T05:19:53.610 INFO:teuthology.orchestra.run.trial030.stdout:Get:1 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-170-generic amd64 5.15.0-170.180 [22.7 MB] 2026-02-17T05:19:53.825 INFO:teuthology.orchestra.run.trial030.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-170-generic amd64 5.15.0-170.180 [11.6 MB] 2026-02-17T05:19:53.896 INFO:teuthology.orchestra.run.trial030.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-170-generic amd64 5.15.0-170.180 [64.0 MB] 2026-02-17T05:19:54.280 INFO:teuthology.orchestra.run.trial030.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.170.159 [1654 B] 2026-02-17T05:19:54.280 INFO:teuthology.orchestra.run.trial030.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.170.159 [2474 B] 2026-02-17T05:19:54.280 INFO:teuthology.orchestra.run.trial030.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-170 all 5.15.0-170.180 [12.4 MB] 2026-02-17T05:19:54.332 INFO:teuthology.orchestra.run.trial030.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-170-generic amd64 5.15.0-170.180 [2828 kB] 2026-02-17T05:19:54.362 INFO:teuthology.orchestra.run.trial030.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.170.159 [2316 B] 2026-02-17T05:19:54.561 INFO:teuthology.orchestra.run.trial030.stdout:Fetched 113 MB in 1s (134 MB/s) 2026-02-17T05:19:54.579 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package linux-modules-5.15.0-170-generic. 2026-02-17T05:19:54.742 INFO:teuthology.orchestra.run.trial030.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 131954 files and directories currently installed.) 2026-02-17T05:19:54.743 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../0-linux-modules-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-17T05:19:54.745 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking linux-modules-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T05:19:55.099 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package linux-image-5.15.0-170-generic. 2026-02-17T05:19:55.104 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../1-linux-image-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-17T05:19:55.121 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T05:19:55.162 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-170-generic. 2026-02-17T05:19:55.168 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-17T05:19:55.169 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking linux-modules-extra-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T05:19:56.296 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../3-linux-generic_5.15.0.170.159_amd64.deb ... 2026-02-17T05:19:56.297 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking linux-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-17T05:19:56.319 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.170.159_amd64.deb ... 2026-02-17T05:19:56.319 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking linux-image-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-17T05:19:56.336 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package linux-headers-5.15.0-170. 2026-02-17T05:19:56.343 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../5-linux-headers-5.15.0-170_5.15.0-170.180_all.deb ... 2026-02-17T05:19:56.344 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking linux-headers-5.15.0-170 (5.15.0-170.180) ... 2026-02-17T05:19:57.691 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package linux-headers-5.15.0-170-generic. 2026-02-17T05:19:57.703 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../6-linux-headers-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-17T05:19:57.703 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking linux-headers-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T05:19:58.311 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.170.159_amd64.deb ... 2026-02-17T05:19:58.312 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking linux-headers-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-17T05:19:58.338 INFO:teuthology.orchestra.run.trial030.stdout:Setting up linux-headers-5.15.0-170 (5.15.0-170.180) ... 2026-02-17T05:19:58.339 INFO:teuthology.orchestra.run.trial030.stdout:Setting up linux-headers-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T05:19:58.340 INFO:teuthology.orchestra.run.trial030.stdout:Setting up linux-headers-generic (5.15.0.170.159) ... 2026-02-17T05:19:58.341 INFO:teuthology.orchestra.run.trial030.stdout:Setting up linux-modules-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T05:19:59.135 INFO:teuthology.orchestra.run.trial030.stdout:Setting up linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T05:19:59.986 INFO:teuthology.orchestra.run.trial030.stdout:I: /boot/vmlinuz is now a symlink to vmlinuz-5.15.0-170-generic 2026-02-17T05:19:59.986 INFO:teuthology.orchestra.run.trial030.stdout:I: /boot/initrd.img is now a symlink to initrd.img-5.15.0-170-generic 2026-02-17T05:19:59.992 INFO:teuthology.orchestra.run.trial030.stdout:Setting up linux-modules-extra-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T05:20:00.814 INFO:teuthology.orchestra.run.trial030.stdout:Setting up linux-image-generic (5.15.0.170.159) ... 2026-02-17T05:20:00.815 INFO:teuthology.orchestra.run.trial030.stdout:Setting up linux-generic (5.15.0.170.159) ... 2026-02-17T05:20:00.816 INFO:teuthology.orchestra.run.trial030.stdout:Processing triggers for linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T05:20:00.821 INFO:teuthology.orchestra.run.trial030.stdout:/etc/kernel/postinst.d/initramfs-tools: 2026-02-17T05:20:00.821 INFO:teuthology.orchestra.run.trial030.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-170-generic 2026-02-17T05:20:07.902 INFO:teuthology.orchestra.run.trial030.stdout:W: Possible missing firmware /lib/firmware/ast_dp501_fw.bin for module ast 2026-02-17T05:20:14.548 INFO:teuthology.orchestra.run.trial030.stdout:/etc/kernel/postinst.d/zz-update-grub: 2026-02-17T05:20:14.548 INFO:teuthology.orchestra.run.trial030.stdout:Sourcing file `/etc/default/grub' 2026-02-17T05:20:14.566 INFO:teuthology.orchestra.run.trial030.stdout:Sourcing file `/etc/default/grub.d/50-curtin-settings.cfg' 2026-02-17T05:20:14.567 INFO:teuthology.orchestra.run.trial030.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2026-02-17T05:20:14.570 INFO:teuthology.orchestra.run.trial030.stdout:Generating grub configuration file ... 2026-02-17T05:20:14.651 INFO:teuthology.orchestra.run.trial030.stdout:Found linux image: /boot/vmlinuz-5.15.0-170-generic 2026-02-17T05:20:14.658 INFO:teuthology.orchestra.run.trial030.stdout:Found initrd image: /boot/initrd.img-5.15.0-170-generic 2026-02-17T05:20:14.830 INFO:teuthology.orchestra.run.trial030.stdout:Found linux image: /boot/vmlinuz-5.15.0-164-generic 2026-02-17T05:20:14.836 INFO:teuthology.orchestra.run.trial030.stdout:Found initrd image: /boot/initrd.img-5.15.0-164-generic 2026-02-17T05:20:14.910 INFO:teuthology.orchestra.run.trial030.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2026-02-17T05:20:14.910 INFO:teuthology.orchestra.run.trial030.stdout:Systems on them will not be added to the GRUB boot configuration. 2026-02-17T05:20:14.911 INFO:teuthology.orchestra.run.trial030.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2026-02-17T05:20:14.912 INFO:teuthology.orchestra.run.trial030.stdout:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T05:20:14.922 INFO:teuthology.orchestra.run.trial030.stdout:done 2026-02-17T05:20:15.321 INFO:teuthology.orchestra.run.trial030.stdout: 2026-02-17T05:20:15.321 INFO:teuthology.orchestra.run.trial030.stdout:Pending kernel upgrade! 2026-02-17T05:20:15.321 INFO:teuthology.orchestra.run.trial030.stdout: 2026-02-17T05:20:15.321 INFO:teuthology.orchestra.run.trial030.stdout:Running kernel version: 2026-02-17T05:20:15.321 INFO:teuthology.orchestra.run.trial030.stdout: 5.15.0-164-generic 2026-02-17T05:20:15.321 INFO:teuthology.orchestra.run.trial030.stdout: 2026-02-17T05:20:15.321 INFO:teuthology.orchestra.run.trial030.stdout:Diagnostics: 2026-02-17T05:20:15.321 INFO:teuthology.orchestra.run.trial030.stdout: The currently running kernel version is not the expected kernel version 5.15.0-170-generic. 2026-02-17T05:20:15.322 INFO:teuthology.orchestra.run.trial030.stdout: 2026-02-17T05:20:15.322 INFO:teuthology.orchestra.run.trial030.stdout:Restarting the system to load the new kernel will not be handled automatically, so you should consider rebooting. [Return] 2026-02-17T05:20:15.322 INFO:teuthology.orchestra.run.trial030.stdout: 2026-02-17T05:20:15.322 INFO:teuthology.orchestra.run.trial030.stdout:The processor microcode seems to be up-to-date. 2026-02-17T05:20:15.322 INFO:teuthology.orchestra.run.trial030.stdout: 2026-02-17T05:20:15.322 INFO:teuthology.orchestra.run.trial030.stdout:No services need to be restarted. 2026-02-17T05:20:15.322 INFO:teuthology.orchestra.run.trial030.stdout: 2026-02-17T05:20:15.322 INFO:teuthology.orchestra.run.trial030.stdout:No containers need to be restarted. 2026-02-17T05:20:15.322 INFO:teuthology.orchestra.run.trial030.stdout: 2026-02-17T05:20:15.322 INFO:teuthology.orchestra.run.trial030.stdout:No user sessions are running outdated binaries. 2026-02-17T05:20:15.322 INFO:teuthology.orchestra.run.trial030.stdout: 2026-02-17T05:20:15.322 INFO:teuthology.orchestra.run.trial030.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-17T05:20:15.989 DEBUG:teuthology.orchestra.run.trial030:> dpkg -s linux-image-generic 2026-02-17T05:20:15.999 INFO:teuthology.orchestra.run.trial030.stdout:Package: linux-image-generic 2026-02-17T05:20:16.000 INFO:teuthology.orchestra.run.trial030.stdout:Status: install ok installed 2026-02-17T05:20:16.000 INFO:teuthology.orchestra.run.trial030.stdout:Priority: optional 2026-02-17T05:20:16.000 INFO:teuthology.orchestra.run.trial030.stdout:Section: kernel 2026-02-17T05:20:16.000 INFO:teuthology.orchestra.run.trial030.stdout:Installed-Size: 21 2026-02-17T05:20:16.000 INFO:teuthology.orchestra.run.trial030.stdout:Maintainer: Ubuntu Kernel Team 2026-02-17T05:20:16.000 INFO:teuthology.orchestra.run.trial030.stdout:Architecture: amd64 2026-02-17T05:20:16.000 INFO:teuthology.orchestra.run.trial030.stdout:Source: linux-meta 2026-02-17T05:20:16.000 INFO:teuthology.orchestra.run.trial030.stdout:Version: 5.15.0.170.159 2026-02-17T05:20:16.000 INFO:teuthology.orchestra.run.trial030.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-170), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-17T05:20:16.000 INFO:teuthology.orchestra.run.trial030.stdout:Depends: linux-image-5.15.0-170-generic, linux-modules-extra-5.15.0-170-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-17T05:20:16.001 INFO:teuthology.orchestra.run.trial030.stdout:Recommends: thermald 2026-02-17T05:20:16.001 INFO:teuthology.orchestra.run.trial030.stdout:Description: Generic Linux kernel image 2026-02-17T05:20:16.001 INFO:teuthology.orchestra.run.trial030.stdout: This package will always depend on the latest generic kernel image 2026-02-17T05:20:16.001 INFO:teuthology.orchestra.run.trial030.stdout: available. 2026-02-17T05:20:16.001 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-164-generic Expected: 5.15.0-170-generic 2026-02-17T05:20:16.001 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-17T05:20:16.001 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-17T05:20:16.002 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-17T05:20:16.002 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial030.front.sepia.ceph.com, path=None, version=distro) 2026-02-17T05:20:16.002 DEBUG:teuthology.orchestra.run.trial030:> sudo apt-get clean 2026-02-17T05:20:16.084 DEBUG:teuthology.orchestra.run.trial030:> sudo apt-get update 2026-02-17T05:20:16.516 INFO:teuthology.orchestra.run.trial030.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-17T05:20:16.582 INFO:teuthology.orchestra.run.trial030.stdout:Hit:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-17T05:20:16.653 INFO:teuthology.orchestra.run.trial030.stdout:Hit:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-17T05:20:16.725 INFO:teuthology.orchestra.run.trial030.stdout:Hit:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-17T05:20:17.373 INFO:teuthology.orchestra.run.trial030.stdout:Reading package lists... 2026-02-17T05:20:17.388 DEBUG:teuthology.orchestra.run.trial030:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-17T05:20:17.424 INFO:teuthology.orchestra.run.trial030.stdout:Reading package lists... 2026-02-17T05:20:17.532 INFO:teuthology.orchestra.run.trial030.stdout:Building dependency tree... 2026-02-17T05:20:17.532 INFO:teuthology.orchestra.run.trial030.stdout:Reading state information... 2026-02-17T05:20:17.618 INFO:teuthology.orchestra.run.trial030.stdout:linux-image-generic is already the newest version (5.15.0.170.159). 2026-02-17T05:20:17.618 INFO:teuthology.orchestra.run.trial030.stdout:linux-image-generic set to manually installed. 2026-02-17T05:20:17.619 INFO:teuthology.orchestra.run.trial030.stdout:The following packages were automatically installed and are no longer required: 2026-02-17T05:20:17.619 INFO:teuthology.orchestra.run.trial030.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-17T05:20:17.619 INFO:teuthology.orchestra.run.trial030.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-17T05:20:17.619 INFO:teuthology.orchestra.run.trial030.stdout: sg3-utils-udev 2026-02-17T05:20:17.619 INFO:teuthology.orchestra.run.trial030.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-17T05:20:17.638 INFO:teuthology.orchestra.run.trial030.stdout:0 upgraded, 0 newly installed, 0 to remove and 51 not upgraded. 2026-02-17T05:20:17.640 DEBUG:teuthology.orchestra.run.trial030:> dpkg -s linux-image-generic 2026-02-17T05:20:17.690 INFO:teuthology.orchestra.run.trial030.stdout:Package: linux-image-generic 2026-02-17T05:20:17.690 INFO:teuthology.orchestra.run.trial030.stdout:Status: install ok installed 2026-02-17T05:20:17.690 INFO:teuthology.orchestra.run.trial030.stdout:Priority: optional 2026-02-17T05:20:17.690 INFO:teuthology.orchestra.run.trial030.stdout:Section: kernel 2026-02-17T05:20:17.690 INFO:teuthology.orchestra.run.trial030.stdout:Installed-Size: 21 2026-02-17T05:20:17.691 INFO:teuthology.orchestra.run.trial030.stdout:Maintainer: Ubuntu Kernel Team 2026-02-17T05:20:17.691 INFO:teuthology.orchestra.run.trial030.stdout:Architecture: amd64 2026-02-17T05:20:17.691 INFO:teuthology.orchestra.run.trial030.stdout:Source: linux-meta 2026-02-17T05:20:17.691 INFO:teuthology.orchestra.run.trial030.stdout:Version: 5.15.0.170.159 2026-02-17T05:20:17.691 INFO:teuthology.orchestra.run.trial030.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-170), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-17T05:20:17.691 INFO:teuthology.orchestra.run.trial030.stdout:Depends: linux-image-5.15.0-170-generic, linux-modules-extra-5.15.0-170-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-17T05:20:17.691 INFO:teuthology.orchestra.run.trial030.stdout:Recommends: thermald 2026-02-17T05:20:17.691 INFO:teuthology.orchestra.run.trial030.stdout:Description: Generic Linux kernel image 2026-02-17T05:20:17.691 INFO:teuthology.orchestra.run.trial030.stdout: This package will always depend on the latest generic kernel image 2026-02-17T05:20:17.691 INFO:teuthology.orchestra.run.trial030.stdout: available. 2026-02-17T05:20:17.692 DEBUG:teuthology.orchestra.run.trial030:> mktemp 2026-02-17T05:20:17.736 INFO:teuthology.orchestra.run.trial030.stdout:/tmp/tmp.9UGXMHYhCy 2026-02-17T05:20:17.737 DEBUG:teuthology.orchestra.run.trial030:> sudo cp /boot/grub/grub.cfg /tmp/tmp.9UGXMHYhCy 2026-02-17T05:20:17.789 DEBUG:teuthology.orchestra.run.trial030:> sudo chmod 0666 /tmp/tmp.9UGXMHYhCy 2026-02-17T05:20:17.886 DEBUG:teuthology.orchestra.remote:trial030:/tmp/tmp.9UGXMHYhCy is 7KB 2026-02-17T05:20:17.892 DEBUG:teuthology.orchestra.run.trial030:> rm -fr /tmp/tmp.9UGXMHYhCy 2026-02-17T05:20:17.896 DEBUG:teuthology.orchestra.run.trial030:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2026-02-17T05:20:17.944 DEBUG:teuthology.orchestra.run.trial030:> set -ex 2026-02-17T05:20:17.944 DEBUG:teuthology.orchestra.run.trial030:> sudo dd of=/etc/grub.d/01_ceph_kernel 2026-02-17T05:20:17.944 DEBUG:teuthology.orchestra.run.trial030:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2026-02-17T05:20:18.002 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-170-generic 2026-02-17T05:20:18.003 DEBUG:teuthology.orchestra.run.trial030:> sudo update-grub 2026-02-17T05:20:18.232 INFO:teuthology.orchestra.run.trial030.stderr:Sourcing file `/etc/default/grub' 2026-02-17T05:20:18.250 INFO:teuthology.orchestra.run.trial030.stderr:Sourcing file `/etc/default/grub.d/50-curtin-settings.cfg' 2026-02-17T05:20:18.251 INFO:teuthology.orchestra.run.trial030.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2026-02-17T05:20:18.253 INFO:teuthology.orchestra.run.trial030.stderr:Generating grub configuration file ... 2026-02-17T05:20:18.335 INFO:teuthology.orchestra.run.trial030.stderr:Found linux image: /boot/vmlinuz-5.15.0-170-generic 2026-02-17T05:20:18.341 INFO:teuthology.orchestra.run.trial030.stderr:Found initrd image: /boot/initrd.img-5.15.0-170-generic 2026-02-17T05:20:18.515 INFO:teuthology.orchestra.run.trial030.stderr:Found linux image: /boot/vmlinuz-5.15.0-164-generic 2026-02-17T05:20:18.521 INFO:teuthology.orchestra.run.trial030.stderr:Found initrd image: /boot/initrd.img-5.15.0-164-generic 2026-02-17T05:20:18.591 INFO:teuthology.orchestra.run.trial030.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2026-02-17T05:20:18.591 INFO:teuthology.orchestra.run.trial030.stderr:Systems on them will not be added to the GRUB boot configuration. 2026-02-17T05:20:18.591 INFO:teuthology.orchestra.run.trial030.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2026-02-17T05:20:18.593 INFO:teuthology.orchestra.run.trial030.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T05:20:18.600 INFO:teuthology.orchestra.run.trial030.stderr:done 2026-02-17T05:20:18.602 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial030 2026-02-17T05:20:18.602 DEBUG:teuthology.orchestra.run.trial030:> sudo bash -c ' 2026-02-17T05:20:18.602 DEBUG:teuthology.orchestra.run.trial030:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-17T05:20:18.603 DEBUG:teuthology.orchestra.run.trial030:> ' 2026-02-17T05:20:48.604 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-17T05:20:48.605 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial030.front.sepia.ceph.com' 2026-02-17T05:20:48.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial030.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T05:21:02.913 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.30 2026-02-17T05:21:11.921 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial030.front.sepia.ceph.com' 2026-02-17T05:21:11.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial030.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T05:21:48.003 DEBUG:teuthology.orchestra.run.trial030:> true 2026-02-17T05:21:48.394 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial030.front.sepia.ceph.com' 2026-02-17T05:21:48.394 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-170-generic"... 2026-02-17T05:21:48.395 DEBUG:teuthology.orchestra.run.trial030:> uname -r 2026-02-17T05:21:48.443 INFO:teuthology.orchestra.run.trial030.stdout:5.15.0-170-generic 2026-02-17T05:21:48.443 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-170-generic vs 5.15.0-170-generic 2026-02-17T05:21:48.443 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-17T05:21:48.443 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2026-02-17T05:21:49.444 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-17T05:21:49.445 DEBUG:teuthology.orchestra.run.trial030:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-17T05:21:49.458 INFO:teuthology.orchestra.run.trial030.stdout:ttyS1 2026-02-17T05:21:49.490 DEBUG:teuthology.parallel:result is None 2026-02-17T05:21:49.490 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-17T05:21:49.505 INFO:teuthology.task.internal:Creating test directory... 2026-02-17T05:21:49.505 DEBUG:teuthology.orchestra.run.trial030:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-17T05:21:49.534 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-17T05:21:49.546 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-17T05:21:49.559 INFO:teuthology.task.internal:Creating archive directory... 2026-02-17T05:21:49.560 DEBUG:teuthology.orchestra.run.trial030:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-17T05:21:49.585 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-17T05:21:49.597 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-17T05:21:49.597 DEBUG:teuthology.orchestra.run.trial030:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-17T05:21:49.633 INFO:teuthology.orchestra.run.trial030.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:21:49.639 INFO:teuthology.orchestra.run.trial030.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:21:49.641 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-17T05:21:49.653 INFO:teuthology.task.internal:Configuring sudo... 2026-02-17T05:21:49.653 DEBUG:teuthology.orchestra.run.trial030:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-17T05:21:49.692 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-17T05:21:49.710 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-17T05:21:49.710 DEBUG:teuthology.orchestra.run.trial030:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-17T05:21:49.739 DEBUG:teuthology.orchestra.run.trial030:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T05:21:49.782 DEBUG:teuthology.orchestra.run.trial030:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T05:21:49.826 DEBUG:teuthology.orchestra.run.trial030:> set -ex 2026-02-17T05:21:49.826 DEBUG:teuthology.orchestra.run.trial030:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-17T05:21:49.876 DEBUG:teuthology.orchestra.run.trial030:> sudo service rsyslog restart 2026-02-17T05:21:49.936 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-17T05:21:49.948 INFO:teuthology.task.internal:Starting timer... 2026-02-17T05:21:49.948 INFO:teuthology.run_tasks:Running task pcp... 2026-02-17T05:21:49.972 INFO:teuthology.run_tasks:Running task selinux... 2026-02-17T05:21:49.991 DEBUG:teuthology.task.selinux:Excluding trial030: OS 'ubuntu' does not support SELinux 2026-02-17T05:21:49.991 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-17T05:21:49.991 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2026-02-17T05:21:49.991 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-17T05:21:49.991 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-17T05:21:50.005 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-17T05:21:50.013 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-17T05:21:50.013 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial030.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-17T05:24:12.023 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial030.front.sepia.ceph.com')] 2026-02-17T05:24:12.025 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial030.front.sepia.ceph.com' 2026-02-17T05:24:12.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial030.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T05:24:12.134 DEBUG:teuthology.orchestra.run.trial030:> true 2026-02-17T05:24:12.385 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial030.front.sepia.ceph.com' 2026-02-17T05:24:12.385 INFO:teuthology.run_tasks:Running task clock... 2026-02-17T05:24:12.409 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-17T05:24:12.409 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-17T05:24:12.410 DEBUG:teuthology.orchestra.run.trial030:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T05:24:12.448 INFO:teuthology.orchestra.run.trial030.stdout:17 Feb 05:24:13 ntpd[8802]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2026-02-17T05:24:12.448 INFO:teuthology.orchestra.run.trial030.stdout:17 Feb 05:24:13 ntpd[8802]: Command line: ntpd -gq 2026-02-17T05:24:12.448 INFO:teuthology.orchestra.run.trial030.stdout:17 Feb 05:24:13 ntpd[8802]: ---------------------------------------------------- 2026-02-17T05:24:12.448 INFO:teuthology.orchestra.run.trial030.stdout:17 Feb 05:24:13 ntpd[8802]: ntp-4 is maintained by Network Time Foundation, 2026-02-17T05:24:12.449 INFO:teuthology.orchestra.run.trial030.stdout:17 Feb 05:24:13 ntpd[8802]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2026-02-17T05:24:12.449 INFO:teuthology.orchestra.run.trial030.stdout:17 Feb 05:24:13 ntpd[8802]: corporation. Support and training for ntp-4 are 2026-02-17T05:24:12.449 INFO:teuthology.orchestra.run.trial030.stdout:17 Feb 05:24:13 ntpd[8802]: available at https://www.nwtime.org/support 2026-02-17T05:24:12.449 INFO:teuthology.orchestra.run.trial030.stdout:17 Feb 05:24:13 ntpd[8802]: ---------------------------------------------------- 2026-02-17T05:24:12.449 INFO:teuthology.orchestra.run.trial030.stdout:17 Feb 05:24:13 ntpd[8802]: proto: precision = 0.030 usec (-25) 2026-02-17T05:24:12.449 INFO:teuthology.orchestra.run.trial030.stdout:17 Feb 05:24:13 ntpd[8802]: basedate set to 2022-02-04 2026-02-17T05:24:12.449 INFO:teuthology.orchestra.run.trial030.stdout:17 Feb 05:24:13 ntpd[8802]: gps base set to 2022-02-06 (week 2196) 2026-02-17T05:24:12.450 INFO:teuthology.orchestra.run.trial030.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-17T05:24:12.450 INFO:teuthology.orchestra.run.trial030.stdout:17 Feb 05:24:13 ntpd[8802]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-17T05:24:12.450 INFO:teuthology.orchestra.run.trial030.stderr:restrict ::: KOD does nothing without LIMITED. 2026-02-17T05:24:12.451 INFO:teuthology.orchestra.run.trial030.stdout:17 Feb 05:24:13 ntpd[8802]: restrict ::: KOD does nothing without LIMITED. 2026-02-17T05:24:12.452 INFO:teuthology.orchestra.run.trial030.stdout:17 Feb 05:24:13 ntpd[8802]: Listen and drop on 0 v6wildcard [::]:123 2026-02-17T05:24:12.452 INFO:teuthology.orchestra.run.trial030.stdout:17 Feb 05:24:13 ntpd[8802]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2026-02-17T05:24:12.452 INFO:teuthology.orchestra.run.trial030.stdout:17 Feb 05:24:13 ntpd[8802]: Listen normally on 2 lo 127.0.0.1:123 2026-02-17T05:24:12.452 INFO:teuthology.orchestra.run.trial030.stdout:17 Feb 05:24:13 ntpd[8802]: Listen normally on 3 enp1s0f0 10.20.193.30:123 2026-02-17T05:24:12.452 INFO:teuthology.orchestra.run.trial030.stdout:17 Feb 05:24:13 ntpd[8802]: Listen normally on 4 lo [::1]:123 2026-02-17T05:24:12.452 INFO:teuthology.orchestra.run.trial030.stdout:17 Feb 05:24:13 ntpd[8802]: Listen normally on 5 enp1s0f0 [fe80::925a:8ff:fe76:e844%2]:123 2026-02-17T05:24:12.452 INFO:teuthology.orchestra.run.trial030.stdout:17 Feb 05:24:13 ntpd[8802]: Listening on routing socket on fd #22 for interface updates 2026-02-17T05:24:14.448 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:15 ntpd[8802]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T05:24:14.448 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:15 ntpd[8802]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T05:24:14.517 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:15 ntpd[8802]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T05:24:14.518 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:15 ntpd[8802]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T05:24:14.518 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:15 ntpd[8802]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T05:24:14.518 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:15 ntpd[8802]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T05:24:16.448 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:17 ntpd[8802]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T05:24:16.448 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:17 ntpd[8802]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T05:24:16.449 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:17 ntpd[8802]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T05:24:16.449 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:17 ntpd[8802]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T05:24:16.449 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:17 ntpd[8802]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T05:24:16.449 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:17 ntpd[8802]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T05:24:16.449 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:17 ntpd[8802]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T05:24:16.449 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:17 ntpd[8802]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T05:24:16.518 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:17 ntpd[8802]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T05:24:16.519 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:17 ntpd[8802]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T05:24:16.519 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:17 ntpd[8802]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T05:24:16.519 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:17 ntpd[8802]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T05:24:16.519 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:17 ntpd[8802]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T05:24:16.519 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:17 ntpd[8802]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T05:24:16.520 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:17 ntpd[8802]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T05:24:16.520 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:17 ntpd[8802]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T05:24:16.530 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:17 ntpd[8802]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T05:24:16.530 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:17 ntpd[8802]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T05:24:16.530 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:17 ntpd[8802]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T05:24:16.531 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:17 ntpd[8802]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T05:24:18.448 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:19 ntpd[8802]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T05:24:18.448 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:19 ntpd[8802]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T05:24:18.449 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:19 ntpd[8802]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T05:24:18.449 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:19 ntpd[8802]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T05:24:18.449 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:19 ntpd[8802]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T05:24:18.449 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:19 ntpd[8802]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T05:24:18.519 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:19 ntpd[8802]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T05:24:18.520 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:19 ntpd[8802]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T05:24:18.520 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:19 ntpd[8802]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T05:24:18.520 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:19 ntpd[8802]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T05:24:18.529 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:19 ntpd[8802]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T05:24:18.529 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:19 ntpd[8802]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T05:24:18.529 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:19 ntpd[8802]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T05:24:18.529 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:19 ntpd[8802]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T05:24:20.448 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:21 ntpd[8802]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T05:24:20.448 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:21 ntpd[8802]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T05:24:20.448 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:21 ntpd[8802]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T05:24:20.448 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:21 ntpd[8802]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T05:24:20.448 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:21 ntpd[8802]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T05:24:20.448 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:21 ntpd[8802]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T05:24:20.518 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:21 ntpd[8802]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T05:24:20.518 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:21 ntpd[8802]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T05:24:20.518 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:21 ntpd[8802]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T05:24:20.518 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:21 ntpd[8802]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T05:24:20.521 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:21 ntpd[8802]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T05:24:20.521 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:21 ntpd[8802]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T05:24:20.521 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:21 ntpd[8802]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T05:24:20.522 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:21 ntpd[8802]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T05:24:20.529 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:21 ntpd[8802]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T05:24:20.529 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:21 ntpd[8802]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T05:24:20.530 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:21 ntpd[8802]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T05:24:20.530 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:21 ntpd[8802]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T05:24:22.448 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:23 ntpd[8802]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T05:24:22.448 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:23 ntpd[8802]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T05:24:22.448 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:23 ntpd[8802]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T05:24:22.449 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:23 ntpd[8802]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T05:24:22.449 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:23 ntpd[8802]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T05:24:22.449 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:23 ntpd[8802]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T05:24:22.517 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:23 ntpd[8802]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T05:24:22.517 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:23 ntpd[8802]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T05:24:22.518 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:23 ntpd[8802]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T05:24:22.518 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:23 ntpd[8802]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T05:24:22.518 INFO:teuthology.orchestra.run.trial030.stdout:17 Feb 05:24:22 ntpd[8802]: ntpd: time set -0.689915 s 2026-02-17T05:24:22.518 INFO:teuthology.orchestra.run.trial030.stdout:ntpd: time set -0.689915s 2026-02-17T05:24:22.519 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:22 ntpd[8802]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2026-02-17T05:24:22.519 INFO:teuthology.orchestra.run.trial030.stderr:17 Feb 05:24:22 ntpd[8802]: can't open /var/log/ntpstats/loopstats.20260217: Permission denied 2026-02-17T05:24:22.573 INFO:teuthology.orchestra.run.trial030.stdout: remote refid st t when poll reach delay offset jitter 2026-02-17T05:24:22.574 INFO:teuthology.orchestra.run.trial030.stdout:============================================================================== 2026-02-17T05:24:22.574 INFO:teuthology.orchestra.run.trial030.stdout: 172-234-25-10.i .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-17T05:24:22.574 INFO:teuthology.orchestra.run.trial030.stdout: 66.59.198.178 .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-17T05:24:22.574 INFO:teuthology.orchestra.run.trial030.stdout: time.cloudflare .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-17T05:24:22.574 INFO:teuthology.orchestra.run.trial030.stdout: 172-233-189-68. .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-17T05:24:22.575 INFO:teuthology.run_tasks:Running task install... 2026-02-17T05:24:22.589 DEBUG:teuthology.task.install:project ceph 2026-02-17T05:24:22.589 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '325850157d309f65985eea9ec9bb9f1d56726fee'}} 2026-02-17T05:24:22.590 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '325850157d309f65985eea9ec9bb9f1d56726fee'} 2026-02-17T05:24:22.590 INFO:teuthology.task.install:Using flavor: default 2026-02-17T05:24:22.599 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-17T05:24:22.599 INFO:teuthology.task.install:extra packages: [] 2026-02-17T05:24:22.599 DEBUG:teuthology.orchestra.run.trial030:> sudo apt-key list | grep Ceph 2026-02-17T05:24:22.663 INFO:teuthology.orchestra.run.trial030.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2026-02-17T05:24:22.692 INFO:teuthology.orchestra.run.trial030.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2026-02-17T05:24:22.692 INFO:teuthology.orchestra.run.trial030.stdout:uid [ unknown] Ceph.com (release key) 2026-02-17T05:24:22.694 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-osd, ceph-osd-classic, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2026-02-17T05:24:22.694 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=325850157d309f65985eea9ec9bb9f1d56726fee 2026-02-17T05:24:22.864 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-bharath18-testing-2026-02-13-0856/325850157d309f65985eea9ec9bb9f1d56726fee/ubuntu/jammy/flavors/default/ 2026-02-17T05:24:22.864 INFO:teuthology.task.install.deb:Package version is 20.3.0-5271-g32585015-1jammy 2026-02-17T05:24:22.998 DEBUG:teuthology.orchestra.run.trial030:> set -ex 2026-02-17T05:24:22.998 DEBUG:teuthology.orchestra.run.trial030:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2026-02-17T05:24:23.009 DEBUG:teuthology.orchestra.run.trial030:> sudo apt-get update 2026-02-17T05:24:23.301 INFO:teuthology.orchestra.run.trial030.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/wip-bharath18-testing-2026-02-13-0856/325850157d309f65985eea9ec9bb9f1d56726fee/ubuntu/jammy/flavors/default jammy InRelease 2026-02-17T05:24:23.351 INFO:teuthology.orchestra.run.trial030.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-bharath18-testing-2026-02-13-0856/325850157d309f65985eea9ec9bb9f1d56726fee/ubuntu/jammy/flavors/default jammy Release [7689 B] 2026-02-17T05:24:23.403 INFO:teuthology.orchestra.run.trial030.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/wip-bharath18-testing-2026-02-13-0856/325850157d309f65985eea9ec9bb9f1d56726fee/ubuntu/jammy/flavors/default jammy Release.gpg 2026-02-17T05:24:23.453 INFO:teuthology.orchestra.run.trial030.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/wip-bharath18-testing-2026-02-13-0856/325850157d309f65985eea9ec9bb9f1d56726fee/ubuntu/jammy/flavors/default jammy/main amd64 Packages [19.2 kB] 2026-02-17T05:24:23.507 INFO:teuthology.orchestra.run.trial030.stdout:Hit:5 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-17T05:24:23.591 INFO:teuthology.orchestra.run.trial030.stdout:Hit:6 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-17T05:24:23.679 INFO:teuthology.orchestra.run.trial030.stdout:Hit:7 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-17T05:24:23.767 INFO:teuthology.orchestra.run.trial030.stdout:Hit:8 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-17T05:24:23.909 INFO:teuthology.orchestra.run.trial030.stdout:Fetched 26.9 kB in 1s (36.5 kB/s) 2026-02-17T05:24:24.444 INFO:teuthology.orchestra.run.trial030.stdout:Reading package lists... 2026-02-17T05:24:24.457 DEBUG:teuthology.orchestra.run.trial030:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=20.3.0-5271-g32585015-1jammy cephadm=20.3.0-5271-g32585015-1jammy ceph-mds=20.3.0-5271-g32585015-1jammy ceph-mgr=20.3.0-5271-g32585015-1jammy ceph-osd=20.3.0-5271-g32585015-1jammy ceph-osd-classic=20.3.0-5271-g32585015-1jammy ceph-common=20.3.0-5271-g32585015-1jammy ceph-fuse=20.3.0-5271-g32585015-1jammy ceph-test=20.3.0-5271-g32585015-1jammy ceph-volume=20.3.0-5271-g32585015-1jammy radosgw=20.3.0-5271-g32585015-1jammy python3-rados=20.3.0-5271-g32585015-1jammy python3-rgw=20.3.0-5271-g32585015-1jammy python3-cephfs=20.3.0-5271-g32585015-1jammy python3-rbd=20.3.0-5271-g32585015-1jammy libcephfs2=20.3.0-5271-g32585015-1jammy libcephfs-dev=20.3.0-5271-g32585015-1jammy librados2=20.3.0-5271-g32585015-1jammy librbd1=20.3.0-5271-g32585015-1jammy rbd-fuse=20.3.0-5271-g32585015-1jammy 2026-02-17T05:24:24.490 INFO:teuthology.orchestra.run.trial030.stdout:Reading package lists... 2026-02-17T05:24:24.601 INFO:teuthology.orchestra.run.trial030.stdout:Building dependency tree... 2026-02-17T05:24:24.602 INFO:teuthology.orchestra.run.trial030.stdout:Reading state information... 2026-02-17T05:24:24.692 INFO:teuthology.orchestra.run.trial030.stdout:The following packages were automatically installed and are no longer required: 2026-02-17T05:24:24.692 INFO:teuthology.orchestra.run.trial030.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-17T05:24:24.692 INFO:teuthology.orchestra.run.trial030.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-17T05:24:24.692 INFO:teuthology.orchestra.run.trial030.stdout: sg3-utils-udev 2026-02-17T05:24:24.692 INFO:teuthology.orchestra.run.trial030.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-17T05:24:24.692 INFO:teuthology.orchestra.run.trial030.stdout:The following additional packages will be installed: 2026-02-17T05:24:24.692 INFO:teuthology.orchestra.run.trial030.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2026-02-17T05:24:24.692 INFO:teuthology.orchestra.run.trial030.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon jq libcephfs-daemon 2026-02-17T05:24:24.693 INFO:teuthology.orchestra.run.trial030.stdout: libcephfs-proxy2 libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 libnbd0 2026-02-17T05:24:24.693 INFO:teuthology.orchestra.run.trial030.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2026-02-17T05:24:24.693 INFO:teuthology.orchestra.run.trial030.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2026-02-17T05:24:24.693 INFO:teuthology.orchestra.run.trial030.stdout: nvme-cli python-asyncssh-doc python3-asyncssh python3-cachetools 2026-02-17T05:24:24.693 INFO:teuthology.orchestra.run.trial030.stdout: python3-ceph-argparse python3-ceph-common python3-cheroot python3-cherrypy3 2026-02-17T05:24:24.693 INFO:teuthology.orchestra.run.trial030.stdout: python3-google-auth python3-iniconfig python3-jaraco.classes 2026-02-17T05:24:24.693 INFO:teuthology.orchestra.run.trial030.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2026-02-17T05:24:24.693 INFO:teuthology.orchestra.run.trial030.stdout: python3-joblib python3-kubernetes python3-natsort python3-pluggy 2026-02-17T05:24:24.693 INFO:teuthology.orchestra.run.trial030.stdout: python3-portend python3-prettytable python3-psutil python3-py 2026-02-17T05:24:24.693 INFO:teuthology.orchestra.run.trial030.stdout: python3-pygments python3-pytest python3-repoze.lru python3-requests-oauthlib 2026-02-17T05:24:24.693 INFO:teuthology.orchestra.run.trial030.stdout: python3-routes python3-rsa python3-simplejson python3-sklearn 2026-02-17T05:24:24.693 INFO:teuthology.orchestra.run.trial030.stdout: python3-sklearn-lib python3-tempora python3-threadpoolctl python3-toml 2026-02-17T05:24:24.693 INFO:teuthology.orchestra.run.trial030.stdout: python3-wcwidth python3-webob python3-websocket python3-zc.lockfile 2026-02-17T05:24:24.693 INFO:teuthology.orchestra.run.trial030.stdout: qttranslations5-l10n socat xmlstarlet 2026-02-17T05:24:24.693 INFO:teuthology.orchestra.run.trial030.stdout:Suggested packages: 2026-02-17T05:24:24.693 INFO:teuthology.orchestra.run.trial030.stdout: python3-influxdb liblua5.3-dev luarocks python-natsort-doc python-psutil-doc 2026-02-17T05:24:24.693 INFO:teuthology.orchestra.run.trial030.stdout: subversion python-pygments-doc ttf-bitstream-vera python3-paste python3-dap 2026-02-17T05:24:24.693 INFO:teuthology.orchestra.run.trial030.stdout: python-sklearn-doc ipython3 python-webob-doc 2026-02-17T05:24:24.693 INFO:teuthology.orchestra.run.trial030.stdout:Recommended packages: 2026-02-17T05:24:24.693 INFO:teuthology.orchestra.run.trial030.stdout: btrfs-tools 2026-02-17T05:24:24.728 INFO:teuthology.orchestra.run.trial030.stdout:The following NEW packages will be installed: 2026-02-17T05:24:24.728 INFO:teuthology.orchestra.run.trial030.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2026-02-17T05:24:24.728 INFO:teuthology.orchestra.run.trial030.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2026-02-17T05:24:24.728 INFO:teuthology.orchestra.run.trial030.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-osd-classic ceph-test 2026-02-17T05:24:24.729 INFO:teuthology.orchestra.run.trial030.stdout: ceph-volume cephadm jq libcephfs-daemon libcephfs-dev libcephfs-proxy2 2026-02-17T05:24:24.729 INFO:teuthology.orchestra.run.trial030.stdout: libcephfs2 libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 libnbd0 2026-02-17T05:24:24.729 INFO:teuthology.orchestra.run.trial030.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2026-02-17T05:24:24.729 INFO:teuthology.orchestra.run.trial030.stdout: librados2 libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2026-02-17T05:24:24.729 INFO:teuthology.orchestra.run.trial030.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python3-asyncssh 2026-02-17T05:24:24.729 INFO:teuthology.orchestra.run.trial030.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2026-02-17T05:24:24.729 INFO:teuthology.orchestra.run.trial030.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-iniconfig 2026-02-17T05:24:24.729 INFO:teuthology.orchestra.run.trial030.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2026-02-17T05:24:24.729 INFO:teuthology.orchestra.run.trial030.stdout: python3-jaraco.text python3-joblib python3-kubernetes python3-natsort 2026-02-17T05:24:24.729 INFO:teuthology.orchestra.run.trial030.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2026-02-17T05:24:24.729 INFO:teuthology.orchestra.run.trial030.stdout: python3-pygments python3-pytest python3-rados python3-rbd python3-repoze.lru 2026-02-17T05:24:24.729 INFO:teuthology.orchestra.run.trial030.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2026-02-17T05:24:24.730 INFO:teuthology.orchestra.run.trial030.stdout: python3-simplejson python3-sklearn python3-sklearn-lib python3-tempora 2026-02-17T05:24:24.730 INFO:teuthology.orchestra.run.trial030.stdout: python3-threadpoolctl python3-toml python3-wcwidth python3-webob 2026-02-17T05:24:24.730 INFO:teuthology.orchestra.run.trial030.stdout: python3-websocket python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2026-02-17T05:24:24.730 INFO:teuthology.orchestra.run.trial030.stdout: socat xmlstarlet 2026-02-17T05:24:25.041 INFO:teuthology.orchestra.run.trial030.stdout:0 upgraded, 87 newly installed, 0 to remove and 51 not upgraded. 2026-02-17T05:24:25.041 INFO:teuthology.orchestra.run.trial030.stdout:Need to get 702 MB of archives. 2026-02-17T05:24:25.041 INFO:teuthology.orchestra.run.trial030.stdout:After this operation, 2670 MB of additional disk space will be used. 2026-02-17T05:24:25.041 INFO:teuthology.orchestra.run.trial030.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-bharath18-testing-2026-02-13-0856/325850157d309f65985eea9ec9bb9f1d56726fee/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 20.3.0-5271-g32585015-1jammy [3799 kB] 2026-02-17T05:24:25.084 INFO:teuthology.orchestra.run.trial030.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2026-02-17T05:24:25.423 INFO:teuthology.orchestra.run.trial030.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2026-02-17T05:24:25.433 INFO:teuthology.orchestra.run.trial030.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2026-02-17T05:24:25.503 INFO:teuthology.orchestra.run.trial030.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2006 kB] 2026-02-17T05:24:25.704 INFO:teuthology.orchestra.run.trial030.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2026-02-17T05:24:25.714 INFO:teuthology.orchestra.run.trial030.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2026-02-17T05:24:25.741 INFO:teuthology.orchestra.run.trial030.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2026-02-17T05:24:25.749 INFO:teuthology.orchestra.run.trial030.stdout:Get:9 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2026-02-17T05:24:25.751 INFO:teuthology.orchestra.run.trial030.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2026-02-17T05:24:25.751 INFO:teuthology.orchestra.run.trial030.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2026-02-17T05:24:25.752 INFO:teuthology.orchestra.run.trial030.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2026-02-17T05:24:25.769 INFO:teuthology.orchestra.run.trial030.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 liboath0 amd64 2.6.7-3ubuntu0.1 [41.3 kB] 2026-02-17T05:24:25.770 INFO:teuthology.orchestra.run.trial030.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9030 B] 2026-02-17T05:24:25.776 INFO:teuthology.orchestra.run.trial030.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2026-02-17T05:24:25.843 INFO:teuthology.orchestra.run.trial030.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6452 B] 2026-02-17T05:24:25.843 INFO:teuthology.orchestra.run.trial030.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8716 B] 2026-02-17T05:24:25.844 INFO:teuthology.orchestra.run.trial030.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2026-02-17T05:24:25.844 INFO:teuthology.orchestra.run.trial030.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2026-02-17T05:24:25.844 INFO:teuthology.orchestra.run.trial030.stdout:Get:20 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7240 B] 2026-02-17T05:24:25.844 INFO:teuthology.orchestra.run.trial030.stdout:Get:21 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8980 B] 2026-02-17T05:24:25.844 INFO:teuthology.orchestra.run.trial030.stdout:Get:22 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2026-02-17T05:24:25.848 INFO:teuthology.orchestra.run.trial030.stdout:Get:23 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2026-02-17T05:24:25.849 INFO:teuthology.orchestra.run.trial030.stdout:Get:24 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libfuse2 amd64 2.9.9-5ubuntu3 [90.3 kB] 2026-02-17T05:24:25.919 INFO:teuthology.orchestra.run.trial030.stdout:Get:25 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python3-asyncssh all 2.5.0-1ubuntu0.1 [189 kB] 2026-02-17T05:24:25.921 INFO:teuthology.orchestra.run.trial030.stdout:Get:26 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2026-02-17T05:24:25.921 INFO:teuthology.orchestra.run.trial030.stdout:Get:27 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2026-02-17T05:24:25.922 INFO:teuthology.orchestra.run.trial030.stdout:Get:28 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2058 kB] 2026-02-17T05:24:25.947 INFO:teuthology.orchestra.run.trial030.stdout:Get:29 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2026-02-17T05:24:25.949 INFO:teuthology.orchestra.run.trial030.stdout:Get:30 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2026-02-17T05:24:25.949 INFO:teuthology.orchestra.run.trial030.stdout:Get:31 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1829 kB] 2026-02-17T05:24:26.007 INFO:teuthology.orchestra.run.trial030.stdout:Get:32 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9722 B] 2026-02-17T05:24:26.008 INFO:teuthology.orchestra.run.trial030.stdout:Get:33 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2026-02-17T05:24:26.008 INFO:teuthology.orchestra.run.trial030.stdout:Get:34 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2026-02-17T05:24:26.009 INFO:teuthology.orchestra.run.trial030.stdout:Get:35 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2026-02-17T05:24:26.009 INFO:teuthology.orchestra.run.trial030.stdout:Get:36 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2026-02-17T05:24:26.067 INFO:teuthology.orchestra.run.trial030.stdout:Get:37 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2026-02-17T05:24:26.069 INFO:teuthology.orchestra.run.trial030.stdout:Get:38 https://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2026-02-17T05:24:26.070 INFO:teuthology.orchestra.run.trial030.stdout:Get:39 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libjq1 amd64 1.6-2.1ubuntu3.1 [133 kB] 2026-02-17T05:24:26.072 INFO:teuthology.orchestra.run.trial030.stdout:Get:40 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 jq amd64 1.6-2.1ubuntu3.1 [52.5 kB] 2026-02-17T05:24:26.139 INFO:teuthology.orchestra.run.trial030.stdout:Get:41 https://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2026-02-17T05:24:26.141 INFO:teuthology.orchestra.run.trial030.stdout:Get:42 https://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2026-02-17T05:24:26.143 INFO:teuthology.orchestra.run.trial030.stdout:Get:43 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2026-02-17T05:24:26.147 INFO:teuthology.orchestra.run.trial030.stdout:Get:44 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python-asyncssh-doc all 2.5.0-1ubuntu0.1 [309 kB] 2026-02-17T05:24:26.150 INFO:teuthology.orchestra.run.trial030.stdout:Get:45 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6024 B] 2026-02-17T05:24:26.150 INFO:teuthology.orchestra.run.trial030.stdout:Get:46 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2026-02-17T05:24:26.211 INFO:teuthology.orchestra.run.trial030.stdout:Get:47 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2026-02-17T05:24:26.212 INFO:teuthology.orchestra.run.trial030.stdout:Get:48 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2026-02-17T05:24:26.213 INFO:teuthology.orchestra.run.trial030.stdout:Get:49 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-pygments all 2.11.2+dfsg-2ubuntu0.1 [750 kB] 2026-02-17T05:24:26.219 INFO:teuthology.orchestra.run.trial030.stdout:Get:50 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2026-02-17T05:24:26.283 INFO:teuthology.orchestra.run.trial030.stdout:Get:51 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2026-02-17T05:24:26.285 INFO:teuthology.orchestra.run.trial030.stdout:Get:52 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2026-02-17T05:24:26.286 INFO:teuthology.orchestra.run.trial030.stdout:Get:53 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2026-02-17T05:24:26.286 INFO:teuthology.orchestra.run.trial030.stdout:Get:54 https://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1983 kB] 2026-02-17T05:24:27.688 INFO:teuthology.orchestra.run.trial030.stdout:Get:55 https://1.chacra.ceph.com/r/ceph/wip-bharath18-testing-2026-02-13-0856/325850157d309f65985eea9ec9bb9f1d56726fee/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 20.3.0-5271-g32585015-1jammy [2910 kB] 2026-02-17T05:24:29.361 INFO:teuthology.orchestra.run.trial030.stdout:Get:56 https://1.chacra.ceph.com/r/ceph/wip-bharath18-testing-2026-02-13-0856/325850157d309f65985eea9ec9bb9f1d56726fee/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 20.3.0-5271-g32585015-1jammy [882 kB] 2026-02-17T05:24:29.874 INFO:teuthology.orchestra.run.trial030.stdout:Get:57 https://1.chacra.ceph.com/r/ceph/wip-bharath18-testing-2026-02-13-0856/325850157d309f65985eea9ec9bb9f1d56726fee/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 20.3.0-5271-g32585015-1jammy [359 kB] 2026-02-17T05:24:30.068 INFO:teuthology.orchestra.run.trial030.stdout:Get:58 https://1.chacra.ceph.com/r/ceph/wip-bharath18-testing-2026-02-13-0856/325850157d309f65985eea9ec9bb9f1d56726fee/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 20.3.0-5271-g32585015-1jammy [32.8 kB] 2026-02-17T05:24:30.069 INFO:teuthology.orchestra.run.trial030.stdout:Get:59 https://1.chacra.ceph.com/r/ceph/wip-bharath18-testing-2026-02-13-0856/325850157d309f65985eea9ec9bb9f1d56726fee/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 20.3.0-5271-g32585015-1jammy [225 kB] 2026-02-17T05:24:30.198 INFO:teuthology.orchestra.run.trial030.stdout:Get:60 https://1.chacra.ceph.com/r/ceph/wip-bharath18-testing-2026-02-13-0856/325850157d309f65985eea9ec9bb9f1d56726fee/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 20.3.0-5271-g32585015-1jammy [88.4 kB] 2026-02-17T05:24:30.247 INFO:teuthology.orchestra.run.trial030.stdout:Get:61 https://1.chacra.ceph.com/r/ceph/wip-bharath18-testing-2026-02-13-0856/325850157d309f65985eea9ec9bb9f1d56726fee/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 20.3.0-5271-g32585015-1jammy [339 kB] 2026-02-17T05:24:30.394 INFO:teuthology.orchestra.run.trial030.stdout:Get:62 https://1.chacra.ceph.com/r/ceph/wip-bharath18-testing-2026-02-13-0856/325850157d309f65985eea9ec9bb9f1d56726fee/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 20.3.0-5271-g32585015-1jammy [9091 kB] 2026-02-17T05:24:34.457 INFO:teuthology.orchestra.run.trial030.stdout:Get:63 https://1.chacra.ceph.com/r/ceph/wip-bharath18-testing-2026-02-13-0856/325850157d309f65985eea9ec9bb9f1d56726fee/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 20.3.0-5271-g32585015-1jammy [112 kB] 2026-02-17T05:24:34.483 INFO:teuthology.orchestra.run.trial030.stdout:Get:64 https://1.chacra.ceph.com/r/ceph/wip-bharath18-testing-2026-02-13-0856/325850157d309f65985eea9ec9bb9f1d56726fee/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 20.3.0-5271-g32585015-1jammy [261 kB] 2026-02-17T05:24:34.615 INFO:teuthology.orchestra.run.trial030.stdout:Get:65 https://1.chacra.ceph.com/r/ceph/wip-bharath18-testing-2026-02-13-0856/325850157d309f65985eea9ec9bb9f1d56726fee/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 20.3.0-5271-g32585015-1jammy [31.5 MB] 2026-02-17T05:24:39.602 INFO:teuthology.orchestra.run.trial030.stdout:Get:66 https://1.chacra.ceph.com/r/ceph/wip-bharath18-testing-2026-02-13-0856/325850157d309f65985eea9ec9bb9f1d56726fee/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 20.3.0-5271-g32585015-1jammy [4983 kB] 2026-02-17T05:24:40.041 INFO:teuthology.orchestra.run.trial030.stdout:Get:67 https://1.chacra.ceph.com/r/ceph/wip-bharath18-testing-2026-02-13-0856/325850157d309f65985eea9ec9bb9f1d56726fee/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 20.3.0-5271-g32585015-1jammy [293 kB] 2026-02-17T05:24:40.064 INFO:teuthology.orchestra.run.trial030.stdout:Get:68 https://1.chacra.ceph.com/r/ceph/wip-bharath18-testing-2026-02-13-0856/325850157d309f65985eea9ec9bb9f1d56726fee/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 20.3.0-5271-g32585015-1jammy [127 kB] 2026-02-17T05:24:40.077 INFO:teuthology.orchestra.run.trial030.stdout:Get:69 https://1.chacra.ceph.com/r/ceph/wip-bharath18-testing-2026-02-13-0856/325850157d309f65985eea9ec9bb9f1d56726fee/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 20.3.0-5271-g32585015-1jammy [922 kB] 2026-02-17T05:24:40.159 INFO:teuthology.orchestra.run.trial030.stdout:Get:70 https://1.chacra.ceph.com/r/ceph/wip-bharath18-testing-2026-02-13-0856/325850157d309f65985eea9ec9bb9f1d56726fee/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 20.3.0-5271-g32585015-1jammy [7537 kB] 2026-02-17T05:24:40.860 INFO:teuthology.orchestra.run.trial030.stdout:Get:71 https://1.chacra.ceph.com/r/ceph/wip-bharath18-testing-2026-02-13-0856/325850157d309f65985eea9ec9bb9f1d56726fee/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd-classic amd64 20.3.0-5271-g32585015-1jammy [468 MB] 2026-02-17T05:25:19.402 INFO:teuthology.orchestra.run.trial030.stdout:Get:72 https://1.chacra.ceph.com/r/ceph/wip-bharath18-testing-2026-02-13-0856/325850157d309f65985eea9ec9bb9f1d56726fee/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 20.3.0-5271-g32585015-1jammy [180 kB] 2026-02-17T05:25:19.410 INFO:teuthology.orchestra.run.trial030.stdout:Get:73 https://1.chacra.ceph.com/r/ceph/wip-bharath18-testing-2026-02-13-0856/325850157d309f65985eea9ec9bb9f1d56726fee/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 20.3.0-5271-g32585015-1jammy [14.1 kB] 2026-02-17T05:25:19.412 INFO:teuthology.orchestra.run.trial030.stdout:Get:74 https://1.chacra.ceph.com/r/ceph/wip-bharath18-testing-2026-02-13-0856/325850157d309f65985eea9ec9bb9f1d56726fee/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 20.3.0-5271-g32585015-1jammy [1030 kB] 2026-02-17T05:25:19.488 INFO:teuthology.orchestra.run.trial030.stdout:Get:75 https://1.chacra.ceph.com/r/ceph/wip-bharath18-testing-2026-02-13-0856/325850157d309f65985eea9ec9bb9f1d56726fee/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 20.3.0-5271-g32585015-1jammy [2437 kB] 2026-02-17T05:25:19.656 INFO:teuthology.orchestra.run.trial030.stdout:Get:76 https://1.chacra.ceph.com/r/ceph/wip-bharath18-testing-2026-02-13-0856/325850157d309f65985eea9ec9bb9f1d56726fee/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 20.3.0-5271-g32585015-1jammy [1069 kB] 2026-02-17T05:25:19.725 INFO:teuthology.orchestra.run.trial030.stdout:Get:77 https://1.chacra.ceph.com/r/ceph/wip-bharath18-testing-2026-02-13-0856/325850157d309f65985eea9ec9bb9f1d56726fee/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 20.3.0-5271-g32585015-1jammy [190 kB] 2026-02-17T05:25:19.738 INFO:teuthology.orchestra.run.trial030.stdout:Get:78 https://1.chacra.ceph.com/r/ceph/wip-bharath18-testing-2026-02-13-0856/325850157d309f65985eea9ec9bb9f1d56726fee/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 20.3.0-5271-g32585015-1jammy [54.7 MB] 2026-02-17T05:25:23.800 INFO:teuthology.orchestra.run.trial030.stdout:Get:79 https://1.chacra.ceph.com/r/ceph/wip-bharath18-testing-2026-02-13-0856/325850157d309f65985eea9ec9bb9f1d56726fee/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 20.3.0-5271-g32585015-1jammy [8626 kB] 2026-02-17T05:25:24.575 INFO:teuthology.orchestra.run.trial030.stdout:Get:80 https://1.chacra.ceph.com/r/ceph/wip-bharath18-testing-2026-02-13-0856/325850157d309f65985eea9ec9bb9f1d56726fee/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 20.3.0-5271-g32585015-1jammy [14.2 kB] 2026-02-17T05:25:24.575 INFO:teuthology.orchestra.run.trial030.stdout:Get:81 https://1.chacra.ceph.com/r/ceph/wip-bharath18-testing-2026-02-13-0856/325850157d309f65985eea9ec9bb9f1d56726fee/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 20.3.0-5271-g32585015-1jammy [68.6 MB] 2026-02-17T05:25:27.600 INFO:teuthology.orchestra.run.trial030.stdout:Get:82 https://1.chacra.ceph.com/r/ceph/wip-bharath18-testing-2026-02-13-0856/325850157d309f65985eea9ec9bb9f1d56726fee/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 20.3.0-5271-g32585015-1jammy [136 kB] 2026-02-17T05:25:27.601 INFO:teuthology.orchestra.run.trial030.stdout:Get:83 https://1.chacra.ceph.com/r/ceph/wip-bharath18-testing-2026-02-13-0856/325850157d309f65985eea9ec9bb9f1d56726fee/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-daemon amd64 20.3.0-5271-g32585015-1jammy [45.1 kB] 2026-02-17T05:25:27.601 INFO:teuthology.orchestra.run.trial030.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/wip-bharath18-testing-2026-02-13-0856/325850157d309f65985eea9ec9bb9f1d56726fee/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-proxy2 amd64 20.3.0-5271-g32585015-1jammy [31.7 kB] 2026-02-17T05:25:27.602 INFO:teuthology.orchestra.run.trial030.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/wip-bharath18-testing-2026-02-13-0856/325850157d309f65985eea9ec9bb9f1d56726fee/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 20.3.0-5271-g32585015-1jammy [44.2 kB] 2026-02-17T05:25:27.603 INFO:teuthology.orchestra.run.trial030.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-bharath18-testing-2026-02-13-0856/325850157d309f65985eea9ec9bb9f1d56726fee/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 20.3.0-5271-g32585015-1jammy [18.3 MB] 2026-02-17T05:25:28.030 INFO:teuthology.orchestra.run.trial030.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/wip-bharath18-testing-2026-02-13-0856/325850157d309f65985eea9ec9bb9f1d56726fee/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 20.3.0-5271-g32585015-1jammy [93.7 kB] 2026-02-17T05:25:28.314 INFO:teuthology.orchestra.run.trial030.stdout:Fetched 702 MB in 1min 3s (11.1 MB/s) 2026-02-17T05:25:28.331 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2026-02-17T05:25:28.490 INFO:teuthology.orchestra.run.trial030.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 167438 files and directories currently installed.) 2026-02-17T05:25:28.492 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../00-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2026-02-17T05:25:28.493 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-17T05:25:28.514 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2026-02-17T05:25:28.527 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../01-libdouble-conversion3_3.1.7-4_amd64.deb ... 2026-02-17T05:25:28.528 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-17T05:25:28.545 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2026-02-17T05:25:28.557 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../02-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2026-02-17T05:25:28.557 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-17T05:25:28.577 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package libqt5core5a:amd64. 2026-02-17T05:25:28.586 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../03-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-17T05:25:28.591 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T05:25:28.621 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2026-02-17T05:25:28.629 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../04-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-17T05:25:28.629 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T05:25:28.646 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package libqt5network5:amd64. 2026-02-17T05:25:28.654 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../05-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-17T05:25:28.654 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T05:25:28.674 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2026-02-17T05:25:28.682 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../06-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2026-02-17T05:25:28.683 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-17T05:25:28.699 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package librados2. 2026-02-17T05:25:28.707 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../07-librados2_20.3.0-5271-g32585015-1jammy_amd64.deb ... 2026-02-17T05:25:28.707 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking librados2 (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:28.750 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package libnbd0. 2026-02-17T05:25:28.758 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../08-libnbd0_1.10.5-1_amd64.deb ... 2026-02-17T05:25:28.758 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking libnbd0 (1.10.5-1) ... 2026-02-17T05:25:28.772 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package librbd1. 2026-02-17T05:25:28.781 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../09-librbd1_20.3.0-5271-g32585015-1jammy_amd64.deb ... 2026-02-17T05:25:28.781 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking librbd1 (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:28.819 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package libcephfs2. 2026-02-17T05:25:28.827 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../10-libcephfs2_20.3.0-5271-g32585015-1jammy_amd64.deb ... 2026-02-17T05:25:28.827 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking libcephfs2 (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:28.847 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-rados. 2026-02-17T05:25:28.855 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../11-python3-rados_20.3.0-5271-g32585015-1jammy_amd64.deb ... 2026-02-17T05:25:28.855 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-rados (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:28.872 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-ceph-argparse. 2026-02-17T05:25:28.880 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../12-python3-ceph-argparse_20.3.0-5271-g32585015-1jammy_all.deb ... 2026-02-17T05:25:28.880 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-ceph-argparse (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:28.895 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-cephfs. 2026-02-17T05:25:28.903 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../13-python3-cephfs_20.3.0-5271-g32585015-1jammy_amd64.deb ... 2026-02-17T05:25:28.903 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-cephfs (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:28.919 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-ceph-common. 2026-02-17T05:25:28.927 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../14-python3-ceph-common_20.3.0-5271-g32585015-1jammy_all.deb ... 2026-02-17T05:25:28.928 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-ceph-common (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:28.946 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-wcwidth. 2026-02-17T05:25:28.953 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../15-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2026-02-17T05:25:28.954 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-17T05:25:28.970 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-prettytable. 2026-02-17T05:25:28.978 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../16-python3-prettytable_2.5.0-2_all.deb ... 2026-02-17T05:25:28.978 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2026-02-17T05:25:28.993 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-rbd. 2026-02-17T05:25:29.000 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../17-python3-rbd_20.3.0-5271-g32585015-1jammy_amd64.deb ... 2026-02-17T05:25:29.001 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-rbd (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:29.017 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package librdkafka1:amd64. 2026-02-17T05:25:29.026 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../18-librdkafka1_1.8.0-1build1_amd64.deb ... 2026-02-17T05:25:29.026 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-17T05:25:29.044 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package librgw2. 2026-02-17T05:25:29.052 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../19-librgw2_20.3.0-5271-g32585015-1jammy_amd64.deb ... 2026-02-17T05:25:29.052 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking librgw2 (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:29.148 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-rgw. 2026-02-17T05:25:29.156 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../20-python3-rgw_20.3.0-5271-g32585015-1jammy_amd64.deb ... 2026-02-17T05:25:29.157 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-rgw (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:29.173 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package liboath0:amd64. 2026-02-17T05:25:29.180 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../21-liboath0_2.6.7-3ubuntu0.1_amd64.deb ... 2026-02-17T05:25:29.181 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-17T05:25:29.195 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package libradosstriper1. 2026-02-17T05:25:29.203 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../22-libradosstriper1_20.3.0-5271-g32585015-1jammy_amd64.deb ... 2026-02-17T05:25:29.203 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking libradosstriper1 (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:29.220 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package ceph-common. 2026-02-17T05:25:29.228 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../23-ceph-common_20.3.0-5271-g32585015-1jammy_amd64.deb ... 2026-02-17T05:25:29.228 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking ceph-common (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:29.486 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package ceph-base. 2026-02-17T05:25:29.494 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../24-ceph-base_20.3.0-5271-g32585015-1jammy_amd64.deb ... 2026-02-17T05:25:29.499 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking ceph-base (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:29.559 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-jaraco.functools. 2026-02-17T05:25:29.567 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../25-python3-jaraco.functools_3.4.0-2_all.deb ... 2026-02-17T05:25:29.567 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2026-02-17T05:25:29.582 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-cheroot. 2026-02-17T05:25:29.590 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../26-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2026-02-17T05:25:29.590 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-17T05:25:29.607 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-jaraco.classes. 2026-02-17T05:25:29.615 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../27-python3-jaraco.classes_3.2.1-3_all.deb ... 2026-02-17T05:25:29.616 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2026-02-17T05:25:29.630 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-jaraco.text. 2026-02-17T05:25:29.638 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../28-python3-jaraco.text_3.6.0-2_all.deb ... 2026-02-17T05:25:29.639 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2026-02-17T05:25:29.653 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-jaraco.collections. 2026-02-17T05:25:29.661 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../29-python3-jaraco.collections_3.4.0-2_all.deb ... 2026-02-17T05:25:29.661 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2026-02-17T05:25:29.675 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-tempora. 2026-02-17T05:25:29.683 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../30-python3-tempora_4.1.2-1_all.deb ... 2026-02-17T05:25:29.683 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-tempora (4.1.2-1) ... 2026-02-17T05:25:29.697 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-portend. 2026-02-17T05:25:29.706 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../31-python3-portend_3.0.0-1_all.deb ... 2026-02-17T05:25:29.706 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-portend (3.0.0-1) ... 2026-02-17T05:25:29.719 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-zc.lockfile. 2026-02-17T05:25:29.727 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../32-python3-zc.lockfile_2.0-1_all.deb ... 2026-02-17T05:25:29.728 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2026-02-17T05:25:29.743 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-cherrypy3. 2026-02-17T05:25:29.751 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../33-python3-cherrypy3_18.6.1-4_all.deb ... 2026-02-17T05:25:29.751 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2026-02-17T05:25:29.776 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-natsort. 2026-02-17T05:25:29.784 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../34-python3-natsort_8.0.2-1_all.deb ... 2026-02-17T05:25:29.784 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-natsort (8.0.2-1) ... 2026-02-17T05:25:29.799 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2026-02-17T05:25:29.808 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../35-ceph-mgr-modules-core_20.3.0-5271-g32585015-1jammy_all.deb ... 2026-02-17T05:25:29.808 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking ceph-mgr-modules-core (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:29.837 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2026-02-17T05:25:29.845 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../36-libsqlite3-mod-ceph_20.3.0-5271-g32585015-1jammy_amd64.deb ... 2026-02-17T05:25:29.845 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking libsqlite3-mod-ceph (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:29.861 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package ceph-mgr. 2026-02-17T05:25:29.869 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../37-ceph-mgr_20.3.0-5271-g32585015-1jammy_amd64.deb ... 2026-02-17T05:25:29.869 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking ceph-mgr (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:29.888 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package ceph-mon. 2026-02-17T05:25:29.896 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../38-ceph-mon_20.3.0-5271-g32585015-1jammy_amd64.deb ... 2026-02-17T05:25:29.897 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking ceph-mon (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:29.961 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package libfuse2:amd64. 2026-02-17T05:25:29.969 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../39-libfuse2_2.9.9-5ubuntu3_amd64.deb ... 2026-02-17T05:25:29.969 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-17T05:25:29.985 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package ceph-osd-classic. 2026-02-17T05:25:29.993 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../40-ceph-osd-classic_20.3.0-5271-g32585015-1jammy_amd64.deb ... 2026-02-17T05:25:29.993 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking ceph-osd-classic (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:33.966 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package ceph-osd. 2026-02-17T05:25:33.978 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../41-ceph-osd_20.3.0-5271-g32585015-1jammy_amd64.deb ... 2026-02-17T05:25:33.979 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking ceph-osd (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:33.998 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package ceph. 2026-02-17T05:25:34.009 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../42-ceph_20.3.0-5271-g32585015-1jammy_amd64.deb ... 2026-02-17T05:25:34.009 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking ceph (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:34.025 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package ceph-fuse. 2026-02-17T05:25:34.038 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../43-ceph-fuse_20.3.0-5271-g32585015-1jammy_amd64.deb ... 2026-02-17T05:25:34.038 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking ceph-fuse (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:34.065 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package ceph-mds. 2026-02-17T05:25:34.077 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../44-ceph-mds_20.3.0-5271-g32585015-1jammy_amd64.deb ... 2026-02-17T05:25:34.077 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking ceph-mds (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:34.109 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package cephadm. 2026-02-17T05:25:34.117 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../45-cephadm_20.3.0-5271-g32585015-1jammy_amd64.deb ... 2026-02-17T05:25:34.117 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking cephadm (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:34.133 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-asyncssh. 2026-02-17T05:25:34.141 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../46-python3-asyncssh_2.5.0-1ubuntu0.1_all.deb ... 2026-02-17T05:25:34.141 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-17T05:25:34.162 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2026-02-17T05:25:34.170 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../47-ceph-mgr-cephadm_20.3.0-5271-g32585015-1jammy_all.deb ... 2026-02-17T05:25:34.171 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking ceph-mgr-cephadm (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:34.192 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-repoze.lru. 2026-02-17T05:25:34.200 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../48-python3-repoze.lru_0.7-2_all.deb ... 2026-02-17T05:25:34.200 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2026-02-17T05:25:34.215 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-routes. 2026-02-17T05:25:34.223 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../49-python3-routes_2.5.1-1ubuntu1_all.deb ... 2026-02-17T05:25:34.224 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2026-02-17T05:25:34.244 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2026-02-17T05:25:34.252 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../50-ceph-mgr-dashboard_20.3.0-5271-g32585015-1jammy_all.deb ... 2026-02-17T05:25:34.252 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking ceph-mgr-dashboard (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:34.924 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2026-02-17T05:25:34.933 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../51-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2026-02-17T05:25:34.934 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-17T05:25:34.974 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-joblib. 2026-02-17T05:25:34.983 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../52-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2026-02-17T05:25:34.983 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2026-02-17T05:25:35.011 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-threadpoolctl. 2026-02-17T05:25:35.020 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../53-python3-threadpoolctl_3.1.0-1_all.deb ... 2026-02-17T05:25:35.020 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2026-02-17T05:25:35.035 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-sklearn. 2026-02-17T05:25:35.044 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../54-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2026-02-17T05:25:35.044 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-17T05:25:35.125 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2026-02-17T05:25:35.134 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../55-ceph-mgr-diskprediction-local_20.3.0-5271-g32585015-1jammy_all.deb ... 2026-02-17T05:25:35.135 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking ceph-mgr-diskprediction-local (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:35.292 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-cachetools. 2026-02-17T05:25:35.301 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../56-python3-cachetools_5.0.0-1_all.deb ... 2026-02-17T05:25:35.301 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2026-02-17T05:25:35.315 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-rsa. 2026-02-17T05:25:35.323 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../57-python3-rsa_4.8-1_all.deb ... 2026-02-17T05:25:35.324 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-rsa (4.8-1) ... 2026-02-17T05:25:35.341 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-google-auth. 2026-02-17T05:25:35.350 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../58-python3-google-auth_1.5.1-3_all.deb ... 2026-02-17T05:25:35.350 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2026-02-17T05:25:35.368 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-requests-oauthlib. 2026-02-17T05:25:35.376 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../59-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2026-02-17T05:25:35.377 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-17T05:25:35.392 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-websocket. 2026-02-17T05:25:35.401 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../60-python3-websocket_1.2.3-1_all.deb ... 2026-02-17T05:25:35.401 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-websocket (1.2.3-1) ... 2026-02-17T05:25:35.419 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-kubernetes. 2026-02-17T05:25:35.427 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../61-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2026-02-17T05:25:35.427 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-17T05:25:35.521 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2026-02-17T05:25:35.530 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../62-ceph-mgr-k8sevents_20.3.0-5271-g32585015-1jammy_all.deb ... 2026-02-17T05:25:35.531 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking ceph-mgr-k8sevents (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:35.545 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package libonig5:amd64. 2026-02-17T05:25:35.553 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../63-libonig5_6.9.7.1-2build1_amd64.deb ... 2026-02-17T05:25:35.554 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-17T05:25:35.570 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package libjq1:amd64. 2026-02-17T05:25:35.578 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../64-libjq1_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-17T05:25:35.579 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-17T05:25:35.594 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package jq. 2026-02-17T05:25:35.602 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../65-jq_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-17T05:25:35.602 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking jq (1.6-2.1ubuntu3.1) ... 2026-02-17T05:25:35.616 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package socat. 2026-02-17T05:25:35.625 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../66-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2026-02-17T05:25:35.625 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2026-02-17T05:25:35.644 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package xmlstarlet. 2026-02-17T05:25:35.653 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../67-xmlstarlet_1.6.1-2.1_amd64.deb ... 2026-02-17T05:25:35.653 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2026-02-17T05:25:35.690 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package ceph-test. 2026-02-17T05:25:35.698 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../68-ceph-test_20.3.0-5271-g32585015-1jammy_amd64.deb ... 2026-02-17T05:25:35.699 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking ceph-test (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:36.349 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package ceph-volume. 2026-02-17T05:25:36.358 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../69-ceph-volume_20.3.0-5271-g32585015-1jammy_all.deb ... 2026-02-17T05:25:36.359 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking ceph-volume (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:36.382 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package libcephfs-daemon. 2026-02-17T05:25:36.391 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../70-libcephfs-daemon_20.3.0-5271-g32585015-1jammy_amd64.deb ... 2026-02-17T05:25:36.391 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking libcephfs-daemon (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:36.405 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package libcephfs-proxy2. 2026-02-17T05:25:36.413 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../71-libcephfs-proxy2_20.3.0-5271-g32585015-1jammy_amd64.deb ... 2026-02-17T05:25:36.414 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking libcephfs-proxy2 (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:36.428 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package libcephfs-dev. 2026-02-17T05:25:36.436 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../72-libcephfs-dev_20.3.0-5271-g32585015-1jammy_amd64.deb ... 2026-02-17T05:25:36.437 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking libcephfs-dev (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:36.452 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package nvme-cli. 2026-02-17T05:25:36.460 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../73-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2026-02-17T05:25:36.461 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2026-02-17T05:25:36.492 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python-asyncssh-doc. 2026-02-17T05:25:36.500 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../74-python-asyncssh-doc_2.5.0-1ubuntu0.1_all.deb ... 2026-02-17T05:25:36.500 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-17T05:25:36.529 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-iniconfig. 2026-02-17T05:25:36.538 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../75-python3-iniconfig_1.1.1-2_all.deb ... 2026-02-17T05:25:36.538 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2026-02-17T05:25:36.553 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-pluggy. 2026-02-17T05:25:36.561 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../76-python3-pluggy_0.13.0-7.1_all.deb ... 2026-02-17T05:25:36.562 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2026-02-17T05:25:36.577 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-psutil. 2026-02-17T05:25:36.585 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../77-python3-psutil_5.9.0-1build1_amd64.deb ... 2026-02-17T05:25:36.586 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2026-02-17T05:25:36.604 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-py. 2026-02-17T05:25:36.612 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../78-python3-py_1.10.0-1_all.deb ... 2026-02-17T05:25:36.613 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-py (1.10.0-1) ... 2026-02-17T05:25:36.634 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-pygments. 2026-02-17T05:25:36.642 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../79-python3-pygments_2.11.2+dfsg-2ubuntu0.1_all.deb ... 2026-02-17T05:25:36.642 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-17T05:25:36.683 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-toml. 2026-02-17T05:25:36.692 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../80-python3-toml_0.10.2-1_all.deb ... 2026-02-17T05:25:36.692 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-toml (0.10.2-1) ... 2026-02-17T05:25:36.707 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-pytest. 2026-02-17T05:25:36.716 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../81-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2026-02-17T05:25:36.716 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2026-02-17T05:25:36.737 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-simplejson. 2026-02-17T05:25:36.745 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../82-python3-simplejson_3.17.6-1build1_amd64.deb ... 2026-02-17T05:25:36.746 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2026-02-17T05:25:36.770 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package python3-webob. 2026-02-17T05:25:36.778 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../83-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2026-02-17T05:25:36.779 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-17T05:25:36.795 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package qttranslations5-l10n. 2026-02-17T05:25:36.804 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../84-qttranslations5-l10n_5.15.3-1_all.deb ... 2026-02-17T05:25:36.804 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2026-02-17T05:25:36.875 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package radosgw. 2026-02-17T05:25:36.884 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../85-radosgw_20.3.0-5271-g32585015-1jammy_amd64.deb ... 2026-02-17T05:25:36.884 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking radosgw (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:37.043 INFO:teuthology.orchestra.run.trial030.stdout:Selecting previously unselected package rbd-fuse. 2026-02-17T05:25:37.052 INFO:teuthology.orchestra.run.trial030.stdout:Preparing to unpack .../86-rbd-fuse_20.3.0-5271-g32585015-1jammy_amd64.deb ... 2026-02-17T05:25:37.052 INFO:teuthology.orchestra.run.trial030.stdout:Unpacking rbd-fuse (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:37.081 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2026-02-17T05:25:37.148 INFO:teuthology.orchestra.run.trial030.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-17T05:25:37.149 INFO:teuthology.orchestra.run.trial030.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2026-02-17T05:25:37.220 INFO:teuthology.orchestra.run.trial030.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /lib/systemd/system/nvmefc-boot-connections.service. 2026-02-17T05:25:37.494 INFO:teuthology.orchestra.run.trial030.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service → /lib/systemd/system/nvmf-autoconnect.service. 2026-02-17T05:25:37.851 INFO:teuthology.orchestra.run.trial030.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2026-02-17T05:25:37.862 INFO:teuthology.orchestra.run.trial030.stdout:Setting up cephadm (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:37.905 INFO:teuthology.orchestra.run.trial030.stdout:Adding system user cephadm....done 2026-02-17T05:25:37.911 INFO:teuthology.orchestra.run.trial030.stdout:usermod: no changes 2026-02-17T05:25:37.917 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2026-02-17T05:25:37.991 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-17T05:25:37.992 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2026-02-17T05:25:38.063 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-repoze.lru (0.7-2) ... 2026-02-17T05:25:38.139 INFO:teuthology.orchestra.run.trial030.stdout:Setting up liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-17T05:25:38.140 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-py (1.10.0-1) ... 2026-02-17T05:25:38.237 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2026-02-17T05:25:38.363 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-cachetools (5.0.0-1) ... 2026-02-17T05:25:38.437 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2026-02-17T05:25:38.513 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-ceph-argparse (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:38.581 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-17T05:25:38.582 INFO:teuthology.orchestra.run.trial030.stdout:Setting up libnbd0 (1.10.5-1) ... 2026-02-17T05:25:38.583 INFO:teuthology.orchestra.run.trial030.stdout:Setting up libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-17T05:25:38.584 INFO:teuthology.orchestra.run.trial030.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-17T05:25:38.585 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2026-02-17T05:25:38.710 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-natsort (8.0.2-1) ... 2026-02-17T05:25:38.788 INFO:teuthology.orchestra.run.trial030.stdout:Setting up libcephfs-proxy2 (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:38.789 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2026-02-17T05:25:38.869 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2026-02-17T05:25:38.959 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-17T05:25:39.216 INFO:teuthology.orchestra.run.trial030.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2026-02-17T05:25:39.217 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-17T05:25:39.314 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-17T05:25:39.441 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-17T05:25:39.524 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2026-02-17T05:25:39.595 INFO:teuthology.orchestra.run.trial030.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2026-02-17T05:25:39.596 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-ceph-common (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:39.690 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-17T05:25:40.205 INFO:teuthology.orchestra.run.trial030.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T05:25:40.209 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-toml (0.10.2-1) ... 2026-02-17T05:25:40.290 INFO:teuthology.orchestra.run.trial030.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-17T05:25:40.291 INFO:teuthology.orchestra.run.trial030.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2026-02-17T05:25:40.292 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2026-02-17T05:25:40.365 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2026-02-17T05:25:40.438 INFO:teuthology.orchestra.run.trial030.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T05:25:40.439 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-rsa (4.8-1) ... 2026-02-17T05:25:40.520 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-tempora (4.1.2-1) ... 2026-02-17T05:25:40.594 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-prettytable (2.5.0-2) ... 2026-02-17T05:25:40.672 INFO:teuthology.orchestra.run.trial030.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-17T05:25:40.674 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-websocket (1.2.3-1) ... 2026-02-17T05:25:40.758 INFO:teuthology.orchestra.run.trial030.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-17T05:25:40.759 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-17T05:25:40.838 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-17T05:25:40.923 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2026-02-17T05:25:40.996 INFO:teuthology.orchestra.run.trial030.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-17T05:25:40.997 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2026-02-17T05:25:41.133 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-portend (3.0.0-1) ... 2026-02-17T05:25:41.207 INFO:teuthology.orchestra.run.trial030.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T05:25:41.208 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-google-auth (1.5.1-3) ... 2026-02-17T05:25:41.289 INFO:teuthology.orchestra.run.trial030.stdout:Setting up jq (1.6-2.1ubuntu3.1) ... 2026-02-17T05:25:41.290 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2026-02-17T05:25:41.423 INFO:teuthology.orchestra.run.trial030.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-17T05:25:41.424 INFO:teuthology.orchestra.run.trial030.stdout:Setting up librados2 (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:41.425 INFO:teuthology.orchestra.run.trial030.stdout:Setting up librgw2 (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:41.426 INFO:teuthology.orchestra.run.trial030.stdout:Setting up libsqlite3-mod-ceph (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:41.427 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-17T05:25:41.968 INFO:teuthology.orchestra.run.trial030.stdout:Setting up libcephfs2 (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:41.969 INFO:teuthology.orchestra.run.trial030.stdout:Setting up libradosstriper1 (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:41.970 INFO:teuthology.orchestra.run.trial030.stdout:Setting up librbd1 (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:41.971 INFO:teuthology.orchestra.run.trial030.stdout:Setting up ceph-mgr-modules-core (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:41.972 INFO:teuthology.orchestra.run.trial030.stdout:Setting up ceph-fuse (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:42.043 INFO:teuthology.orchestra.run.trial030.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-17T05:25:42.043 INFO:teuthology.orchestra.run.trial030.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-17T05:25:42.393 INFO:teuthology.orchestra.run.trial030.stdout:Setting up libcephfs-dev (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:42.394 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-rados (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:42.395 INFO:teuthology.orchestra.run.trial030.stdout:Setting up libcephfs-daemon (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:42.396 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-rbd (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:42.397 INFO:teuthology.orchestra.run.trial030.stdout:Setting up rbd-fuse (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:42.398 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-rgw (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:42.399 INFO:teuthology.orchestra.run.trial030.stdout:Setting up python3-cephfs (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:42.400 INFO:teuthology.orchestra.run.trial030.stdout:Setting up ceph-common (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:42.427 INFO:teuthology.orchestra.run.trial030.stdout:Adding group ceph....done 2026-02-17T05:25:42.461 INFO:teuthology.orchestra.run.trial030.stdout:Adding system user ceph....done 2026-02-17T05:25:42.470 INFO:teuthology.orchestra.run.trial030.stdout:Setting system user ceph properties....done 2026-02-17T05:25:42.476 INFO:teuthology.orchestra.run.trial030.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2026-02-17T05:25:42.565 INFO:teuthology.orchestra.run.trial030.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /lib/systemd/system/ceph.target. 2026-02-17T05:25:42.826 INFO:teuthology.orchestra.run.trial030.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service → /lib/systemd/system/rbdmap.service. 2026-02-17T05:25:43.169 INFO:teuthology.orchestra.run.trial030.stdout:Setting up ceph-test (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:43.170 INFO:teuthology.orchestra.run.trial030.stdout:Setting up radosgw (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:43.414 INFO:teuthology.orchestra.run.trial030.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-17T05:25:43.414 INFO:teuthology.orchestra.run.trial030.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-17T05:25:43.765 INFO:teuthology.orchestra.run.trial030.stdout:Setting up ceph-base (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:43.881 INFO:teuthology.orchestra.run.trial030.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /lib/systemd/system/ceph-crash.service. 2026-02-17T05:25:44.234 INFO:teuthology.orchestra.run.trial030.stdout:Setting up ceph-mds (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:44.293 INFO:teuthology.orchestra.run.trial030.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-17T05:25:44.294 INFO:teuthology.orchestra.run.trial030.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-17T05:25:44.653 INFO:teuthology.orchestra.run.trial030.stdout:Setting up ceph-mgr (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:44.720 INFO:teuthology.orchestra.run.trial030.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-17T05:25:44.721 INFO:teuthology.orchestra.run.trial030.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-17T05:25:45.076 INFO:teuthology.orchestra.run.trial030.stdout:Setting up ceph-mgr-k8sevents (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:45.077 INFO:teuthology.orchestra.run.trial030.stdout:Setting up ceph-osd-classic (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:45.095 INFO:teuthology.orchestra.run.trial030.stdout:update-alternatives: using /usr/bin/ceph-osd-classic to provide /usr/bin/ceph-osd (ceph-osd) in auto mode 2026-02-17T05:25:45.104 INFO:teuthology.orchestra.run.trial030.stdout:Setting up ceph-mgr-diskprediction-local (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:45.114 INFO:teuthology.orchestra.run.trial030.stdout:Setting up ceph-mon (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:45.188 INFO:teuthology.orchestra.run.trial030.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-17T05:25:45.188 INFO:teuthology.orchestra.run.trial030.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-17T05:25:45.525 INFO:teuthology.orchestra.run.trial030.stdout:Setting up ceph-mgr-cephadm (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:45.537 INFO:teuthology.orchestra.run.trial030.stdout:Setting up ceph-mgr-dashboard (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:45.549 INFO:teuthology.orchestra.run.trial030.stdout:Setting up ceph-osd (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:45.632 INFO:teuthology.orchestra.run.trial030.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-17T05:25:45.633 INFO:teuthology.orchestra.run.trial030.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-17T05:25:45.993 INFO:teuthology.orchestra.run.trial030.stdout:Setting up ceph (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:45.994 INFO:teuthology.orchestra.run.trial030.stdout:Setting up ceph-volume (20.3.0-5271-g32585015-1jammy) ... 2026-02-17T05:25:46.103 INFO:teuthology.orchestra.run.trial030.stdout:Processing triggers for man-db (2.10.2-1) ... 2026-02-17T05:25:46.190 INFO:teuthology.orchestra.run.trial030.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.11) ... 2026-02-17T05:25:46.893 INFO:teuthology.orchestra.run.trial030.stdout: 2026-02-17T05:25:46.893 INFO:teuthology.orchestra.run.trial030.stdout:Running kernel seems to be up-to-date. 2026-02-17T05:25:46.894 INFO:teuthology.orchestra.run.trial030.stdout: 2026-02-17T05:25:46.894 INFO:teuthology.orchestra.run.trial030.stdout:The processor microcode seems to be up-to-date. 2026-02-17T05:25:46.894 INFO:teuthology.orchestra.run.trial030.stdout: 2026-02-17T05:25:46.894 INFO:teuthology.orchestra.run.trial030.stdout:No services need to be restarted. 2026-02-17T05:25:46.894 INFO:teuthology.orchestra.run.trial030.stdout: 2026-02-17T05:25:46.894 INFO:teuthology.orchestra.run.trial030.stdout:No containers need to be restarted. 2026-02-17T05:25:46.894 INFO:teuthology.orchestra.run.trial030.stdout: 2026-02-17T05:25:46.894 INFO:teuthology.orchestra.run.trial030.stdout:No user sessions are running outdated binaries. 2026-02-17T05:25:46.894 INFO:teuthology.orchestra.run.trial030.stdout: 2026-02-17T05:25:46.894 INFO:teuthology.orchestra.run.trial030.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-17T05:25:47.539 INFO:teuthology.orchestra.run.trial030.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2026-02-17T05:25:47.546 DEBUG:teuthology.parallel:result is None 2026-02-17T05:25:47.546 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=325850157d309f65985eea9ec9bb9f1d56726fee 2026-02-17T05:25:47.685 DEBUG:teuthology.orchestra.run.trial030:> dpkg-query -W -f '${Version}' ceph 2026-02-17T05:25:47.694 INFO:teuthology.orchestra.run.trial030.stdout:20.3.0-5271-g32585015-1jammy 2026-02-17T05:25:47.694 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5271-g32585015-1jammy 2026-02-17T05:25:47.695 INFO:teuthology.task.install:The correct ceph version 20.3.0-5271-g32585015-1jammy is installed. 2026-02-17T05:25:47.697 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-17T05:25:47.697 DEBUG:teuthology.orchestra.run.trial030:> set -ex 2026-02-17T05:25:47.697 DEBUG:teuthology.orchestra.run.trial030:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-17T05:25:47.746 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-17T05:25:47.746 DEBUG:teuthology.orchestra.run.trial030:> set -ex 2026-02-17T05:25:47.746 DEBUG:teuthology.orchestra.run.trial030:> sudo dd of=/usr/bin/daemon-helper 2026-02-17T05:25:47.797 DEBUG:teuthology.orchestra.run.trial030:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-17T05:25:47.845 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-17T05:25:47.846 DEBUG:teuthology.orchestra.run.trial030:> set -ex 2026-02-17T05:25:47.846 DEBUG:teuthology.orchestra.run.trial030:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-17T05:25:47.895 DEBUG:teuthology.orchestra.run.trial030:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-17T05:25:47.946 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-17T05:25:47.946 DEBUG:teuthology.orchestra.run.trial030:> set -ex 2026-02-17T05:25:47.946 DEBUG:teuthology.orchestra.run.trial030:> sudo dd of=/usr/bin/stdin-killer 2026-02-17T05:25:47.994 DEBUG:teuthology.orchestra.run.trial030:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-17T05:25:48.046 INFO:teuthology.run_tasks:Running task workunit... 2026-02-17T05:25:48.073 INFO:tasks.workunit:Pulling workunits from ref 325850157d309f65985eea9ec9bb9f1d56726fee 2026-02-17T05:25:48.073 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-17T05:25:48.073 INFO:tasks.workunit:timeout=3h 2026-02-17T05:25:48.074 INFO:tasks.workunit:cleanup=True 2026-02-17T05:25:48.074 DEBUG:teuthology.orchestra.run.trial030:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-17T05:25:48.089 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T05:25:48.090 INFO:teuthology.orchestra.run.trial030.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2026-02-17T05:25:48.090 DEBUG:teuthology.orchestra.run.trial030:> mkdir -- /home/ubuntu/cephtest/mnt.0 2026-02-17T05:25:48.137 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2026-02-17T05:25:48.138 DEBUG:teuthology.orchestra.run.trial030:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2026-02-17T05:25:48.181 DEBUG:teuthology.orchestra.run.trial030:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 325850157d309f65985eea9ec9bb9f1d56726fee 2026-02-17T05:25:48.233 INFO:tasks.workunit.client.0.trial030.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-17T05:26:09.589 INFO:tasks.workunit.client.0.trial030.stderr:Note: switching to '325850157d309f65985eea9ec9bb9f1d56726fee'. 2026-02-17T05:26:09.589 INFO:tasks.workunit.client.0.trial030.stderr: 2026-02-17T05:26:09.589 INFO:tasks.workunit.client.0.trial030.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-17T05:26:09.589 INFO:tasks.workunit.client.0.trial030.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-17T05:26:09.589 INFO:tasks.workunit.client.0.trial030.stderr:state without impacting any branches by switching back to a branch. 2026-02-17T05:26:09.590 INFO:tasks.workunit.client.0.trial030.stderr: 2026-02-17T05:26:09.590 INFO:tasks.workunit.client.0.trial030.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-17T05:26:09.590 INFO:tasks.workunit.client.0.trial030.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-17T05:26:09.590 INFO:tasks.workunit.client.0.trial030.stderr: 2026-02-17T05:26:09.590 INFO:tasks.workunit.client.0.trial030.stderr: git switch -c 2026-02-17T05:26:09.590 INFO:tasks.workunit.client.0.trial030.stderr: 2026-02-17T05:26:09.590 INFO:tasks.workunit.client.0.trial030.stderr:Or undo this operation with: 2026-02-17T05:26:09.590 INFO:tasks.workunit.client.0.trial030.stderr: 2026-02-17T05:26:09.590 INFO:tasks.workunit.client.0.trial030.stderr: git switch - 2026-02-17T05:26:09.590 INFO:tasks.workunit.client.0.trial030.stderr: 2026-02-17T05:26:09.590 INFO:tasks.workunit.client.0.trial030.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-17T05:26:09.591 INFO:tasks.workunit.client.0.trial030.stderr: 2026-02-17T05:26:09.591 INFO:tasks.workunit.client.0.trial030.stderr:HEAD is now at 325850157d3 Merge branch 'issue73891' of https://github.com/bill-scales/ceph into wip-bharath18-testing-2026-02-13-0856 2026-02-17T05:26:09.598 DEBUG:teuthology.orchestra.run.trial030:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/standalone && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-17T05:26:09.647 DEBUG:teuthology.orchestra.run.trial030:> set -ex 2026-02-17T05:26:09.648 DEBUG:teuthology.orchestra.run.trial030:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-17T05:26:09.694 INFO:tasks.workunit:Running workunits matching osd on client.0... 2026-02-17T05:26:09.695 INFO:tasks.workunit:Running workunit osd/bad-inc-map.sh... 2026-02-17T05:26:09.695 DEBUG:teuthology.orchestra.run.trial030:workunit test osd/bad-inc-map.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=325850157d309f65985eea9ec9bb9f1d56726fee TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh 2026-02-17T05:26:09.748 INFO:tasks.workunit.client.0.trial030.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-17T05:26:09.765 INFO:tasks.workunit.client.0.trial030.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-17T05:26:09.765 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-17T05:26:09.765 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-17T05:26:09.765 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PYTHONWARNINGS=ignore 2026-02-17T05:26:09.765 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PYTHONWARNINGS=ignore 2026-02-17T05:26:09.765 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export CEPH_CONF=/dev/null 2026-02-17T05:26:09.765 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: CEPH_CONF=/dev/null 2026-02-17T05:26:09.765 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: unset CEPH_ARGS 2026-02-17T05:26:09.766 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2398: main: local code 2026-02-17T05:26:09.766 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: run td/bad-inc-map 2026-02-17T05:26:09.766 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:8: run: local dir=td/bad-inc-map 2026-02-17T05:26:09.766 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:9: run: shift 2026-02-17T05:26:09.766 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:11: run: export CEPH_MON=127.0.0.1:45333 2026-02-17T05:26:09.766 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:11: run: CEPH_MON=127.0.0.1:45333 2026-02-17T05:26:09.766 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:12: run: export CEPH_ARGS 2026-02-17T05:26:09.766 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:13: run: uuidgen 2026-02-17T05:26:09.767 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:13: run: CEPH_ARGS+='--fsid=4edac875-552e-4558-b6ec-6d56f966cd01 --auth-supported=none ' 2026-02-17T05:26:09.767 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:14: run: CEPH_ARGS+='--mon-host=127.0.0.1:45333 ' 2026-02-17T05:26:09.767 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:15: run: set -e 2026-02-17T05:26:09.767 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:17: run: set 2026-02-17T05:26:09.767 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:17: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-17T05:26:09.769 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:17: run: local funcs=TEST_bad_inc_map 2026-02-17T05:26:09.769 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:18: run: for func in $funcs 2026-02-17T05:26:09.769 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:19: run: setup td/bad-inc-map 2026-02-17T05:26:09.769 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/bad-inc-map 2026-02-17T05:26:09.769 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/bad-inc-map 2026-02-17T05:26:09.769 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/bad-inc-map 2026-02-17T05:26:09.769 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T05:26:09.769 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/bad-inc-map KILL 2026-02-17T05:26:09.769 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:26:09.769 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:26:09.769 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:26:09.770 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:26:09.770 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:26:09.770 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:26:09.771 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T05:26:09.772 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T05:26:09.772 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T05:26:09.773 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T05:26:09.773 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T05:26:09.773 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T05:26:09.774 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:26:09.774 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T05:26:09.774 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T05:26:09.775 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:26:09.775 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T05:26:09.777 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T05:26:09.777 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/bad-inc-map 2026-02-17T05:26:09.778 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T05:26:09.779 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:26:09.779 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.11416 2026-02-17T05:26:09.779 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.11416 2026-02-17T05:26:09.780 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T05:26:09.780 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T05:26:09.780 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/bad-inc-map 2026-02-17T05:26:09.782 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T05:26:09.782 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:26:09.782 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.11416 2026-02-17T05:26:09.782 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.11416 2026-02-17T05:26:09.783 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T05:26:09.785 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-17T05:26:09.785 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-17T05:26:09.785 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T05:26:09.785 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/bad-inc-map 1' TERM HUP INT 2026-02-17T05:26:09.785 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:20: run: TEST_bad_inc_map td/bad-inc-map 2026-02-17T05:26:09.785 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:26: TEST_bad_inc_map: local dir=td/bad-inc-map 2026-02-17T05:26:09.785 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:28: TEST_bad_inc_map: run_mon td/bad-inc-map a 2026-02-17T05:26:09.785 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/bad-inc-map 2026-02-17T05:26:09.785 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T05:26:09.785 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T05:26:09.786 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T05:26:09.786 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/bad-inc-map/a 2026-02-17T05:26:09.786 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/bad-inc-map/a --run-dir=td/bad-inc-map 2026-02-17T05:26:09.820 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T05:26:09.820 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:26:09.820 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:26:09.820 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:26:09.820 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:26:09.820 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.11416 2026-02-17T05:26:09.820 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.11416/$cluster-$name.asok' 2026-02-17T05:26:09.821 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/bad-inc-map/a '--log-file=td/bad-inc-map/$name.log' '--admin-socket=/tmp/ceph-asok.11416/$cluster-$name.asok' --mon-cluster-log-file=td/bad-inc-map/log --run-dir=td/bad-inc-map '--pid-file=td/bad-inc-map/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T05:26:09.850 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T05:26:09.851 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T05:26:09.851 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T05:26:09.851 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T05:26:09.851 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T05:26:09.853 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T05:26:09.853 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T05:26:09.853 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T05:26:09.853 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T05:26:09.853 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T05:26:09.853 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:26:09.853 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.11416 2026-02-17T05:26:09.854 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.11416/ceph-mon.a.asok 2026-02-17T05:26:09.854 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T05:26:09.854 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.11416/ceph-mon.a.asok config get fsid 2026-02-17T05:26:09.909 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T05:26:09.910 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T05:26:09.910 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T05:26:09.910 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T05:26:09.910 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T05:26:09.910 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T05:26:09.910 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T05:26:09.910 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T05:26:09.911 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T05:26:09.911 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:26:09.911 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.11416 2026-02-17T05:26:09.911 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.11416/ceph-mon.a.asok 2026-02-17T05:26:09.912 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T05:26:09.912 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.11416/ceph-mon.a.asok config get mon_host 2026-02-17T05:26:09.966 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:29: TEST_bad_inc_map: run_mgr td/bad-inc-map x 2026-02-17T05:26:09.966 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/bad-inc-map 2026-02-17T05:26:09.966 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T05:26:09.966 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T05:26:09.967 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T05:26:09.967 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/bad-inc-map/x 2026-02-17T05:26:09.967 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T05:26:10.080 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T05:26:10.080 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:26:10.081 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:26:10.081 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:26:10.081 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:26:10.081 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.11416 2026-02-17T05:26:10.081 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.11416/$cluster-$name.asok' 2026-02-17T05:26:10.081 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T05:26:10.082 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/bad-inc-map/x '--log-file=td/bad-inc-map/$name.log' '--admin-socket=/tmp/ceph-asok.11416/$cluster-$name.asok' --run-dir=td/bad-inc-map '--pid-file=td/bad-inc-map/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T05:26:10.102 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:30: TEST_bad_inc_map: run_osd td/bad-inc-map 0 2026-02-17T05:26:10.103 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/bad-inc-map 2026-02-17T05:26:10.103 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T05:26:10.103 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T05:26:10.103 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T05:26:10.103 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/bad-inc-map/0 2026-02-17T05:26:10.103 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=4edac875-552e-4558-b6ec-6d56f966cd01 --auth-supported=none --mon-host=127.0.0.1:45333 ' 2026-02-17T05:26:10.103 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:26:10.103 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:26:10.104 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:26:10.104 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/bad-inc-map/0' 2026-02-17T05:26:10.104 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/bad-inc-map/0/journal' 2026-02-17T05:26:10.104 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T05:26:10.104 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T05:26:10.104 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/bad-inc-map' 2026-02-17T05:26:10.104 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T05:26:10.104 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:26:10.104 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:26:10.104 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:26:10.104 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:26:10.104 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.11416 2026-02-17T05:26:10.105 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.11416/$cluster-$name.asok' 2026-02-17T05:26:10.105 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.11416/$cluster-$name.asok' 2026-02-17T05:26:10.105 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:26:10.105 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T05:26:10.105 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T05:26:10.105 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/bad-inc-map/$name.log' 2026-02-17T05:26:10.105 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/bad-inc-map/$name.pid' 2026-02-17T05:26:10.105 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:26:10.105 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:26:10.105 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:26:10.105 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:26:10.105 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T05:26:10.106 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T05:26:10.106 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/bad-inc-map/0 2026-02-17T05:26:10.106 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T05:26:10.107 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=d278c5cf-1dca-4703-b568-903aa7aad2c5 2026-02-17T05:26:10.107 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 d278c5cf-1dca-4703-b568-903aa7aad2c5' 2026-02-17T05:26:10.107 INFO:tasks.workunit.client.0.trial030.stdout:add osd0 d278c5cf-1dca-4703-b568-903aa7aad2c5 2026-02-17T05:26:10.107 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T05:26:10.115 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDy+5Npx3LPBhAAxO0qp20ANA6ibODzj21b8w== 2026-02-17T05:26:10.115 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDy+5Npx3LPBhAAxO0qp20ANA6ibODzj21b8w=="}' 2026-02-17T05:26:10.115 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new d278c5cf-1dca-4703-b568-903aa7aad2c5 -i td/bad-inc-map/0/new.json 2026-02-17T05:26:10.227 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:26:10.236 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/bad-inc-map/0/new.json 2026-02-17T05:26:10.237 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=4edac875-552e-4558-b6ec-6d56f966cd01 --auth-supported=none --mon-host=127.0.0.1:45333 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/0 --osd-journal=td/bad-inc-map/0/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.11416/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDy+5Npx3LPBhAAxO0qp20ANA6ibODzj21b8w== --osd-uuid d278c5cf-1dca-4703-b568-903aa7aad2c5 2026-02-17T05:26:10.252 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:10.246+0000 7efe97355a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:26:10.254 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:10.250+0000 7efe97355a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:26:10.255 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:10.250+0000 7efe97355a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:26:10.256 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:10.250+0000 7efe97355a40 -1 bdev(0x555819466400 td/bad-inc-map/0/block) open stat got: (1) Operation not permitted 2026-02-17T05:26:10.256 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:10.250+0000 7efe97355a40 -1 bluestore(td/bad-inc-map/0) _read_fsid unparsable uuid 2026-02-17T05:26:10.971 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/bad-inc-map/0/keyring 2026-02-17T05:26:10.971 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T05:26:10.972 INFO:tasks.workunit.client.0.trial030.stdout:adding osd0 key to auth repository 2026-02-17T05:26:10.972 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T05:26:10.972 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/bad-inc-map/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T05:26:11.097 INFO:tasks.workunit.client.0.trial030.stdout:start osd.0 2026-02-17T05:26:11.098 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T05:26:11.098 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=4edac875-552e-4558-b6ec-6d56f966cd01 --auth-supported=none --mon-host=127.0.0.1:45333 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/0 --osd-journal=td/bad-inc-map/0/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.11416/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T05:26:11.098 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T05:26:11.098 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T05:26:11.098 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T05:26:11.121 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:11.114+0000 7f506b68ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:26:11.123 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:11.118+0000 7f506b68ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:26:11.125 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:11.118+0000 7f506b68ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:26:11.207 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T05:26:11.208 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:26:11.208 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T05:26:11.208 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:26:11.208 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:26:11.208 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:26:11.208 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:26:11.209 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:26:11.209 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:26:11.209 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T05:26:11.315 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:26:11.660 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:11.654+0000 7f506b68ea40 -1 Falling back to public interface 2026-02-17T05:26:12.317 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:26:12.317 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:26:12.317 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T05:26:12.318 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-17T05:26:12.318 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:26:12.318 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T05:26:12.425 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:26:12.766 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:12.762+0000 7f506b68ea40 -1 osd.0 0 log_to_monitors true 2026-02-17T05:26:13.427 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:26:13.427 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:26:13.428 INFO:tasks.workunit.client.0.trial030.stdout:2 2026-02-17T05:26:13.428 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T05:26:13.428 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:26:13.428 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T05:26:13.645 INFO:tasks.workunit.client.0.trial030.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2138752730,v1:127.0.0.1:6801/2138752730] [v2:127.0.0.1:6802/2138752730,v1:127.0.0.1:6803/2138752730] exists,up d278c5cf-1dca-4703-b568-903aa7aad2c5 2026-02-17T05:26:13.649 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:26:13.649 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:26:13.650 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:26:13.650 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:31: TEST_bad_inc_map: run_osd td/bad-inc-map 1 2026-02-17T05:26:13.650 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/bad-inc-map 2026-02-17T05:26:13.650 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T05:26:13.650 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-17T05:26:13.650 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T05:26:13.650 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/bad-inc-map/1 2026-02-17T05:26:13.650 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=4edac875-552e-4558-b6ec-6d56f966cd01 --auth-supported=none --mon-host=127.0.0.1:45333 ' 2026-02-17T05:26:13.650 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:26:13.650 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:26:13.650 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:26:13.651 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/bad-inc-map/1' 2026-02-17T05:26:13.651 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/bad-inc-map/1/journal' 2026-02-17T05:26:13.651 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T05:26:13.651 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T05:26:13.651 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/bad-inc-map' 2026-02-17T05:26:13.651 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T05:26:13.651 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:26:13.651 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:26:13.651 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:26:13.651 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:26:13.651 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.11416 2026-02-17T05:26:13.651 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.11416/$cluster-$name.asok' 2026-02-17T05:26:13.651 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.11416/$cluster-$name.asok' 2026-02-17T05:26:13.652 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:26:13.652 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T05:26:13.652 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T05:26:13.652 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/bad-inc-map/$name.log' 2026-02-17T05:26:13.652 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/bad-inc-map/$name.pid' 2026-02-17T05:26:13.652 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:26:13.652 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:26:13.652 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:26:13.652 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:26:13.652 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T05:26:13.652 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T05:26:13.652 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/bad-inc-map/1 2026-02-17T05:26:13.653 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T05:26:13.653 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=a4a08f60-706a-4c29-a60a-28c4622f28d9 2026-02-17T05:26:13.653 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 a4a08f60-706a-4c29-a60a-28c4622f28d9' 2026-02-17T05:26:13.653 INFO:tasks.workunit.client.0.trial030.stdout:add osd1 a4a08f60-706a-4c29-a60a-28c4622f28d9 2026-02-17T05:26:13.653 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T05:26:13.661 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQD1+5NpoU1XJxAAa/Zozwi1IOp+v7HxcuQofQ== 2026-02-17T05:26:13.661 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQD1+5NpoU1XJxAAa/Zozwi1IOp+v7HxcuQofQ=="}' 2026-02-17T05:26:13.661 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new a4a08f60-706a-4c29-a60a-28c4622f28d9 -i td/bad-inc-map/1/new.json 2026-02-17T05:26:13.884 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-17T05:26:13.893 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/bad-inc-map/1/new.json 2026-02-17T05:26:13.894 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=4edac875-552e-4558-b6ec-6d56f966cd01 --auth-supported=none --mon-host=127.0.0.1:45333 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/1 --osd-journal=td/bad-inc-map/1/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.11416/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQD1+5NpoU1XJxAAa/Zozwi1IOp+v7HxcuQofQ== --osd-uuid a4a08f60-706a-4c29-a60a-28c4622f28d9 2026-02-17T05:26:13.910 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:13.902+0000 7f4b11be0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:26:13.911 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:13.906+0000 7f4b11be0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:26:13.912 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:13.906+0000 7f4b11be0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:26:13.913 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:13.906+0000 7f4b11be0a40 -1 bdev(0x559ce2dc8400 td/bad-inc-map/1/block) open stat got: (1) Operation not permitted 2026-02-17T05:26:13.913 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:13.906+0000 7f4b11be0a40 -1 bluestore(td/bad-inc-map/1) _read_fsid unparsable uuid 2026-02-17T05:26:14.546 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/bad-inc-map/1/keyring 2026-02-17T05:26:14.546 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T05:26:14.547 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-17T05:26:14.547 INFO:tasks.workunit.client.0.trial030.stdout:adding osd1 key to auth repository 2026-02-17T05:26:14.547 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/bad-inc-map/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T05:26:14.851 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-17T05:26:14.852 INFO:tasks.workunit.client.0.trial030.stdout:start osd.1 2026-02-17T05:26:14.852 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=4edac875-552e-4558-b6ec-6d56f966cd01 --auth-supported=none --mon-host=127.0.0.1:45333 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/1 --osd-journal=td/bad-inc-map/1/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.11416/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T05:26:14.853 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T05:26:14.853 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T05:26:14.853 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T05:26:14.873 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:14.866+0000 7fe063518a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:26:14.874 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:14.870+0000 7fe063518a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:26:14.875 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:14.870+0000 7fe063518a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:26:15.062 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-17T05:26:15.063 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:26:15.063 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T05:26:15.063 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:26:15.063 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:26:15.063 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:26:15.063 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:26:15.063 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:26:15.063 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:26:15.063 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T05:26:15.236 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:15.230+0000 7fe063518a40 -1 Falling back to public interface 2026-02-17T05:26:15.273 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:26:15.859 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:15.854+0000 7fe063518a40 -1 osd.1 0 log_to_monitors true 2026-02-17T05:26:16.275 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:26:16.275 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:26:16.275 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-17T05:26:16.276 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T05:26:16.276 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:26:16.276 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T05:26:16.490 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:26:17.490 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:26:17.491 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:26:17.491 INFO:tasks.workunit.client.0.trial030.stdout:2 2026-02-17T05:26:17.491 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T05:26:17.491 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:26:17.491 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T05:26:17.707 INFO:tasks.workunit.client.0.trial030.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3821746640,v1:127.0.0.1:6811/3821746640] [v2:127.0.0.1:6812/3821746640,v1:127.0.0.1:6813/3821746640] exists,up a4a08f60-706a-4c29-a60a-28c4622f28d9 2026-02-17T05:26:17.710 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:26:17.711 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:26:17.711 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:26:17.711 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:32: TEST_bad_inc_map: run_osd td/bad-inc-map 2 2026-02-17T05:26:17.711 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/bad-inc-map 2026-02-17T05:26:17.711 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T05:26:17.711 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-17T05:26:17.711 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T05:26:17.711 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/bad-inc-map/2 2026-02-17T05:26:17.711 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=4edac875-552e-4558-b6ec-6d56f966cd01 --auth-supported=none --mon-host=127.0.0.1:45333 ' 2026-02-17T05:26:17.712 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:26:17.712 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:26:17.712 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:26:17.712 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/bad-inc-map/2' 2026-02-17T05:26:17.712 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/bad-inc-map/2/journal' 2026-02-17T05:26:17.712 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T05:26:17.712 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T05:26:17.712 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/bad-inc-map' 2026-02-17T05:26:17.712 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T05:26:17.712 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:26:17.712 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:26:17.712 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:26:17.712 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:26:17.713 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.11416 2026-02-17T05:26:17.713 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.11416/$cluster-$name.asok' 2026-02-17T05:26:17.713 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.11416/$cluster-$name.asok' 2026-02-17T05:26:17.713 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:26:17.713 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T05:26:17.713 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T05:26:17.713 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/bad-inc-map/$name.log' 2026-02-17T05:26:17.713 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/bad-inc-map/$name.pid' 2026-02-17T05:26:17.713 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:26:17.713 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:26:17.713 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:26:17.713 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:26:17.713 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T05:26:17.714 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T05:26:17.714 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/bad-inc-map/2 2026-02-17T05:26:17.714 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T05:26:17.714 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=01e891b0-f284-466c-8431-4b770799a76d 2026-02-17T05:26:17.714 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 01e891b0-f284-466c-8431-4b770799a76d' 2026-02-17T05:26:17.715 INFO:tasks.workunit.client.0.trial030.stdout:add osd2 01e891b0-f284-466c-8431-4b770799a76d 2026-02-17T05:26:17.715 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T05:26:17.724 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQD5+5Np+mAbKxAAnfuFpS4SyVkt+1K0yQ3HGQ== 2026-02-17T05:26:17.724 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQD5+5Np+mAbKxAAnfuFpS4SyVkt+1K0yQ3HGQ=="}' 2026-02-17T05:26:17.724 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 01e891b0-f284-466c-8431-4b770799a76d -i td/bad-inc-map/2/new.json 2026-02-17T05:26:17.953 INFO:tasks.workunit.client.0.trial030.stdout:2 2026-02-17T05:26:17.962 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/bad-inc-map/2/new.json 2026-02-17T05:26:17.963 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=4edac875-552e-4558-b6ec-6d56f966cd01 --auth-supported=none --mon-host=127.0.0.1:45333 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/2 --osd-journal=td/bad-inc-map/2/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.11416/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQD5+5Np+mAbKxAAnfuFpS4SyVkt+1K0yQ3HGQ== --osd-uuid 01e891b0-f284-466c-8431-4b770799a76d 2026-02-17T05:26:17.986 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:17.978+0000 7f0ec5c43a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:26:17.988 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:17.982+0000 7f0ec5c43a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:26:17.988 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:17.982+0000 7f0ec5c43a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:26:17.989 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:17.982+0000 7f0ec5c43a40 -1 bdev(0x55c8f757c400 td/bad-inc-map/2/block) open stat got: (1) Operation not permitted 2026-02-17T05:26:17.989 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:17.982+0000 7f0ec5c43a40 -1 bluestore(td/bad-inc-map/2) _read_fsid unparsable uuid 2026-02-17T05:26:18.633 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/bad-inc-map/2/keyring 2026-02-17T05:26:18.634 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T05:26:18.634 INFO:tasks.workunit.client.0.trial030.stdout:adding osd2 key to auth repository 2026-02-17T05:26:18.635 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-17T05:26:18.635 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/bad-inc-map/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T05:26:18.940 INFO:tasks.workunit.client.0.trial030.stdout:start osd.2 2026-02-17T05:26:18.940 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-17T05:26:18.941 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=4edac875-552e-4558-b6ec-6d56f966cd01 --auth-supported=none --mon-host=127.0.0.1:45333 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/2 --osd-journal=td/bad-inc-map/2/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.11416/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T05:26:18.941 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T05:26:18.941 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T05:26:18.941 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T05:26:18.962 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:18.954+0000 7fdf51bc1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:26:18.964 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:18.958+0000 7fdf51bc1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:26:18.965 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:18.958+0000 7fdf51bc1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:26:19.151 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-17T05:26:19.151 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:26:19.151 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T05:26:19.151 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:26:19.152 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:26:19.152 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:26:19.152 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:26:19.152 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:26:19.152 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:26:19.152 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T05:26:19.372 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:26:19.412 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:19.406+0000 7fdf51bc1a40 -1 Falling back to public interface 2026-02-17T05:26:19.992 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:19.986+0000 7fdf51bc1a40 -1 osd.2 0 log_to_monitors true 2026-02-17T05:26:20.373 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:26:20.373 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:26:20.374 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T05:26:20.374 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-17T05:26:20.374 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:26:20.375 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T05:26:20.591 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:26:21.593 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:26:21.593 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:26:21.593 INFO:tasks.workunit.client.0.trial030.stdout:2 2026-02-17T05:26:21.594 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T05:26:21.594 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:26:21.594 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T05:26:21.809 INFO:tasks.workunit.client.0.trial030.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/384292001,v1:127.0.0.1:6819/384292001] [v2:127.0.0.1:6820/384292001,v1:127.0.0.1:6821/384292001] exists,up 01e891b0-f284-466c-8431-4b770799a76d 2026-02-17T05:26:21.810 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:26:21.810 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:26:21.810 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:26:21.810 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:34: TEST_bad_inc_map: ceph config set osd.2 osd_inject_bad_map_crc_probability 1 2026-02-17T05:26:22.027 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:37: TEST_bad_inc_map: create_pool foo 8 2026-02-17T05:26:22.027 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create foo 8 2026-02-17T05:26:22.311 INFO:tasks.workunit.client.0.trial030.stderr:pool 'foo' already exists 2026-02-17T05:26:22.321 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T05:26:23.322 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:38: TEST_bad_inc_map: ceph osd pool set foo min_size 1 2026-02-17T05:26:23.631 INFO:tasks.workunit.client.0.trial030.stderr:set pool 1 min_size to 1 2026-02-17T05:26:23.641 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:39: TEST_bad_inc_map: ceph osd pool set foo min_size 2 2026-02-17T05:26:23.935 INFO:tasks.workunit.client.0.trial030.stderr:set pool 1 min_size to 2 2026-02-17T05:26:23.949 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:41: TEST_bad_inc_map: sleep 5 2026-02-17T05:26:28.950 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:44: TEST_bad_inc_map: TIMEOUT=10 2026-02-17T05:26:28.950 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:44: TEST_bad_inc_map: wait_for_osd up 0 2026-02-17T05:26:28.950 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:26:28.950 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T05:26:28.950 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:26:28.950 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:26:28.950 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 10 )) 2026-02-17T05:26:28.951 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:26:28.951 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:26:28.951 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:26:28.951 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T05:26:29.166 INFO:tasks.workunit.client.0.trial030.stdout:osd.0 up in weight 1 up_from 5 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2138752730,v1:127.0.0.1:6801/2138752730] [v2:127.0.0.1:6802/2138752730,v1:127.0.0.1:6803/2138752730] exists,up d278c5cf-1dca-4703-b568-903aa7aad2c5 2026-02-17T05:26:29.167 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:26:29.168 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:26:29.168 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:26:29.168 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:45: TEST_bad_inc_map: TIMEOUT=10 2026-02-17T05:26:29.168 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:45: TEST_bad_inc_map: wait_for_osd up 1 2026-02-17T05:26:29.168 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:26:29.168 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T05:26:29.168 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:26:29.168 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:26:29.168 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 10 )) 2026-02-17T05:26:29.169 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:26:29.169 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:26:29.169 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:26:29.169 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T05:26:29.380 INFO:tasks.workunit.client.0.trial030.stdout:osd.1 up in weight 1 up_from 9 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3821746640,v1:127.0.0.1:6811/3821746640] [v2:127.0.0.1:6812/3821746640,v1:127.0.0.1:6813/3821746640] exists,up a4a08f60-706a-4c29-a60a-28c4622f28d9 2026-02-17T05:26:29.381 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:26:29.381 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:26:29.381 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:26:29.381 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:46: TEST_bad_inc_map: TIMEOUT=10 2026-02-17T05:26:29.381 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:46: TEST_bad_inc_map: wait_for_osd up 2 2026-02-17T05:26:29.381 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:26:29.382 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T05:26:29.382 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:26:29.382 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:26:29.382 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 10 )) 2026-02-17T05:26:29.382 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:26:29.383 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:26:29.383 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:26:29.383 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T05:26:29.587 INFO:tasks.workunit.client.0.trial030.stdout:osd.2 up in weight 1 up_from 13 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/384292001,v1:127.0.0.1:6819/384292001] [v2:127.0.0.1:6820/384292001,v1:127.0.0.1:6821/384292001] exists,up 01e891b0-f284-466c-8431-4b770799a76d 2026-02-17T05:26:29.588 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:26:29.588 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:26:29.589 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:26:29.589 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:49: TEST_bad_inc_map: grep 'injecting map crc failure' td/bad-inc-map/osd.2.log 2026-02-17T05:26:29.590 INFO:tasks.workunit.client.0.trial030.stdout:2026-02-17T05:26:22.254+0000 7fdf3eb5d640 -1 osd.2 13 handle_osd_map injecting map crc failure 2026-02-17T05:26:29.590 INFO:tasks.workunit.client.0.trial030.stdout:2026-02-17T05:26:22.350+0000 7fdf40b61640 -1 osd.2 14 handle_osd_map injecting map crc failure 2026-02-17T05:26:29.590 INFO:tasks.workunit.client.0.trial030.stdout:2026-02-17T05:26:22.350+0000 7fdf40b61640 -1 osd.2 14 handle_osd_map injecting map crc failure 2026-02-17T05:26:29.590 INFO:tasks.workunit.client.0.trial030.stdout:2026-02-17T05:26:23.522+0000 7fdf40b61640 -1 osd.2 15 handle_osd_map injecting map crc failure 2026-02-17T05:26:29.590 INFO:tasks.workunit.client.0.trial030.stdout:2026-02-17T05:26:23.626+0000 7fdf40b61640 -1 osd.2 17 handle_osd_map injecting map crc failure 2026-02-17T05:26:29.590 INFO:tasks.workunit.client.0.trial030.stdout:2026-02-17T05:26:23.626+0000 7fdf3eb5d640 -1 osd.2 17 handle_osd_map injecting map crc failure 2026-02-17T05:26:29.590 INFO:tasks.workunit.client.0.trial030.stdout:2026-02-17T05:26:23.826+0000 7fdf40b61640 -1 osd.2 18 handle_osd_map injecting map crc failure 2026-02-17T05:26:29.590 INFO:tasks.workunit.client.0.trial030.stdout:2026-02-17T05:26:23.930+0000 7fdf3eb5d640 -1 osd.2 19 handle_osd_map injecting map crc failure 2026-02-17T05:26:29.591 INFO:tasks.workunit.client.0.trial030.stdout:2026-02-17T05:26:23.930+0000 7fdf40b61640 -1 osd.2 19 handle_osd_map injecting map crc failure 2026-02-17T05:26:29.591 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:50: TEST_bad_inc_map: grep 'bailing because last' td/bad-inc-map/osd.2.log 2026-02-17T05:26:29.592 INFO:tasks.workunit.client.0.trial030.stdout:2026-02-17T05:26:22.254+0000 7fdf3eb5d640 10 osd.2 13 handle_osd_map bailing because last < start (13<14) 2026-02-17T05:26:29.592 INFO:tasks.workunit.client.0.trial030.stdout:2026-02-17T05:26:22.350+0000 7fdf40b61640 10 osd.2 14 handle_osd_map bailing because last < start (14<15) 2026-02-17T05:26:29.592 INFO:tasks.workunit.client.0.trial030.stdout:2026-02-17T05:26:22.350+0000 7fdf40b61640 10 osd.2 14 handle_osd_map bailing because last < start (14<15) 2026-02-17T05:26:29.592 INFO:tasks.workunit.client.0.trial030.stdout:2026-02-17T05:26:23.522+0000 7fdf40b61640 10 osd.2 15 handle_osd_map bailing because last < start (15<16) 2026-02-17T05:26:29.592 INFO:tasks.workunit.client.0.trial030.stdout:2026-02-17T05:26:23.626+0000 7fdf40b61640 10 osd.2 17 handle_osd_map bailing because last < start (17<18) 2026-02-17T05:26:29.592 INFO:tasks.workunit.client.0.trial030.stdout:2026-02-17T05:26:23.626+0000 7fdf3eb5d640 10 osd.2 17 handle_osd_map bailing because last < start (17<18) 2026-02-17T05:26:29.592 INFO:tasks.workunit.client.0.trial030.stdout:2026-02-17T05:26:23.826+0000 7fdf40b61640 10 osd.2 18 handle_osd_map bailing because last < start (18<19) 2026-02-17T05:26:29.592 INFO:tasks.workunit.client.0.trial030.stdout:2026-02-17T05:26:23.930+0000 7fdf3eb5d640 10 osd.2 19 handle_osd_map bailing because last < start (19<20) 2026-02-17T05:26:29.592 INFO:tasks.workunit.client.0.trial030.stdout:2026-02-17T05:26:23.930+0000 7fdf40b61640 10 osd.2 19 handle_osd_map bailing because last < start (19<20) 2026-02-17T05:26:29.592 INFO:tasks.workunit.client.0.trial030.stdout:success 2026-02-17T05:26:29.593 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:52: TEST_bad_inc_map: echo success 2026-02-17T05:26:29.593 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:54: TEST_bad_inc_map: delete_pool foo 2026-02-17T05:26:29.593 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=foo 2026-02-17T05:26:29.593 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete foo foo --yes-i-really-really-mean-it 2026-02-17T05:26:29.808 INFO:tasks.workunit.client.0.trial030.stderr:pool 'foo' does not exist 2026-02-17T05:26:29.819 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:55: TEST_bad_inc_map: kill_daemons td/bad-inc-map 2026-02-17T05:26:29.820 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:26:29.820 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:26:29.820 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:26:29.820 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:26:29.821 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:26:35.136 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:26:35.136 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:21: run: teardown td/bad-inc-map 2026-02-17T05:26:35.136 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/bad-inc-map 2026-02-17T05:26:35.136 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T05:26:35.136 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/bad-inc-map KILL 2026-02-17T05:26:35.136 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:26:35.136 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:26:35.137 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:26:35.137 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:26:35.137 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:26:35.143 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:26:35.143 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T05:26:35.144 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T05:26:35.145 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T05:26:35.146 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T05:26:35.146 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T05:26:35.146 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T05:26:35.147 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:26:35.147 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T05:26:35.148 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T05:26:35.148 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:26:35.149 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T05:26:35.149 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T05:26:35.150 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/bad-inc-map 2026-02-17T05:26:35.160 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T05:26:35.160 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:26:35.160 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.11416 2026-02-17T05:26:35.160 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.11416 2026-02-17T05:26:35.162 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T05:26:35.162 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T05:26:35.162 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: code=0 2026-02-17T05:26:35.162 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2404: main: teardown td/bad-inc-map 0 2026-02-17T05:26:35.162 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/bad-inc-map 2026-02-17T05:26:35.163 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-17T05:26:35.163 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/bad-inc-map KILL 2026-02-17T05:26:35.163 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:26:35.163 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:26:35.163 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:26:35.163 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:26:35.163 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:26:35.164 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:26:35.165 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T05:26:35.165 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T05:26:35.166 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T05:26:35.167 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T05:26:35.167 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T05:26:35.167 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T05:26:35.168 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:26:35.168 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T05:26:35.169 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T05:26:35.169 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:26:35.170 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T05:26:35.171 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-17T05:26:35.171 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/bad-inc-map 2026-02-17T05:26:35.173 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T05:26:35.173 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:26:35.173 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.11416 2026-02-17T05:26:35.173 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.11416 2026-02-17T05:26:35.175 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T05:26:35.175 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T05:26:35.175 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: return 0 2026-02-17T05:26:35.175 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-17T05:26:35.176 DEBUG:teuthology.orchestra.run.trial030:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-17T05:26:35.227 INFO:tasks.workunit:Running workunit osd/divergent-priors.sh... 2026-02-17T05:26:35.227 DEBUG:teuthology.orchestra.run.trial030:workunit test osd/divergent-priors.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=325850157d309f65985eea9ec9bb9f1d56726fee TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh 2026-02-17T05:26:35.280 INFO:tasks.workunit.client.0.trial030.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-17T05:26:35.284 INFO:tasks.workunit.client.0.trial030.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-17T05:26:35.284 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-17T05:26:35.284 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-17T05:26:35.284 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PYTHONWARNINGS=ignore 2026-02-17T05:26:35.284 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PYTHONWARNINGS=ignore 2026-02-17T05:26:35.285 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export CEPH_CONF=/dev/null 2026-02-17T05:26:35.285 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: CEPH_CONF=/dev/null 2026-02-17T05:26:35.285 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: unset CEPH_ARGS 2026-02-17T05:26:35.285 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2398: main: local code 2026-02-17T05:26:35.285 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: run td/divergent-priors 2026-02-17T05:26:35.285 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:21: run: local dir=td/divergent-priors 2026-02-17T05:26:35.285 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:22: run: shift 2026-02-17T05:26:35.285 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:25: run: export loglen=12 2026-02-17T05:26:35.285 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:25: run: loglen=12 2026-02-17T05:26:35.285 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:26: run: export divisor=3 2026-02-17T05:26:35.285 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:26: run: divisor=3 2026-02-17T05:26:35.286 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:27: run: expr 12 / 2 2026-02-17T05:26:35.286 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:27: run: export trim=6 2026-02-17T05:26:35.287 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:27: run: trim=6 2026-02-17T05:26:35.287 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:28: run: expr 6 / 3 2026-02-17T05:26:35.287 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:28: run: export DIVERGENT_WRITE=2 2026-02-17T05:26:35.287 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:28: run: DIVERGENT_WRITE=2 2026-02-17T05:26:35.287 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:29: run: expr 6 / 3 2026-02-17T05:26:35.288 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:29: run: export DIVERGENT_REMOVE=2 2026-02-17T05:26:35.288 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:29: run: DIVERGENT_REMOVE=2 2026-02-17T05:26:35.288 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:30: run: expr 6 / 3 2026-02-17T05:26:35.290 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:30: run: export DIVERGENT_CREATE=2 2026-02-17T05:26:35.290 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:30: run: DIVERGENT_CREATE=2 2026-02-17T05:26:35.290 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:31: run: export poolname=test 2026-02-17T05:26:35.290 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:31: run: poolname=test 2026-02-17T05:26:35.290 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:32: run: export testobjects=100 2026-02-17T05:26:35.290 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:32: run: testobjects=100 2026-02-17T05:26:35.290 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:34: run: export CEPH_MON=127.0.0.1:7115 2026-02-17T05:26:35.290 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:34: run: CEPH_MON=127.0.0.1:7115 2026-02-17T05:26:35.290 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:35: run: export CEPH_ARGS 2026-02-17T05:26:35.291 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:36: run: uuidgen 2026-02-17T05:26:35.292 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:36: run: CEPH_ARGS+='--fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none ' 2026-02-17T05:26:35.292 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:37: run: CEPH_ARGS+='--mon-host=127.0.0.1:7115 ' 2026-02-17T05:26:35.292 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:39: run: CEPH_ARGS+='--osd_force_auth_primary_missing_objects=1000000 ' 2026-02-17T05:26:35.292 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:40: run: CEPH_ARGS+='--osd_debug_pg_log_writeout=true ' 2026-02-17T05:26:35.292 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:41: run: CEPH_ARGS+='--osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T05:26:35.292 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:43: run: set 2026-02-17T05:26:35.292 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:43: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-17T05:26:35.295 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:43: run: local 'funcs=TEST_divergent 2026-02-17T05:26:35.295 INFO:tasks.workunit.client.0.trial030.stderr:TEST_divergent_2 2026-02-17T05:26:35.295 INFO:tasks.workunit.client.0.trial030.stderr:TEST_divergent_3 2026-02-17T05:26:35.295 INFO:tasks.workunit.client.0.trial030.stderr:TEST_divergent_ec' 2026-02-17T05:26:35.295 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:44: run: for func in $funcs 2026-02-17T05:26:35.295 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:45: run: setup td/divergent-priors 2026-02-17T05:26:35.295 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/divergent-priors 2026-02-17T05:26:35.295 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/divergent-priors 2026-02-17T05:26:35.295 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-17T05:26:35.296 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T05:26:35.296 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-17T05:26:35.296 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:26:35.296 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:26:35.296 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:26:35.296 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:26:35.296 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:26:35.297 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:26:35.297 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T05:26:35.298 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T05:26:35.298 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T05:26:35.299 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T05:26:35.299 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T05:26:35.299 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T05:26:35.300 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:26:35.301 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T05:26:35.301 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T05:26:35.301 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:26:35.302 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T05:26:35.303 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T05:26:35.303 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-17T05:26:35.305 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T05:26:35.305 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:26:35.305 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:26:35.305 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.19532 2026-02-17T05:26:35.306 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T05:26:35.306 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T05:26:35.307 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/divergent-priors 2026-02-17T05:26:35.308 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T05:26:35.309 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:26:35.309 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:26:35.309 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.19532 2026-02-17T05:26:35.310 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T05:26:35.311 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-17T05:26:35.311 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-17T05:26:35.311 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T05:26:35.312 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/divergent-priors 1' TERM HUP INT 2026-02-17T05:26:35.312 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:46: run: TEST_divergent td/divergent-priors 2026-02-17T05:26:35.312 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:57: TEST_divergent: local dir=td/divergent-priors 2026-02-17T05:26:35.312 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:59: TEST_divergent: file_with_random_data 2026-02-17T05:26:35.312 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=512 2026-02-17T05:26:35.312 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-17T05:26:35.312 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:35.313 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.8HyEvfVyHy bs=512 count=1 2026-02-17T05:26:35.314 INFO:tasks.workunit.client.0.trial030.stderr:1+0 records in 2026-02-17T05:26:35.314 INFO:tasks.workunit.client.0.trial030.stderr:1+0 records out 2026-02-17T05:26:35.314 INFO:tasks.workunit.client.0.trial030.stderr:512 bytes copied, 0.000190642 s, 2.7 MB/s 2026-02-17T05:26:35.314 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:35.315 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:59: TEST_divergent: local dummyfile=/tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:35.315 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:60: TEST_divergent: local num_osds=3 2026-02-17T05:26:35.315 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:61: TEST_divergent: expr 3 - 1 2026-02-17T05:26:35.316 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:61: TEST_divergent: seq 0 2 2026-02-17T05:26:35.317 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:61: TEST_divergent: local 'osds=0 2026-02-17T05:26:35.317 INFO:tasks.workunit.client.0.trial030.stderr:1 2026-02-17T05:26:35.317 INFO:tasks.workunit.client.0.trial030.stderr:2' 2026-02-17T05:26:35.318 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:62: TEST_divergent: run_mon td/divergent-priors a 2026-02-17T05:26:35.318 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/divergent-priors 2026-02-17T05:26:35.318 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T05:26:35.318 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T05:26:35.318 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T05:26:35.318 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/divergent-priors/a 2026-02-17T05:26:35.318 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/divergent-priors/a --run-dir=td/divergent-priors 2026-02-17T05:26:35.347 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T05:26:35.347 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:26:35.347 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:26:35.347 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:26:35.347 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:26:35.347 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:26:35.348 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:26:35.348 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/divergent-priors/a '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' --mon-cluster-log-file=td/divergent-priors/log --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T05:26:35.379 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T05:26:35.381 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T05:26:35.381 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T05:26:35.381 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T05:26:35.381 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T05:26:35.381 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T05:26:35.381 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T05:26:35.381 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T05:26:35.381 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T05:26:35.382 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T05:26:35.382 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:26:35.383 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:26:35.383 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19532/ceph-mon.a.asok 2026-02-17T05:26:35.383 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T05:26:35.383 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.19532/ceph-mon.a.asok config get fsid 2026-02-17T05:26:35.437 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T05:26:35.437 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T05:26:35.437 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T05:26:35.437 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T05:26:35.437 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T05:26:35.437 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T05:26:35.438 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T05:26:35.438 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T05:26:35.439 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T05:26:35.439 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:26:35.439 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:26:35.439 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19532/ceph-mon.a.asok 2026-02-17T05:26:35.439 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T05:26:35.439 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.19532/ceph-mon.a.asok config get mon_host 2026-02-17T05:26:35.492 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:63: TEST_divergent: run_mgr td/divergent-priors x 2026-02-17T05:26:35.492 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/divergent-priors 2026-02-17T05:26:35.493 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T05:26:35.493 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T05:26:35.493 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T05:26:35.493 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/divergent-priors/x 2026-02-17T05:26:35.493 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T05:26:35.605 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T05:26:35.606 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:26:35.606 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:26:35.606 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:26:35.606 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:26:35.606 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:26:35.606 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:26:35.607 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T05:26:35.607 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/divergent-priors/x '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T05:26:35.631 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:64: TEST_divergent: for i in $osds 2026-02-17T05:26:35.631 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:66: TEST_divergent: run_osd td/divergent-priors 0 2026-02-17T05:26:35.631 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-17T05:26:35.631 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T05:26:35.631 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T05:26:35.631 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T05:26:35.631 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/0 2026-02-17T05:26:35.632 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T05:26:35.632 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:26:35.632 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:26:35.632 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:26:35.632 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-17T05:26:35.632 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-17T05:26:35.632 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T05:26:35.632 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T05:26:35.632 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T05:26:35.632 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T05:26:35.632 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:26:35.632 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:26:35.633 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:26:35.633 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:26:35.633 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:26:35.633 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:26:35.633 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:26:35.633 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:26:35.633 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T05:26:35.633 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T05:26:35.633 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T05:26:35.633 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T05:26:35.633 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:26:35.633 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:26:35.633 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:26:35.634 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:26:35.634 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T05:26:35.634 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T05:26:35.634 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/0 2026-02-17T05:26:35.634 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T05:26:35.635 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=352e74ee-ecc2-4670-94d6-94c5b9b5c4be 2026-02-17T05:26:35.635 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 352e74ee-ecc2-4670-94d6-94c5b9b5c4be' 2026-02-17T05:26:35.635 INFO:tasks.workunit.client.0.trial030.stdout:add osd0 352e74ee-ecc2-4670-94d6-94c5b9b5c4be 2026-02-17T05:26:35.636 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T05:26:35.646 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAL/JNp4WZ7JhAAwMKob1NrdivIPhq23uXWdg== 2026-02-17T05:26:35.646 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAL/JNp4WZ7JhAAwMKob1NrdivIPhq23uXWdg=="}' 2026-02-17T05:26:35.647 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 352e74ee-ecc2-4670-94d6-94c5b9b5c4be -i td/divergent-priors/0/new.json 2026-02-17T05:26:35.765 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:26:35.773 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/0/new.json 2026-02-17T05:26:35.774 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAL/JNp4WZ7JhAAwMKob1NrdivIPhq23uXWdg== --osd-uuid 352e74ee-ecc2-4670-94d6-94c5b9b5c4be 2026-02-17T05:26:35.794 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:35.794+0000 7feb8acf6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:26:35.796 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:35.794+0000 7feb8acf6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:26:35.797 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:35.794+0000 7feb8acf6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:26:35.797 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:35.794+0000 7feb8acf6a40 -1 bdev(0x5633df18e400 td/divergent-priors/0/block) open stat got: (1) Operation not permitted 2026-02-17T05:26:35.797 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:35.794+0000 7feb8acf6a40 -1 bluestore(td/divergent-priors/0) _read_fsid unparsable uuid 2026-02-17T05:26:36.631 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/0/keyring 2026-02-17T05:26:36.631 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T05:26:36.632 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T05:26:36.633 INFO:tasks.workunit.client.0.trial030.stdout:adding osd0 key to auth repository 2026-02-17T05:26:36.633 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T05:26:36.757 INFO:tasks.workunit.client.0.trial030.stdout:start osd.0 2026-02-17T05:26:36.758 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T05:26:36.758 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T05:26:36.758 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T05:26:36.758 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T05:26:36.758 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T05:26:36.787 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:36.786+0000 7f6fab572a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:26:36.789 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:36.786+0000 7f6fab572a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:26:36.791 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:36.790+0000 7f6fab572a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:26:36.869 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T05:26:36.869 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:26:36.869 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T05:26:36.869 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:26:36.869 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:26:36.870 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:26:36.870 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:26:36.870 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:26:36.870 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:26:36.871 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T05:26:36.979 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:26:37.312 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:37.310+0000 7f6fab572a40 -1 Falling back to public interface 2026-02-17T05:26:37.981 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:26:37.981 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:26:37.981 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-17T05:26:37.981 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T05:26:37.981 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:26:37.981 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T05:26:38.199 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:26:38.299 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:38.298+0000 7f6fab572a40 -1 osd.0 0 log_to_monitors true 2026-02-17T05:26:39.200 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:26:39.200 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:26:39.200 INFO:tasks.workunit.client.0.trial030.stdout:2 2026-02-17T05:26:39.201 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T05:26:39.201 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:26:39.201 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T05:26:39.421 INFO:tasks.workunit.client.0.trial030.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/335266713,v1:127.0.0.1:6801/335266713] [v2:127.0.0.1:6802/335266713,v1:127.0.0.1:6803/335266713] exists,up 352e74ee-ecc2-4670-94d6-94c5b9b5c4be 2026-02-17T05:26:39.424 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:26:39.424 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:26:39.425 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:26:39.425 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:64: TEST_divergent: for i in $osds 2026-02-17T05:26:39.425 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:66: TEST_divergent: run_osd td/divergent-priors 1 2026-02-17T05:26:39.425 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-17T05:26:39.425 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T05:26:39.425 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-17T05:26:39.425 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T05:26:39.425 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/1 2026-02-17T05:26:39.425 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T05:26:39.425 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:26:39.425 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:26:39.426 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:26:39.426 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-17T05:26:39.426 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-17T05:26:39.426 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T05:26:39.426 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T05:26:39.426 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T05:26:39.426 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T05:26:39.426 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:26:39.426 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:26:39.426 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:26:39.426 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:26:39.426 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:26:39.426 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:26:39.427 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:26:39.427 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:26:39.427 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T05:26:39.427 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T05:26:39.427 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T05:26:39.427 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T05:26:39.427 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:26:39.427 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:26:39.427 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:26:39.427 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:26:39.427 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T05:26:39.427 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T05:26:39.427 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/1 2026-02-17T05:26:39.428 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T05:26:39.428 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=5524a34c-0b5e-410e-8b07-ebafda9e86f0 2026-02-17T05:26:39.429 INFO:tasks.workunit.client.0.trial030.stdout:add osd1 5524a34c-0b5e-410e-8b07-ebafda9e86f0 2026-02-17T05:26:39.429 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 5524a34c-0b5e-410e-8b07-ebafda9e86f0' 2026-02-17T05:26:39.429 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T05:26:39.440 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAP/JNp+14gGhAATs3Y7J0o+IY+9vHt10kR1w== 2026-02-17T05:26:39.440 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAP/JNp+14gGhAATs3Y7J0o+IY+9vHt10kR1w=="}' 2026-02-17T05:26:39.440 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 5524a34c-0b5e-410e-8b07-ebafda9e86f0 -i td/divergent-priors/1/new.json 2026-02-17T05:26:39.655 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-17T05:26:39.663 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/1/new.json 2026-02-17T05:26:39.664 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAP/JNp+14gGhAATs3Y7J0o+IY+9vHt10kR1w== --osd-uuid 5524a34c-0b5e-410e-8b07-ebafda9e86f0 2026-02-17T05:26:39.683 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:39.682+0000 7fd4f64eaa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:26:39.684 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:39.682+0000 7fd4f64eaa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:26:39.685 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:39.682+0000 7fd4f64eaa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:26:39.686 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:39.682+0000 7fd4f64eaa40 -1 bdev(0x55c57103c400 td/divergent-priors/1/block) open stat got: (1) Operation not permitted 2026-02-17T05:26:39.686 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:39.682+0000 7fd4f64eaa40 -1 bluestore(td/divergent-priors/1) _read_fsid unparsable uuid 2026-02-17T05:26:40.328 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/1/keyring 2026-02-17T05:26:40.328 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T05:26:40.329 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-17T05:26:40.329 INFO:tasks.workunit.client.0.trial030.stdout:adding osd1 key to auth repository 2026-02-17T05:26:40.330 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T05:26:40.623 INFO:tasks.workunit.client.0.trial030.stdout:start osd.1 2026-02-17T05:26:40.623 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-17T05:26:40.624 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T05:26:40.624 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T05:26:40.624 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T05:26:40.624 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T05:26:40.651 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:40.649+0000 7f17e398fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:26:40.654 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:40.649+0000 7f17e398fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:26:40.654 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:40.649+0000 7f17e398fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:26:40.841 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-17T05:26:40.841 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:26:40.841 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T05:26:40.841 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:26:40.841 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:26:40.841 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:26:40.842 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:26:40.842 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:26:40.842 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:26:40.843 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T05:26:41.056 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:26:41.128 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:41.125+0000 7f17e398fa40 -1 Falling back to public interface 2026-02-17T05:26:41.786 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:41.781+0000 7f17e398fa40 -1 osd.1 0 log_to_monitors true 2026-02-17T05:26:42.058 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:26:42.058 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:26:42.058 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-17T05:26:42.059 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T05:26:42.059 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:26:42.059 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T05:26:42.274 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:26:43.275 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:26:43.276 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:26:43.276 INFO:tasks.workunit.client.0.trial030.stdout:2 2026-02-17T05:26:43.277 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T05:26:43.277 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:26:43.277 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T05:26:43.488 INFO:tasks.workunit.client.0.trial030.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3684006821,v1:127.0.0.1:6811/3684006821] [v2:127.0.0.1:6812/3684006821,v1:127.0.0.1:6813/3684006821] exists,up 5524a34c-0b5e-410e-8b07-ebafda9e86f0 2026-02-17T05:26:43.492 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:26:43.493 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:26:43.493 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:26:43.493 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:64: TEST_divergent: for i in $osds 2026-02-17T05:26:43.493 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:66: TEST_divergent: run_osd td/divergent-priors 2 2026-02-17T05:26:43.493 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-17T05:26:43.493 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T05:26:43.493 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-17T05:26:43.493 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T05:26:43.493 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/2 2026-02-17T05:26:43.493 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T05:26:43.494 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:26:43.494 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:26:43.494 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:26:43.494 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-17T05:26:43.494 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-17T05:26:43.494 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T05:26:43.494 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T05:26:43.494 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T05:26:43.494 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T05:26:43.494 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:26:43.494 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:26:43.495 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:26:43.495 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:26:43.495 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:26:43.495 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:26:43.495 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:26:43.495 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:26:43.495 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T05:26:43.495 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T05:26:43.495 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T05:26:43.495 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T05:26:43.495 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:26:43.495 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:26:43.496 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:26:43.496 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:26:43.496 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T05:26:43.496 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T05:26:43.496 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/2 2026-02-17T05:26:43.496 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T05:26:43.497 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=e4a4420b-77ab-4a4b-a531-61a8b5f39ca2 2026-02-17T05:26:43.497 INFO:tasks.workunit.client.0.trial030.stdout:add osd2 e4a4420b-77ab-4a4b-a531-61a8b5f39ca2 2026-02-17T05:26:43.497 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 e4a4420b-77ab-4a4b-a531-61a8b5f39ca2' 2026-02-17T05:26:43.498 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T05:26:43.508 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAT/JNpUT86HhAAHHRkxQHSjni47wyWvhyZVA== 2026-02-17T05:26:43.508 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAT/JNpUT86HhAAHHRkxQHSjni47wyWvhyZVA=="}' 2026-02-17T05:26:43.508 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new e4a4420b-77ab-4a4b-a531-61a8b5f39ca2 -i td/divergent-priors/2/new.json 2026-02-17T05:26:43.733 INFO:tasks.workunit.client.0.trial030.stdout:2 2026-02-17T05:26:43.744 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/2/new.json 2026-02-17T05:26:43.745 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAT/JNpUT86HhAAHHRkxQHSjni47wyWvhyZVA== --osd-uuid e4a4420b-77ab-4a4b-a531-61a8b5f39ca2 2026-02-17T05:26:43.772 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:43.769+0000 7f542bd77a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:26:43.774 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:43.769+0000 7f542bd77a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:26:43.775 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:43.773+0000 7f542bd77a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:26:43.775 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:43.773+0000 7f542bd77a40 -1 bdev(0x55f565324400 td/divergent-priors/2/block) open stat got: (1) Operation not permitted 2026-02-17T05:26:43.775 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:43.773+0000 7f542bd77a40 -1 bluestore(td/divergent-priors/2) _read_fsid unparsable uuid 2026-02-17T05:26:44.470 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/2/keyring 2026-02-17T05:26:44.470 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T05:26:44.471 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-17T05:26:44.471 INFO:tasks.workunit.client.0.trial030.stdout:adding osd2 key to auth repository 2026-02-17T05:26:44.472 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T05:26:44.764 INFO:tasks.workunit.client.0.trial030.stdout:start osd.2 2026-02-17T05:26:44.765 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-17T05:26:44.765 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T05:26:44.765 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T05:26:44.765 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T05:26:44.765 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T05:26:44.793 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:44.789+0000 7f94be90aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:26:44.795 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:44.793+0000 7f94be90aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:26:44.796 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:44.793+0000 7f94be90aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:26:44.985 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-17T05:26:44.985 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:26:44.985 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T05:26:44.985 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:26:44.985 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:26:44.985 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:26:44.986 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:26:44.986 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:26:44.987 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:26:44.987 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T05:26:45.176 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:45.173+0000 7f94be90aa40 -1 Falling back to public interface 2026-02-17T05:26:45.205 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:26:45.793 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:26:45.789+0000 7f94be90aa40 -1 osd.2 0 log_to_monitors true 2026-02-17T05:26:46.207 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:26:46.207 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:26:46.207 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T05:26:46.207 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-17T05:26:46.208 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:26:46.208 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T05:26:46.432 INFO:tasks.workunit.client.0.trial030.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/3723596659,v1:127.0.0.1:6819/3723596659] [v2:127.0.0.1:6820/3723596659,v1:127.0.0.1:6821/3723596659] exists,up e4a4420b-77ab-4a4b-a531-61a8b5f39ca2 2026-02-17T05:26:46.433 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:26:46.433 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:26:46.433 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:26:46.433 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:69: TEST_divergent: ceph osd set noout 2026-02-17T05:26:46.717 INFO:tasks.workunit.client.0.trial030.stderr:noout is set 2026-02-17T05:26:46.728 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:70: TEST_divergent: ceph osd set noin 2026-02-17T05:26:47.023 INFO:tasks.workunit.client.0.trial030.stderr:noin is set 2026-02-17T05:26:47.033 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:71: TEST_divergent: ceph osd set nodown 2026-02-17T05:26:47.327 INFO:tasks.workunit.client.0.trial030.stderr:nodown is set 2026-02-17T05:26:47.339 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:72: TEST_divergent: create_pool test 1 1 2026-02-17T05:26:47.339 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2026-02-17T05:26:47.586 INFO:tasks.workunit.client.0.trial030.stderr:pool 'test' already exists 2026-02-17T05:26:47.596 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T05:26:48.598 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:73: TEST_divergent: ceph osd pool set test size 3 2026-02-17T05:26:48.884 INFO:tasks.workunit.client.0.trial030.stderr:set pool 1 size to 3 2026-02-17T05:26:48.897 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:74: TEST_divergent: ceph osd pool set test min_size 2 2026-02-17T05:26:49.188 INFO:tasks.workunit.client.0.trial030.stderr:set pool 1 min_size to 2 2026-02-17T05:26:49.204 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:76: TEST_divergent: flush_pg_stats 2026-02-17T05:26:49.204 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T05:26:49.204 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:26:49.421 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:26:49.421 INFO:tasks.workunit.client.0.trial030.stderr:1 2026-02-17T05:26:49.421 INFO:tasks.workunit.client.0.trial030.stderr:2' 2026-02-17T05:26:49.421 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:26:49.421 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:26:49.422 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T05:26:49.508 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836485 2026-02-17T05:26:49.508 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836485 2026-02-17T05:26:49.508 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485' 2026-02-17T05:26:49.508 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:26:49.508 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T05:26:49.593 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672964 2026-02-17T05:26:49.593 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672964 2026-02-17T05:26:49.593 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-42949672964' 2026-02-17T05:26:49.593 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:26:49.593 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T05:26:49.678 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542147 2026-02-17T05:26:49.679 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542147 2026-02-17T05:26:49.679 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-42949672964 2-60129542147' 2026-02-17T05:26:49.679 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:26:49.679 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836485 2026-02-17T05:26:49.679 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:26:49.680 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:26:49.680 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836485 2026-02-17T05:26:49.681 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:26:49.682 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836485 2026-02-17T05:26:49.682 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2026-02-17T05:26:49.683 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.0 seq 21474836485 2026-02-17T05:26:49.683 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:26:49.905 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836485 2026-02-17T05:26:49.906 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:26:50.907 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T05:26:50.908 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:26:51.126 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836485 -lt 21474836485 2026-02-17T05:26:51.127 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:26:51.127 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672964 2026-02-17T05:26:51.128 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:26:51.128 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:26:51.129 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672964 2026-02-17T05:26:51.129 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:26:51.131 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672964 2026-02-17T05:26:51.131 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.1 seq 42949672964 2026-02-17T05:26:51.132 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672964' 2026-02-17T05:26:51.132 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:26:51.352 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672964 -lt 42949672964 2026-02-17T05:26:51.352 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:26:51.353 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542147 2026-02-17T05:26:51.353 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:26:51.354 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:26:51.355 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:26:51.355 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542147 2026-02-17T05:26:51.356 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542147 2026-02-17T05:26:51.356 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542147' 2026-02-17T05:26:51.357 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.2 seq 60129542147 2026-02-17T05:26:51.357 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:26:51.577 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542147 -lt 60129542147 2026-02-17T05:26:51.577 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:77: TEST_divergent: wait_for_clean 2026-02-17T05:26:51.577 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T05:26:51.577 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T05:26:51.577 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T05:26:51.577 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T05:26:51.578 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T05:26:51.578 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T05:26:51.579 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T05:26:51.579 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T05:26:51.579 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T05:26:51.683 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T05:26:51.683 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T05:26:51.683 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T05:26:51.683 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T05:26:51.684 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T05:26:51.684 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:26:51.908 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:26:51.908 INFO:tasks.workunit.client.0.trial030.stderr:1 2026-02-17T05:26:51.908 INFO:tasks.workunit.client.0.trial030.stderr:2' 2026-02-17T05:26:51.908 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:26:51.908 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:26:51.909 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T05:26:51.992 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-17T05:26:51.992 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-17T05:26:51.992 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487' 2026-02-17T05:26:51.992 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:26:51.992 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T05:26:52.075 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672966 2026-02-17T05:26:52.075 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672966 2026-02-17T05:26:52.075 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-42949672966' 2026-02-17T05:26:52.075 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:26:52.075 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T05:26:52.159 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542150 2026-02-17T05:26:52.159 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542150 2026-02-17T05:26:52.159 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-42949672966 2-60129542150' 2026-02-17T05:26:52.159 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:26:52.159 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836487 2026-02-17T05:26:52.160 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:26:52.161 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:26:52.161 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-17T05:26:52.162 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:26:52.164 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836487 2026-02-17T05:26:52.164 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-17T05:26:52.164 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.0 seq 21474836487 2026-02-17T05:26:52.165 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:26:52.380 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836485 -lt 21474836487 2026-02-17T05:26:52.380 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:26:53.380 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T05:26:53.381 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:26:53.602 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836485 -lt 21474836487 2026-02-17T05:26:53.602 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:26:54.604 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T05:26:54.604 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:26:54.828 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-17T05:26:54.829 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:26:54.829 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672966 2026-02-17T05:26:54.829 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:26:54.831 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:26:54.832 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672966 2026-02-17T05:26:54.832 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:26:54.833 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672966 2026-02-17T05:26:54.833 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672966' 2026-02-17T05:26:54.834 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.1 seq 42949672966 2026-02-17T05:26:54.834 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:26:55.056 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672967 -lt 42949672966 2026-02-17T05:26:55.057 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:26:55.057 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542150 2026-02-17T05:26:55.057 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:26:55.058 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:26:55.059 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542150 2026-02-17T05:26:55.059 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:26:55.061 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542150 2026-02-17T05:26:55.061 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542150' 2026-02-17T05:26:55.061 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.2 seq 60129542150 2026-02-17T05:26:55.061 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:26:55.285 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542150 -lt 60129542150 2026-02-17T05:26:55.285 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T05:26:55.286 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:26:55.286 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:26:55.567 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T05:26:55.567 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:26:55.568 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:26:55.569 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:26:55.569 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:26:55.569 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:26:55.569 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:26:55.569 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:26:55.783 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T05:26:55.783 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:26:55.783 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:26:55.783 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:26:56.083 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T05:26:56.083 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T05:26:56.083 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T05:26:56.085 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:80: TEST_divergent: ceph pg dump pgs --format=json 2026-02-17T05:26:56.085 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:80: TEST_divergent: jq '.pg_stats[0].up_primary' 2026-02-17T05:26:56.294 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:26:56.304 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:80: TEST_divergent: local divergent=1 2026-02-17T05:26:56.305 INFO:tasks.workunit.client.0.trial030.stdout:primary and soon to be divergent is 1 2026-02-17T05:26:56.305 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:81: TEST_divergent: echo 'primary and soon to be divergent is 1' 2026-02-17T05:26:56.305 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:82: TEST_divergent: ceph pg dump pgs 2026-02-17T05:26:56.505 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T05:26:56.505 INFO:tasks.workunit.client.0.trial030.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T05:26:47.825183+0000 0'0 27:24 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:26:47.528723+0000 0'0 2026-02-17T05:26:47.528723+0000 0 0 periodic scrub scheduled @ 2026-02-18T07:17:30.158820+0000 0 0 2026-02-17T05:26:56.505 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-17T05:26:56.506 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T05:26:56.506 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:26:56.514 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:83: TEST_divergent: local non_divergent= 2026-02-17T05:26:56.514 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:84: TEST_divergent: for i in $osds 2026-02-17T05:26:56.515 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:86: TEST_divergent: '[' 0 = 1 ']' 2026-02-17T05:26:56.515 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:89: TEST_divergent: non_divergent=' 0' 2026-02-17T05:26:56.515 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:84: TEST_divergent: for i in $osds 2026-02-17T05:26:56.515 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:86: TEST_divergent: '[' 1 = 1 ']' 2026-02-17T05:26:56.515 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:87: TEST_divergent: continue 2026-02-17T05:26:56.515 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:84: TEST_divergent: for i in $osds 2026-02-17T05:26:56.515 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:86: TEST_divergent: '[' 2 = 1 ']' 2026-02-17T05:26:56.515 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:89: TEST_divergent: non_divergent=' 0 2' 2026-02-17T05:26:56.515 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:92: TEST_divergent: echo 'writing initial objects' 2026-02-17T05:26:56.515 INFO:tasks.workunit.client.0.trial030.stdout:writing initial objects 2026-02-17T05:26:56.515 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: seq 1 100 2026-02-17T05:26:56.515 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:56.515 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_1 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:56.539 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:56.539 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_2 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:56.568 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:56.568 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_3 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:56.595 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:56.595 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_4 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:56.615 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:56.615 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_5 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:56.643 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:56.643 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_6 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:56.670 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:56.671 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_7 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:56.700 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:56.700 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_8 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:56.721 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:56.721 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_9 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:56.750 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:56.750 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_10 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:56.777 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:56.777 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_11 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:56.805 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:56.805 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_12 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:56.833 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:56.833 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_13 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:56.861 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:56.861 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_14 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:56.889 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:56.889 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_15 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:56.917 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:56.917 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_16 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:56.945 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:56.945 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_17 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:56.972 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:56.973 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_18 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:57.001 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:57.001 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_19 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:57.029 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:57.029 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_20 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:57.057 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:57.058 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_21 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:57.085 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:57.086 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_22 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:57.109 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:57.109 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_23 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:57.139 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:57.139 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_24 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:57.167 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:57.167 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_25 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:57.189 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:57.189 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_26 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:57.217 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:57.217 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_27 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:57.246 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:57.246 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_28 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:57.274 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:57.275 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_29 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:57.301 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:57.302 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_30 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:57.329 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:57.330 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_31 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:57.358 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:57.358 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_32 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:57.385 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:57.386 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_33 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:57.413 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:57.413 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_34 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:57.442 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:57.442 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_35 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:57.471 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:57.471 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_36 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:57.492 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:57.493 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_37 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:57.520 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:57.521 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_38 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:57.548 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:57.548 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_39 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:57.577 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:57.577 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_40 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:57.604 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:57.605 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_41 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:57.632 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:57.633 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_42 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:57.661 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:57.661 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_43 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:57.689 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:57.690 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_44 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:57.717 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:57.717 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_45 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:57.745 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:57.745 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_46 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:57.773 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:57.773 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_47 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:57.801 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:57.801 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_48 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:57.829 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:57.829 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_49 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:57.857 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:57.857 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_50 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:57.886 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:57.886 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_51 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:57.914 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:57.914 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_52 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:57.942 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:57.942 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_53 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:57.970 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:57.970 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_54 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:57.998 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:57.998 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_55 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:58.028 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:58.028 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_56 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:58.057 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:58.057 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_57 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:58.086 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:58.086 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_58 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:58.114 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:58.114 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_59 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:58.144 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:58.144 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_60 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:58.173 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:58.173 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_61 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:58.201 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:58.202 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_62 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:58.229 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:58.229 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_63 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:58.257 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:58.257 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_64 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:58.284 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:58.284 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_65 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:58.312 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:58.312 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_66 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:58.340 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:58.341 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_67 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:58.368 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:58.369 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_68 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:58.397 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:58.397 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_69 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:58.425 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:58.425 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_70 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:58.453 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:58.453 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_71 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:58.481 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:58.481 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_72 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:58.509 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:58.509 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_73 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:58.537 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:58.537 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_74 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:58.565 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:58.565 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_75 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:58.593 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:58.593 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_76 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:58.621 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:58.621 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_77 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:58.649 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:58.649 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_78 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:58.677 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:58.677 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_79 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:58.705 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:58.705 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_80 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:58.725 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:58.726 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_81 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:58.755 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:58.755 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_82 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:58.781 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:58.781 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_83 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:58.811 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:58.811 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_84 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:58.840 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:58.840 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_85 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:58.868 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:58.868 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_86 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:58.896 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:58.896 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_87 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:58.917 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:58.917 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_88 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:58.945 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:58.946 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_89 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:58.973 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:58.973 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_90 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:59.001 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:59.001 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_91 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:59.029 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:59.029 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_92 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:59.057 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:59.057 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_93 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:59.084 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:59.084 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_94 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:59.112 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:59.112 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_95 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:59.140 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:59.141 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_96 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:59.169 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:59.169 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_97 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:59.197 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:59.197 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_98 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:59.225 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:59.225 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_99 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:59.253 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T05:26:59.253 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_100 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:26:59.281 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-17T05:26:59.281 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: wait_for_clean 2026-02-17T05:26:59.281 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T05:26:59.282 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T05:26:59.282 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T05:26:59.283 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-17T05:26:59.283 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T05:26:59.283 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T05:26:59.283 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T05:26:59.283 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T05:26:59.283 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T05:26:59.351 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-17T05:26:59.352 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T05:26:59.352 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T05:26:59.352 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T05:26:59.352 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T05:26:59.352 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:26:59.571 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:26:59.572 INFO:tasks.workunit.client.0.trial030.stderr:1 2026-02-17T05:26:59.572 INFO:tasks.workunit.client.0.trial030.stderr:2' 2026-02-17T05:26:59.572 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:26:59.572 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:26:59.572 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T05:26:59.655 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836491 2026-02-17T05:26:59.655 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836491 2026-02-17T05:26:59.655 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491' 2026-02-17T05:26:59.655 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:26:59.655 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T05:26:59.735 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672970 2026-02-17T05:26:59.735 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672970 2026-02-17T05:26:59.735 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-42949672970' 2026-02-17T05:26:59.735 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:26:59.735 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T05:26:59.819 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542153 2026-02-17T05:26:59.819 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542153 2026-02-17T05:26:59.819 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-42949672970 2-60129542153' 2026-02-17T05:26:59.819 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:26:59.820 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836491 2026-02-17T05:26:59.820 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:26:59.821 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:26:59.821 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836491 2026-02-17T05:26:59.822 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:26:59.823 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836491 2026-02-17T05:26:59.823 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836491' 2026-02-17T05:26:59.823 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.0 seq 21474836491 2026-02-17T05:26:59.824 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:27:00.033 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836491 -lt 21474836491 2026-02-17T05:27:00.033 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:27:00.034 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672970 2026-02-17T05:27:00.034 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:27:00.035 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:27:00.036 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672970 2026-02-17T05:27:00.036 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:27:00.037 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672970 2026-02-17T05:27:00.037 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.1 seq 42949672970 2026-02-17T05:27:00.038 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672970' 2026-02-17T05:27:00.038 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:27:00.253 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672970 -lt 42949672970 2026-02-17T05:27:00.253 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:27:00.254 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542153 2026-02-17T05:27:00.254 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:27:00.255 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:27:00.256 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542153 2026-02-17T05:27:00.256 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:27:00.258 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542153 2026-02-17T05:27:00.258 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542153' 2026-02-17T05:27:00.258 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.2 seq 60129542153 2026-02-17T05:27:00.259 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:27:00.477 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542153 -lt 60129542153 2026-02-17T05:27:00.478 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T05:27:00.478 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:27:00.479 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:27:00.774 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T05:27:00.774 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:27:00.774 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:27:00.774 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:27:00.774 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:27:00.774 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:27:00.775 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:27:00.775 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:27:00.990 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T05:27:00.991 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:27:00.991 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:27:00.991 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:27:01.282 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T05:27:01.283 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T05:27:01.283 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T05:27:01.283 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:101: TEST_divergent: get_pg test existing_1 2026-02-17T05:27:01.284 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=test 2026-02-17T05:27:01.284 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=existing_1 2026-02-17T05:27:01.284 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map test existing_1 2026-02-17T05:27:01.284 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-17T05:27:01.509 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:101: TEST_divergent: local pgid=1.0 2026-02-17T05:27:01.510 INFO:tasks.workunit.client.0.trial030.stdout:blackholing osds 0 2 2026-02-17T05:27:01.510 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:104: TEST_divergent: echo 'blackholing osds 0 2' 2026-02-17T05:27:01.510 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:105: TEST_divergent: ceph pg dump pgs 2026-02-17T05:27:01.717 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T05:27:01.717 INFO:tasks.workunit.client.0.trial030.stdout:1.0 100 0 0 0 0 51200 0 0 16 84 16 active+clean 2026-02-17T05:26:47.825183+0000 27'100 27:124 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:26:47.528723+0000 0'0 2026-02-17T05:26:47.528723+0000 0 0 periodic scrub scheduled @ 2026-02-18T07:17:30.158820+0000 0 0 2026-02-17T05:27:01.717 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-17T05:27:01.717 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T05:27:01.717 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:27:01.727 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:106: TEST_divergent: for i in $non_divergent 2026-02-17T05:27:01.728 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: get_asok_path osd.0 2026-02-17T05:27:01.728 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-17T05:27:01.728 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-17T05:27:01.729 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T05:27:01.729 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:27:01.730 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:27:01.730 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19532/ceph-osd.0.asok 2026-02-17T05:27:01.730 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: CEPH_ARGS= 2026-02-17T05:27:01.730 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.19532/ceph-osd.0.asok config set objectstore_blackhole 1 2026-02-17T05:27:01.793 INFO:tasks.workunit.client.0.trial030.stdout:{ 2026-02-17T05:27:01.793 INFO:tasks.workunit.client.0.trial030.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-17T05:27:01.793 INFO:tasks.workunit.client.0.trial030.stdout:} 2026-02-17T05:27:01.798 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:106: TEST_divergent: for i in $non_divergent 2026-02-17T05:27:01.799 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: get_asok_path osd.2 2026-02-17T05:27:01.800 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-17T05:27:01.800 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-17T05:27:01.800 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T05:27:01.800 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:27:01.800 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:27:01.800 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19532/ceph-osd.2.asok 2026-02-17T05:27:01.801 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: CEPH_ARGS= 2026-02-17T05:27:01.801 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.19532/ceph-osd.2.asok config set objectstore_blackhole 1 2026-02-17T05:27:01.854 INFO:tasks.workunit.client.0.trial030.stdout:{ 2026-02-17T05:27:01.854 INFO:tasks.workunit.client.0.trial030.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-17T05:27:01.854 INFO:tasks.workunit.client.0.trial030.stdout:} 2026-02-17T05:27:01.859 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:111: TEST_divergent: local case5=100 2026-02-17T05:27:01.860 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:112: TEST_divergent: expr 100 - 1 2026-02-17T05:27:01.860 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:112: TEST_divergent: local case3=99 2026-02-17T05:27:01.861 INFO:tasks.workunit.client.0.trial030.stdout:writing divergent object 2026-02-17T05:27:01.861 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:114: TEST_divergent: echo 'writing divergent object' 2026-02-17T05:27:01.861 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:116: TEST_divergent: echo 'create missing divergent object' 2026-02-17T05:27:01.862 INFO:tasks.workunit.client.0.trial030.stdout:create missing divergent object 2026-02-17T05:27:01.863 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:117: TEST_divergent: inject_eio rep data test existing_99 td/divergent-priors 0 2026-02-17T05:27:01.863 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:115: TEST_divergent: rados -p test put existing_100 /tmp/tmp.8HyEvfVyHy 2026-02-17T05:27:01.863 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2480: inject_eio: local pooltype=rep 2026-02-17T05:27:01.863 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: shift 2026-02-17T05:27:01.863 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: local which=data 2026-02-17T05:27:01.863 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: shift 2026-02-17T05:27:01.863 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: local poolname=test 2026-02-17T05:27:01.864 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: shift 2026-02-17T05:27:01.864 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: local objname=existing_99 2026-02-17T05:27:01.864 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: shift 2026-02-17T05:27:01.864 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: local dir=td/divergent-priors 2026-02-17T05:27:01.864 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: shift 2026-02-17T05:27:01.864 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: local shard_id=0 2026-02-17T05:27:01.864 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: shift 2026-02-17T05:27:01.864 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: get_osds test existing_99 2026-02-17T05:27:01.864 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=test 2026-02-17T05:27:01.864 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=existing_99 2026-02-17T05:27:01.864 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map test existing_99 2026-02-17T05:27:01.864 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-17T05:27:02.082 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=1 2026-02-17T05:27:02.082 INFO:tasks.workunit.client.0.trial030.stderr:0 2026-02-17T05:27:02.082 INFO:tasks.workunit.client.0.trial030.stderr:2' 2026-02-17T05:27:02.082 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 1 0 2 2026-02-17T05:27:02.082 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: initial_osds=('1' '0' '2') 2026-02-17T05:27:02.082 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: local -a initial_osds 2026-02-17T05:27:02.082 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local osd_id=1 2026-02-17T05:27:02.082 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: '[' rep '!=' ec ']' 2026-02-17T05:27:02.082 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: shard_id= 2026-02-17T05:27:02.082 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: cat td/divergent-priors/1/type 2026-02-17T05:27:02.083 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: type=bluestore 2026-02-17T05:27:02.083 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: set_config osd 1 bluestore_debug_inject_read_err true 2026-02-17T05:27:02.083 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-17T05:27:02.084 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=1 2026-02-17T05:27:02.084 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-17T05:27:02.084 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-17T05:27:02.085 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-17T05:27:02.085 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.1 2026-02-17T05:27:02.085 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-17T05:27:02.085 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-17T05:27:02.085 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T05:27:02.085 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:27:02.085 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:27:02.086 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19532/ceph-osd.1.asok 2026-02-17T05:27:02.086 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.19532/ceph-osd.1.asok config set bluestore_debug_inject_read_err true 2026-02-17T05:27:02.149 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-17T05:27:02.149 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: local loop=0 2026-02-17T05:27:02.149 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: grep -q Invalid 2026-02-17T05:27:02.151 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: get_asok_path osd.1 2026-02-17T05:27:02.151 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-17T05:27:02.151 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-17T05:27:02.151 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T05:27:02.151 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:27:02.151 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:27:02.151 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19532/ceph-osd.1.asok 2026-02-17T05:27:02.151 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: CEPH_ARGS= 2026-02-17T05:27:02.151 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: ceph --admin-daemon /tmp/ceph-asok.19532/ceph-osd.1.asok injectdataerr test existing_99 2026-02-17T05:27:02.211 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:119: TEST_divergent: sleep 10 2026-02-17T05:27:02.211 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:118: TEST_divergent: rados -p test get existing_99 td/divergent-priors/existing 2026-02-17T05:27:12.212 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:120: TEST_divergent: killall -9 rados 2026-02-17T05:27:12.256 INFO:tasks.workunit.client.0.trial030.stderr:rados: no process found 2026-02-17T05:27:12.256 INFO:tasks.workunit.client.0.trial030.stdout:killing all the osds 2026-02-17T05:27:12.256 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:123: TEST_divergent: echo 'killing all the osds' 2026-02-17T05:27:12.256 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:124: TEST_divergent: ceph pg dump pgs 2026-02-17T05:27:12.476 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T05:27:12.477 INFO:tasks.workunit.client.0.trial030.stdout:1.0 100 0 0 0 0 51200 0 0 17 84 17 active+clean 2026-02-17T05:27:02.233211+0000 27'101 27:133 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:26:47.528723+0000 0'0 2026-02-17T05:26:47.528723+0000 0 0 periodic scrub scheduled @ 2026-02-18T07:17:30.158820+0000 0 0 2026-02-17T05:27:12.477 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-17T05:27:12.477 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T05:27:12.477 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:27:12.487 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:125: TEST_divergent: kill_daemons td/divergent-priors KILL osd 2026-02-17T05:27:12.488 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:27:12.488 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:27:12.489 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:27:12.489 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:27:12.489 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:27:12.597 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:27:12.598 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:126: TEST_divergent: for i in $osds 2026-02-17T05:27:12.598 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:128: TEST_divergent: ceph osd down osd.0 2026-02-17T05:27:12.843 INFO:tasks.workunit.client.0.trial030.stderr:osd.0 is already down. 2026-02-17T05:27:12.853 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:126: TEST_divergent: for i in $osds 2026-02-17T05:27:12.853 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:128: TEST_divergent: ceph osd down osd.1 2026-02-17T05:27:13.135 INFO:tasks.workunit.client.0.trial030.stderr:osd.1 is already down. 2026-02-17T05:27:13.145 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:126: TEST_divergent: for i in $osds 2026-02-17T05:27:13.145 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:128: TEST_divergent: ceph osd down osd.2 2026-02-17T05:27:13.424 INFO:tasks.workunit.client.0.trial030.stderr:osd.2 is already down. 2026-02-17T05:27:13.435 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:130: TEST_divergent: for i in $non_divergent 2026-02-17T05:27:13.435 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:132: TEST_divergent: ceph osd out osd.0 2026-02-17T05:27:13.710 INFO:tasks.workunit.client.0.trial030.stderr:osd.0 is already out. 2026-02-17T05:27:13.721 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:130: TEST_divergent: for i in $non_divergent 2026-02-17T05:27:13.721 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:132: TEST_divergent: ceph osd out osd.2 2026-02-17T05:27:14.011 INFO:tasks.workunit.client.0.trial030.stderr:osd.2 is already out. 2026-02-17T05:27:14.022 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:136: TEST_divergent: echo 'bringing up non_divergent 0 2' 2026-02-17T05:27:14.022 INFO:tasks.workunit.client.0.trial030.stdout:bringing up non_divergent 0 2 2026-02-17T05:27:14.022 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:137: TEST_divergent: ceph pg dump pgs 2026-02-17T05:27:14.231 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T05:27:14.232 INFO:tasks.workunit.client.0.trial030.stdout:1.0 100 0 0 0 0 51200 0 0 17 84 17 stale+active+clean 2026-02-17T05:27:02.233211+0000 27'101 27:133 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:26:47.528723+0000 0'0 2026-02-17T05:26:47.528723+0000 0 0 periodic scrub scheduled @ 2026-02-18T07:17:30.158820+0000 0 0 2026-02-17T05:27:14.232 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-17T05:27:14.232 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T05:27:14.232 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:27:14.244 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:138: TEST_divergent: for i in $non_divergent 2026-02-17T05:27:14.244 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:140: TEST_divergent: activate_osd td/divergent-priors 0 2026-02-17T05:27:14.244 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-17T05:27:14.244 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T05:27:14.244 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T05:27:14.244 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T05:27:14.245 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/0 2026-02-17T05:27:14.245 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T05:27:14.245 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:27:14.245 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:27:14.245 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:27:14.245 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-17T05:27:14.245 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-17T05:27:14.245 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T05:27:14.245 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T05:27:14.246 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T05:27:14.246 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T05:27:14.246 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:27:14.246 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:27:14.246 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:27:14.246 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:27:14.246 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:27:14.246 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:27:14.246 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:27:14.246 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:27:14.246 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T05:27:14.246 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T05:27:14.247 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:27:14.247 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:27:14.247 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:27:14.247 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:27:14.247 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T05:27:14.247 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T05:27:14.247 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/0 2026-02-17T05:27:14.248 INFO:tasks.workunit.client.0.trial030.stdout:start osd.0 2026-02-17T05:27:14.249 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T05:27:14.249 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T05:27:14.249 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/0/whoami 2026-02-17T05:27:14.249 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T05:27:14.249 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T05:27:14.249 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T05:27:14.249 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T05:27:14.272 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:27:14.268+0000 7f62bd3c7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:27:14.273 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:27:14.268+0000 7f62bd3c7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:27:14.274 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:27:14.268+0000 7f62bd3c7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:27:14.471 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T05:27:14.471 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:27:14.471 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T05:27:14.471 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:27:14.471 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:27:14.471 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:27:14.472 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:27:14.472 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:27:14.473 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:27:14.473 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T05:27:14.689 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:27:14.761 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:27:14.756+0000 7f62bd3c7a40 -1 Falling back to public interface 2026-02-17T05:27:15.402 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:27:15.396+0000 7f62bd3c7a40 -1 osd.0 27 log_to_monitors true 2026-02-17T05:27:15.691 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:27:15.691 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:27:15.691 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T05:27:15.691 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-17T05:27:15.692 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:27:15.692 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T05:27:15.910 INFO:tasks.workunit.client.0.trial030.stdout:osd.0 up out weight 0 up_from 34 up_thru 0 down_at 28 last_clean_interval [5,27) [v2:127.0.0.1:6800/1366271510,v1:127.0.0.1:6801/1366271510] [v2:127.0.0.1:6802/1366271510,v1:127.0.0.1:6803/1366271510] exists,up 352e74ee-ecc2-4670-94d6-94c5b9b5c4be 2026-02-17T05:27:15.912 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:27:15.912 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:27:15.912 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:27:15.912 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:138: TEST_divergent: for i in $non_divergent 2026-02-17T05:27:15.912 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:140: TEST_divergent: activate_osd td/divergent-priors 2 2026-02-17T05:27:15.912 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-17T05:27:15.913 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T05:27:15.913 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-17T05:27:15.913 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T05:27:15.913 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/2 2026-02-17T05:27:15.913 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T05:27:15.913 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:27:15.913 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:27:15.913 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:27:15.913 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-17T05:27:15.913 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-17T05:27:15.913 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T05:27:15.913 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T05:27:15.913 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T05:27:15.913 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T05:27:15.913 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:27:15.914 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:27:15.914 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:27:15.914 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:27:15.914 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:27:15.914 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:27:15.914 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:27:15.914 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:27:15.914 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T05:27:15.914 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T05:27:15.914 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:27:15.914 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:27:15.914 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:27:15.914 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:27:15.914 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T05:27:15.915 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T05:27:15.915 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/2 2026-02-17T05:27:15.915 INFO:tasks.workunit.client.0.trial030.stdout:start osd.2 2026-02-17T05:27:15.916 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-17T05:27:15.916 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T05:27:15.916 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/2/whoami 2026-02-17T05:27:15.916 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-17T05:27:15.916 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T05:27:15.916 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T05:27:15.917 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T05:27:15.939 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:27:15.936+0000 7f65a59cba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:27:15.941 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:27:15.936+0000 7f65a59cba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:27:15.942 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:27:15.936+0000 7f65a59cba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:27:16.127 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-17T05:27:16.127 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:27:16.127 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T05:27:16.128 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:27:16.128 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:27:16.128 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:27:16.129 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:27:16.129 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:27:16.129 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:27:16.129 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T05:27:16.355 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:27:16.364 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:27:16.360+0000 7f65a59cba40 -1 Falling back to public interface 2026-02-17T05:27:17.008 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:27:17.004+0000 7f65a59cba40 -1 osd.2 27 log_to_monitors true 2026-02-17T05:27:17.356 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:27:17.357 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:27:17.357 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-17T05:27:17.358 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T05:27:17.359 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:27:17.359 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T05:27:17.577 INFO:tasks.workunit.client.0.trial030.stdout:osd.2 up out weight 0 up_from 36 up_thru 0 down_at 30 last_clean_interval [14,27) [v2:127.0.0.1:6810/2487313544,v1:127.0.0.1:6811/2487313544] [v2:127.0.0.1:6812/2487313544,v1:127.0.0.1:6813/2487313544] exists,up e4a4420b-77ab-4a4b-a531-61a8b5f39ca2 2026-02-17T05:27:17.577 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:27:17.577 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:27:17.577 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:27:17.577 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:142: TEST_divergent: for i in $non_divergent 2026-02-17T05:27:17.577 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:144: TEST_divergent: ceph osd in osd.0 2026-02-17T05:27:17.826 INFO:tasks.workunit.client.0.trial030.stderr:osd.0 is already in. 2026-02-17T05:27:17.836 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:142: TEST_divergent: for i in $non_divergent 2026-02-17T05:27:17.836 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:144: TEST_divergent: ceph osd in osd.2 2026-02-17T05:27:18.113 INFO:tasks.workunit.client.0.trial030.stderr:osd.2 is already in. 2026-02-17T05:27:18.124 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:147: TEST_divergent: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-17T05:27:18.124 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:147: TEST_divergent: wait_for_clean 2026-02-17T05:27:18.125 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T05:27:18.125 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T05:27:18.125 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T05:27:18.125 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-17T05:27:18.126 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T05:27:18.126 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T05:27:18.126 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T05:27:18.126 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T05:27:18.126 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T05:27:18.187 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-17T05:27:18.187 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T05:27:18.187 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T05:27:18.187 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T05:27:18.187 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T05:27:18.187 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:27:18.407 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:27:18.408 INFO:tasks.workunit.client.0.trial030.stderr:1 2026-02-17T05:27:18.408 INFO:tasks.workunit.client.0.trial030.stderr:2' 2026-02-17T05:27:18.408 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:27:18.408 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:27:18.408 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T05:27:18.488 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=146028888067 2026-02-17T05:27:18.489 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 146028888067 2026-02-17T05:27:18.489 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-146028888067' 2026-02-17T05:27:18.489 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:27:18.489 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T05:27:18.553 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-17T05:27:18.553 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: true 2026-02-17T05:27:18.553 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-17T05:27:18.553 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: continue 2026-02-17T05:27:18.553 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:27:18.553 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T05:27:18.634 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=154618822659 2026-02-17T05:27:18.634 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 154618822659 2026-02-17T05:27:18.634 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-146028888067 2-154618822659' 2026-02-17T05:27:18.634 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:27:18.635 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-146028888067 2026-02-17T05:27:18.635 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:27:18.636 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:27:18.636 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-146028888067 2026-02-17T05:27:18.637 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:27:18.638 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=146028888067 2026-02-17T05:27:18.638 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 146028888067' 2026-02-17T05:27:18.638 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.0 seq 146028888067 2026-02-17T05:27:18.639 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:27:18.862 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 146028888067 2026-02-17T05:27:18.862 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:27:19.863 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T05:27:19.864 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:27:20.081 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 146028888067 -lt 146028888067 2026-02-17T05:27:20.081 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:27:20.082 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-154618822659 2026-02-17T05:27:20.082 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:27:20.083 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:27:20.084 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-154618822659 2026-02-17T05:27:20.084 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:27:20.086 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=154618822659 2026-02-17T05:27:20.086 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 154618822659' 2026-02-17T05:27:20.086 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.2 seq 154618822659 2026-02-17T05:27:20.086 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:27:20.321 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 154618822659 -lt 154618822659 2026-02-17T05:27:20.322 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T05:27:20.323 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:27:20.323 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:27:20.615 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T05:27:20.615 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:27:20.615 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:27:20.615 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:27:20.615 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:27:20.615 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:27:20.616 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:27:20.616 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:27:20.835 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:27:20.835 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:27:20.836 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:27:20.836 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:27:21.131 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T05:27:21.131 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-17T05:27:21.132 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-17T05:27:21.132 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-17T05:27:21.132 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T05:27:21.132 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-17T05:27:21.233 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T05:27:21.233 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:27:21.233 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:27:21.233 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:27:21.233 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:27:21.233 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:27:21.233 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:27:21.233 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:27:21.458 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:27:21.458 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:27:21.459 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:27:21.459 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:27:21.743 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T05:27:21.743 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T05:27:21.743 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T05:27:21.743 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T05:27:21.743 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T05:27:21.743 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T05:27:21.743 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T05:27:21.743 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T05:27:21.744 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T05:27:22.035 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T05:27:22.035 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T05:27:22.035 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-17T05:27:22.035 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T05:27:22.035 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-17T05:27:22.237 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T05:27:22.237 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:27:22.237 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:27:22.237 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:27:22.237 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:27:22.237 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:27:22.238 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:27:22.238 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:27:22.456 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:27:22.456 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:27:22.457 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:27:22.457 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:27:22.754 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T05:27:22.754 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T05:27:22.754 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T05:27:22.754 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T05:27:22.754 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T05:27:22.754 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T05:27:22.754 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T05:27:22.754 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T05:27:22.754 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T05:27:23.052 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T05:27:23.053 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T05:27:23.053 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-17T05:27:23.053 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T05:27:23.053 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-17T05:27:23.453 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T05:27:23.453 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:27:23.454 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:27:23.454 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:27:23.454 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:27:23.455 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:27:23.455 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:27:23.455 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:27:23.672 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:27:23.673 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:27:23.673 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:27:23.673 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:27:23.972 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T05:27:23.972 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T05:27:23.972 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T05:27:23.973 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T05:27:23.973 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T05:27:23.973 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T05:27:23.973 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T05:27:23.973 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T05:27:23.973 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T05:27:24.268 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T05:27:24.268 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T05:27:24.268 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-17T05:27:24.268 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T05:27:24.268 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-17T05:27:25.068 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T05:27:25.069 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:27:25.070 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:27:25.070 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:27:25.070 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:27:25.070 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:27:25.070 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:27:25.070 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:27:25.290 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:27:25.291 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:27:25.291 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:27:25.291 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:27:25.588 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T05:27:25.588 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T05:27:25.588 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T05:27:25.589 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T05:27:25.589 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T05:27:25.589 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T05:27:25.589 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T05:27:25.589 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T05:27:25.589 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T05:27:25.876 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T05:27:25.876 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T05:27:25.876 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-17T05:27:25.876 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T05:27:25.877 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-17T05:27:27.479 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T05:27:27.479 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:27:27.479 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:27:27.479 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:27:27.479 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:27:27.480 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:27:27.480 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:27:27.480 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:27:27.688 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:27:27.688 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:27:27.688 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:27:27.688 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:27:27.975 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T05:27:27.975 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T05:27:27.975 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T05:27:27.975 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T05:27:27.975 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T05:27:27.975 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T05:27:27.975 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T05:27:27.975 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T05:27:27.975 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T05:27:28.268 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T05:27:28.268 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T05:27:28.268 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-17T05:27:28.268 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T05:27:28.268 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-17T05:27:31.469 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T05:27:31.470 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:27:31.470 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:27:31.470 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:27:31.470 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:27:31.470 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:27:31.470 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:27:31.471 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:27:31.684 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:27:31.684 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:27:31.685 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:27:31.685 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:27:31.981 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T05:27:31.981 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T05:27:31.982 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T05:27:31.982 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T05:27:31.982 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T05:27:31.982 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T05:27:31.982 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T05:27:31.982 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T05:27:31.982 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T05:27:32.282 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T05:27:32.282 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T05:27:32.282 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-17T05:27:32.282 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T05:27:32.282 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-17T05:27:38.682 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T05:27:38.682 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:27:38.683 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:27:38.683 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:27:38.683 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:27:38.683 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:27:38.683 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:27:38.683 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:27:38.900 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:27:38.900 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:27:38.901 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:27:38.901 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:27:39.189 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T05:27:39.189 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T05:27:39.189 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T05:27:39.189 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T05:27:39.189 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T05:27:39.190 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T05:27:39.190 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T05:27:39.190 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T05:27:39.190 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T05:27:39.478 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T05:27:39.478 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T05:27:39.478 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-17T05:27:39.478 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T05:27:39.478 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-17T05:27:46.779 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T05:27:46.779 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:27:46.779 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:27:46.779 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:27:46.779 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:27:46.779 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:27:46.780 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:27:46.780 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:27:46.994 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:27:46.995 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:27:46.995 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:27:46.995 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:27:47.278 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T05:27:47.278 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T05:27:47.278 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T05:27:47.279 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T05:27:47.279 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T05:27:47.279 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T05:27:47.279 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T05:27:47.279 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T05:27:47.279 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T05:27:47.564 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T05:27:47.564 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T05:27:47.565 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-17T05:27:47.565 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-17T05:27:47.858 INFO:tasks.workunit.client.0.trial030.stdout:{ 2026-02-17T05:27:47.858 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_fingerprint": "66dfa952-9d2c-47e5-89de-478d897c73d8", 2026-02-17T05:27:47.858 INFO:tasks.workunit.client.0.trial030.stdout: "version": "20.3.0-5271-g32585015", 2026-02-17T05:27:47.858 INFO:tasks.workunit.client.0.trial030.stdout: "commit": "325850157d309f65985eea9ec9bb9f1d56726fee", 2026-02-17T05:27:47.858 INFO:tasks.workunit.client.0.trial030.stdout: "timestamp": "2026-02-17T05:27:47.856379+0000", 2026-02-17T05:27:47.858 INFO:tasks.workunit.client.0.trial030.stdout: "tag": "", 2026-02-17T05:27:47.858 INFO:tasks.workunit.client.0.trial030.stdout: "health": { 2026-02-17T05:27:47.859 INFO:tasks.workunit.client.0.trial030.stdout: "status": "HEALTH_WARN", 2026-02-17T05:27:47.859 INFO:tasks.workunit.client.0.trial030.stdout: "checks": { 2026-02-17T05:27:47.859 INFO:tasks.workunit.client.0.trial030.stdout: "OSDMAP_FLAGS": { 2026-02-17T05:27:47.859 INFO:tasks.workunit.client.0.trial030.stdout: "severity": "HEALTH_WARN", 2026-02-17T05:27:47.859 INFO:tasks.workunit.client.0.trial030.stdout: "summary": { 2026-02-17T05:27:47.859 INFO:tasks.workunit.client.0.trial030.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-17T05:27:47.859 INFO:tasks.workunit.client.0.trial030.stdout: "count": 17 2026-02-17T05:27:47.859 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.859 INFO:tasks.workunit.client.0.trial030.stdout: "detail": [], 2026-02-17T05:27:47.859 INFO:tasks.workunit.client.0.trial030.stdout: "muted": false 2026-02-17T05:27:47.859 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.860 INFO:tasks.workunit.client.0.trial030.stdout: "OSD_DOWN": { 2026-02-17T05:27:47.860 INFO:tasks.workunit.client.0.trial030.stdout: "severity": "HEALTH_WARN", 2026-02-17T05:27:47.860 INFO:tasks.workunit.client.0.trial030.stdout: "summary": { 2026-02-17T05:27:47.860 INFO:tasks.workunit.client.0.trial030.stdout: "message": "1 osds down", 2026-02-17T05:27:47.860 INFO:tasks.workunit.client.0.trial030.stdout: "count": 1 2026-02-17T05:27:47.860 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.860 INFO:tasks.workunit.client.0.trial030.stdout: "detail": [ 2026-02-17T05:27:47.860 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.860 INFO:tasks.workunit.client.0.trial030.stdout: "message": "osd.1 (root=default,host=trial030) is down" 2026-02-17T05:27:47.860 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:27:47.860 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:27:47.860 INFO:tasks.workunit.client.0.trial030.stdout: "muted": false 2026-02-17T05:27:47.861 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.861 INFO:tasks.workunit.client.0.trial030.stdout: "PG_DEGRADED": { 2026-02-17T05:27:47.861 INFO:tasks.workunit.client.0.trial030.stdout: "severity": "HEALTH_WARN", 2026-02-17T05:27:47.861 INFO:tasks.workunit.client.0.trial030.stdout: "summary": { 2026-02-17T05:27:47.861 INFO:tasks.workunit.client.0.trial030.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 1 pg degraded", 2026-02-17T05:27:47.861 INFO:tasks.workunit.client.0.trial030.stdout: "count": 1 2026-02-17T05:27:47.861 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.861 INFO:tasks.workunit.client.0.trial030.stdout: "detail": [ 2026-02-17T05:27:47.861 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.861 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [0,2]" 2026-02-17T05:27:47.861 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:27:47.861 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:27:47.861 INFO:tasks.workunit.client.0.trial030.stdout: "muted": false 2026-02-17T05:27:47.862 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:27:47.862 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.862 INFO:tasks.workunit.client.0.trial030.stdout: "mutes": [] 2026-02-17T05:27:47.862 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.862 INFO:tasks.workunit.client.0.trial030.stdout: "monmap_first_committed": 1, 2026-02-17T05:27:47.862 INFO:tasks.workunit.client.0.trial030.stdout: "monmap_last_committed": 1, 2026-02-17T05:27:47.862 INFO:tasks.workunit.client.0.trial030.stdout: "monmap": { 2026-02-17T05:27:47.862 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 1, 2026-02-17T05:27:47.862 INFO:tasks.workunit.client.0.trial030.stdout: "fsid": "931b36d9-02d4-44f0-bc8b-c9190b7fdb00", 2026-02-17T05:27:47.862 INFO:tasks.workunit.client.0.trial030.stdout: "modified": "2026-02-17T05:26:35.338685Z", 2026-02-17T05:27:47.862 INFO:tasks.workunit.client.0.trial030.stdout: "created": "2026-02-17T05:26:35.338685Z", 2026-02-17T05:27:47.862 INFO:tasks.workunit.client.0.trial030.stdout: "min_mon_release": 20, 2026-02-17T05:27:47.863 INFO:tasks.workunit.client.0.trial030.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:27:47.863 INFO:tasks.workunit.client.0.trial030.stdout: "election_strategy": 1, 2026-02-17T05:27:47.863 INFO:tasks.workunit.client.0.trial030.stdout: "disallowed_leaders": "", 2026-02-17T05:27:47.863 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_mode": false, 2026-02-17T05:27:47.863 INFO:tasks.workunit.client.0.trial030.stdout: "tiebreaker_mon": "", 2026-02-17T05:27:47.863 INFO:tasks.workunit.client.0.trial030.stdout: "removed_ranks": "", 2026-02-17T05:27:47.863 INFO:tasks.workunit.client.0.trial030.stdout: "features": { 2026-02-17T05:27:47.863 INFO:tasks.workunit.client.0.trial030.stdout: "persistent": [ 2026-02-17T05:27:47.863 INFO:tasks.workunit.client.0.trial030.stdout: "kraken", 2026-02-17T05:27:47.863 INFO:tasks.workunit.client.0.trial030.stdout: "luminous", 2026-02-17T05:27:47.863 INFO:tasks.workunit.client.0.trial030.stdout: "mimic", 2026-02-17T05:27:47.864 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap-prune", 2026-02-17T05:27:47.864 INFO:tasks.workunit.client.0.trial030.stdout: "nautilus", 2026-02-17T05:27:47.864 INFO:tasks.workunit.client.0.trial030.stdout: "octopus", 2026-02-17T05:27:47.864 INFO:tasks.workunit.client.0.trial030.stdout: "pacific", 2026-02-17T05:27:47.864 INFO:tasks.workunit.client.0.trial030.stdout: "elector-pinging", 2026-02-17T05:27:47.864 INFO:tasks.workunit.client.0.trial030.stdout: "quincy", 2026-02-17T05:27:47.864 INFO:tasks.workunit.client.0.trial030.stdout: "reef", 2026-02-17T05:27:47.864 INFO:tasks.workunit.client.0.trial030.stdout: "squid", 2026-02-17T05:27:47.865 INFO:tasks.workunit.client.0.trial030.stdout: "tentacle", 2026-02-17T05:27:47.865 INFO:tasks.workunit.client.0.trial030.stdout: "nvmeof_beacon_diff" 2026-02-17T05:27:47.865 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:27:47.865 INFO:tasks.workunit.client.0.trial030.stdout: "optional": [] 2026-02-17T05:27:47.865 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.865 INFO:tasks.workunit.client.0.trial030.stdout: "mons": [ 2026-02-17T05:27:47.865 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.865 INFO:tasks.workunit.client.0.trial030.stdout: "rank": 0, 2026-02-17T05:27:47.865 INFO:tasks.workunit.client.0.trial030.stdout: "name": "a", 2026-02-17T05:27:47.865 INFO:tasks.workunit.client.0.trial030.stdout: "public_addrs": { 2026-02-17T05:27:47.866 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:27:47.866 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.866 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:27:47.866 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:7115", 2026-02-17T05:27:47.866 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 0 2026-02-17T05:27:47.866 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:27:47.866 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:27:47.866 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.866 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:7115/0", 2026-02-17T05:27:47.866 INFO:tasks.workunit.client.0.trial030.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-17T05:27:47.866 INFO:tasks.workunit.client.0.trial030.stdout: "priority": 0, 2026-02-17T05:27:47.867 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 0, 2026-02-17T05:27:47.867 INFO:tasks.workunit.client.0.trial030.stdout: "time_added": "2026-02-17T05:26:35:338683+0000", 2026-02-17T05:27:47.867 INFO:tasks.workunit.client.0.trial030.stdout: "crush_location": [] 2026-02-17T05:27:47.867 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:27:47.867 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:27:47.867 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.867 INFO:tasks.workunit.client.0.trial030.stdout: "quorum": [ 2026-02-17T05:27:47.867 INFO:tasks.workunit.client.0.trial030.stdout: 0 2026-02-17T05:27:47.867 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:27:47.867 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap": { 2026-02-17T05:27:47.867 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 39, 2026-02-17T05:27:47.868 INFO:tasks.workunit.client.0.trial030.stdout: "fsid": "931b36d9-02d4-44f0-bc8b-c9190b7fdb00", 2026-02-17T05:27:47.868 INFO:tasks.workunit.client.0.trial030.stdout: "created": "2026-02-17T05:26:35.419611+0000", 2026-02-17T05:27:47.868 INFO:tasks.workunit.client.0.trial030.stdout: "modified": "2026-02-17T05:27:18.157751+0000", 2026-02-17T05:27:47.868 INFO:tasks.workunit.client.0.trial030.stdout: "last_up_change": "2026-02-17T05:27:17.162970+0000", 2026-02-17T05:27:47.868 INFO:tasks.workunit.client.0.trial030.stdout: "last_in_change": "2026-02-17T05:27:18.055527+0000", 2026-02-17T05:27:47.868 INFO:tasks.workunit.client.0.trial030.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-17T05:27:47.868 INFO:tasks.workunit.client.0.trial030.stdout: "flags_num": 5800384, 2026-02-17T05:27:47.868 INFO:tasks.workunit.client.0.trial030.stdout: "flags_set": [ 2026-02-17T05:27:47.868 INFO:tasks.workunit.client.0.trial030.stdout: "nodown", 2026-02-17T05:27:47.868 INFO:tasks.workunit.client.0.trial030.stdout: "noin", 2026-02-17T05:27:47.869 INFO:tasks.workunit.client.0.trial030.stdout: "noout", 2026-02-17T05:27:47.869 INFO:tasks.workunit.client.0.trial030.stdout: "pglog_hardlimit", 2026-02-17T05:27:47.869 INFO:tasks.workunit.client.0.trial030.stdout: "purged_snapdirs", 2026-02-17T05:27:47.869 INFO:tasks.workunit.client.0.trial030.stdout: "recovery_deletes", 2026-02-17T05:27:47.869 INFO:tasks.workunit.client.0.trial030.stdout: "sortbitwise" 2026-02-17T05:27:47.869 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:27:47.869 INFO:tasks.workunit.client.0.trial030.stdout: "crush_version": 9, 2026-02-17T05:27:47.869 INFO:tasks.workunit.client.0.trial030.stdout: "full_ratio": 0.99000000953674316, 2026-02-17T05:27:47.869 INFO:tasks.workunit.client.0.trial030.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-17T05:27:47.869 INFO:tasks.workunit.client.0.trial030.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-17T05:27:47.869 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_snapshot": "", 2026-02-17T05:27:47.870 INFO:tasks.workunit.client.0.trial030.stdout: "pool_max": 1, 2026-02-17T05:27:47.870 INFO:tasks.workunit.client.0.trial030.stdout: "max_osd": 3, 2026-02-17T05:27:47.870 INFO:tasks.workunit.client.0.trial030.stdout: "require_min_compat_client": "luminous", 2026-02-17T05:27:47.870 INFO:tasks.workunit.client.0.trial030.stdout: "min_compat_client": "jewel", 2026-02-17T05:27:47.870 INFO:tasks.workunit.client.0.trial030.stdout: "require_osd_release": "tentacle", 2026-02-17T05:27:47.870 INFO:tasks.workunit.client.0.trial030.stdout: "allow_crimson": false, 2026-02-17T05:27:47.870 INFO:tasks.workunit.client.0.trial030.stdout: "pools": [ 2026-02-17T05:27:47.870 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.870 INFO:tasks.workunit.client.0.trial030.stdout: "pool": 1, 2026-02-17T05:27:47.870 INFO:tasks.workunit.client.0.trial030.stdout: "pool_name": "test", 2026-02-17T05:27:47.870 INFO:tasks.workunit.client.0.trial030.stdout: "create_time": "2026-02-17T05:26:47.507932+0000", 2026-02-17T05:27:47.871 INFO:tasks.workunit.client.0.trial030.stdout: "flags": 1, 2026-02-17T05:27:47.871 INFO:tasks.workunit.client.0.trial030.stdout: "flags_names": "hashpspool", 2026-02-17T05:27:47.871 INFO:tasks.workunit.client.0.trial030.stdout: "type": 1, 2026-02-17T05:27:47.871 INFO:tasks.workunit.client.0.trial030.stdout: "size": 3, 2026-02-17T05:27:47.871 INFO:tasks.workunit.client.0.trial030.stdout: "min_size": 2, 2026-02-17T05:27:47.871 INFO:tasks.workunit.client.0.trial030.stdout: "crush_rule": 0, 2026-02-17T05:27:47.871 INFO:tasks.workunit.client.0.trial030.stdout: "peering_crush_bucket_count": 0, 2026-02-17T05:27:47.871 INFO:tasks.workunit.client.0.trial030.stdout: "peering_crush_bucket_target": 0, 2026-02-17T05:27:47.871 INFO:tasks.workunit.client.0.trial030.stdout: "peering_crush_bucket_barrier": 0, 2026-02-17T05:27:47.871 INFO:tasks.workunit.client.0.trial030.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-17T05:27:47.871 INFO:tasks.workunit.client.0.trial030.stdout: "is_stretch_pool": false, 2026-02-17T05:27:47.871 INFO:tasks.workunit.client.0.trial030.stdout: "object_hash": 2, 2026-02-17T05:27:47.872 INFO:tasks.workunit.client.0.trial030.stdout: "pg_autoscale_mode": "off", 2026-02-17T05:27:47.872 INFO:tasks.workunit.client.0.trial030.stdout: "pg_num": 1, 2026-02-17T05:27:47.872 INFO:tasks.workunit.client.0.trial030.stdout: "pg_placement_num": 1, 2026-02-17T05:27:47.872 INFO:tasks.workunit.client.0.trial030.stdout: "pg_placement_num_target": 1, 2026-02-17T05:27:47.872 INFO:tasks.workunit.client.0.trial030.stdout: "pg_num_target": 1, 2026-02-17T05:27:47.872 INFO:tasks.workunit.client.0.trial030.stdout: "pg_num_pending": 1, 2026-02-17T05:27:47.872 INFO:tasks.workunit.client.0.trial030.stdout: "last_pg_merge_meta": { 2026-02-17T05:27:47.872 INFO:tasks.workunit.client.0.trial030.stdout: "source_pgid": "0.0", 2026-02-17T05:27:47.872 INFO:tasks.workunit.client.0.trial030.stdout: "ready_epoch": 0, 2026-02-17T05:27:47.872 INFO:tasks.workunit.client.0.trial030.stdout: "last_epoch_started": 0, 2026-02-17T05:27:47.872 INFO:tasks.workunit.client.0.trial030.stdout: "last_epoch_clean": 0, 2026-02-17T05:27:47.872 INFO:tasks.workunit.client.0.trial030.stdout: "source_version": "0'0", 2026-02-17T05:27:47.872 INFO:tasks.workunit.client.0.trial030.stdout: "target_version": "0'0" 2026-02-17T05:27:47.872 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.873 INFO:tasks.workunit.client.0.trial030.stdout: "last_change": "27", 2026-02-17T05:27:47.873 INFO:tasks.workunit.client.0.trial030.stdout: "last_force_op_resend": "0", 2026-02-17T05:27:47.873 INFO:tasks.workunit.client.0.trial030.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-17T05:27:47.873 INFO:tasks.workunit.client.0.trial030.stdout: "last_force_op_resend_preluminous": "0", 2026-02-17T05:27:47.873 INFO:tasks.workunit.client.0.trial030.stdout: "auid": 0, 2026-02-17T05:27:47.873 INFO:tasks.workunit.client.0.trial030.stdout: "snap_mode": "selfmanaged", 2026-02-17T05:27:47.873 INFO:tasks.workunit.client.0.trial030.stdout: "snap_seq": 0, 2026-02-17T05:27:47.873 INFO:tasks.workunit.client.0.trial030.stdout: "snap_epoch": 0, 2026-02-17T05:27:47.873 INFO:tasks.workunit.client.0.trial030.stdout: "pool_snaps": [], 2026-02-17T05:27:47.873 INFO:tasks.workunit.client.0.trial030.stdout: "removed_snaps": "[]", 2026-02-17T05:27:47.873 INFO:tasks.workunit.client.0.trial030.stdout: "quota_max_bytes": 0, 2026-02-17T05:27:47.873 INFO:tasks.workunit.client.0.trial030.stdout: "quota_max_objects": 0, 2026-02-17T05:27:47.873 INFO:tasks.workunit.client.0.trial030.stdout: "tiers": [], 2026-02-17T05:27:47.874 INFO:tasks.workunit.client.0.trial030.stdout: "tier_of": -1, 2026-02-17T05:27:47.874 INFO:tasks.workunit.client.0.trial030.stdout: "read_tier": -1, 2026-02-17T05:27:47.874 INFO:tasks.workunit.client.0.trial030.stdout: "write_tier": -1, 2026-02-17T05:27:47.874 INFO:tasks.workunit.client.0.trial030.stdout: "cache_mode": "none", 2026-02-17T05:27:47.874 INFO:tasks.workunit.client.0.trial030.stdout: "target_max_bytes": 0, 2026-02-17T05:27:47.874 INFO:tasks.workunit.client.0.trial030.stdout: "target_max_objects": 0, 2026-02-17T05:27:47.874 INFO:tasks.workunit.client.0.trial030.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-17T05:27:47.874 INFO:tasks.workunit.client.0.trial030.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-17T05:27:47.874 INFO:tasks.workunit.client.0.trial030.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-17T05:27:47.875 INFO:tasks.workunit.client.0.trial030.stdout: "cache_min_flush_age": 0, 2026-02-17T05:27:47.875 INFO:tasks.workunit.client.0.trial030.stdout: "cache_min_evict_age": 0, 2026-02-17T05:27:47.875 INFO:tasks.workunit.client.0.trial030.stdout: "erasure_code_profile": "", 2026-02-17T05:27:47.875 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_params": { 2026-02-17T05:27:47.875 INFO:tasks.workunit.client.0.trial030.stdout: "type": "none" 2026-02-17T05:27:47.875 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.875 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_period": 0, 2026-02-17T05:27:47.875 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_count": 0, 2026-02-17T05:27:47.875 INFO:tasks.workunit.client.0.trial030.stdout: "use_gmt_hitset": true, 2026-02-17T05:27:47.875 INFO:tasks.workunit.client.0.trial030.stdout: "min_read_recency_for_promote": 0, 2026-02-17T05:27:47.876 INFO:tasks.workunit.client.0.trial030.stdout: "min_write_recency_for_promote": 0, 2026-02-17T05:27:47.876 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_grade_decay_rate": 0, 2026-02-17T05:27:47.876 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_search_last_n": 0, 2026-02-17T05:27:47.876 INFO:tasks.workunit.client.0.trial030.stdout: "grade_table": [], 2026-02-17T05:27:47.876 INFO:tasks.workunit.client.0.trial030.stdout: "stripe_width": 0, 2026-02-17T05:27:47.876 INFO:tasks.workunit.client.0.trial030.stdout: "expected_num_objects": 0, 2026-02-17T05:27:47.876 INFO:tasks.workunit.client.0.trial030.stdout: "fast_read": false, 2026-02-17T05:27:47.876 INFO:tasks.workunit.client.0.trial030.stdout: "nonprimary_shards": "{}", 2026-02-17T05:27:47.876 INFO:tasks.workunit.client.0.trial030.stdout: "options": {}, 2026-02-17T05:27:47.876 INFO:tasks.workunit.client.0.trial030.stdout: "application_metadata": {}, 2026-02-17T05:27:47.876 INFO:tasks.workunit.client.0.trial030.stdout: "read_balance": { 2026-02-17T05:27:47.877 INFO:tasks.workunit.client.0.trial030.stdout: "score_type": "Fair distribution", 2026-02-17T05:27:47.877 INFO:tasks.workunit.client.0.trial030.stdout: "score_acting": 2.9900000095367432, 2026-02-17T05:27:47.877 INFO:tasks.workunit.client.0.trial030.stdout: "score_stable": 2.9900000095367432, 2026-02-17T05:27:47.877 INFO:tasks.workunit.client.0.trial030.stdout: "optimal_score": 0.67000001668930054, 2026-02-17T05:27:47.877 INFO:tasks.workunit.client.0.trial030.stdout: "raw_score_acting": 2, 2026-02-17T05:27:47.877 INFO:tasks.workunit.client.0.trial030.stdout: "raw_score_stable": 2, 2026-02-17T05:27:47.877 INFO:tasks.workunit.client.0.trial030.stdout: "primary_affinity_weighted": 1, 2026-02-17T05:27:47.877 INFO:tasks.workunit.client.0.trial030.stdout: "average_primary_affinity": 1, 2026-02-17T05:27:47.877 INFO:tasks.workunit.client.0.trial030.stdout: "average_primary_affinity_weighted": 1 2026-02-17T05:27:47.877 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:27:47.877 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:27:47.877 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:27:47.878 INFO:tasks.workunit.client.0.trial030.stdout: "osds": [ 2026-02-17T05:27:47.878 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.878 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 0, 2026-02-17T05:27:47.878 INFO:tasks.workunit.client.0.trial030.stdout: "uuid": "352e74ee-ecc2-4670-94d6-94c5b9b5c4be", 2026-02-17T05:27:47.878 INFO:tasks.workunit.client.0.trial030.stdout: "up": 1, 2026-02-17T05:27:47.878 INFO:tasks.workunit.client.0.trial030.stdout: "in": 1, 2026-02-17T05:27:47.878 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 1, 2026-02-17T05:27:47.878 INFO:tasks.workunit.client.0.trial030.stdout: "primary_affinity": 1, 2026-02-17T05:27:47.878 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_begin": 5, 2026-02-17T05:27:47.878 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_end": 27, 2026-02-17T05:27:47.878 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 34, 2026-02-17T05:27:47.878 INFO:tasks.workunit.client.0.trial030.stdout: "up_thru": 38, 2026-02-17T05:27:47.878 INFO:tasks.workunit.client.0.trial030.stdout: "down_at": 28, 2026-02-17T05:27:47.879 INFO:tasks.workunit.client.0.trial030.stdout: "lost_at": 0, 2026-02-17T05:27:47.879 INFO:tasks.workunit.client.0.trial030.stdout: "public_addrs": { 2026-02-17T05:27:47.879 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:27:47.879 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.879 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:27:47.879 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6800", 2026-02-17T05:27:47.879 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1366271510 2026-02-17T05:27:47.879 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.879 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.879 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:27:47.879 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6801", 2026-02-17T05:27:47.880 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1366271510 2026-02-17T05:27:47.880 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:27:47.880 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:27:47.880 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.880 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addrs": { 2026-02-17T05:27:47.880 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:27:47.880 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.880 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:27:47.880 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6802", 2026-02-17T05:27:47.880 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1366271510 2026-02-17T05:27:47.880 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.881 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.881 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:27:47.881 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6803", 2026-02-17T05:27:47.881 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1366271510 2026-02-17T05:27:47.881 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:27:47.881 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:27:47.881 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.881 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addrs": { 2026-02-17T05:27:47.881 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:27:47.881 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.881 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:27:47.882 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6806", 2026-02-17T05:27:47.882 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1366271510 2026-02-17T05:27:47.882 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.882 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.882 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:27:47.882 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6807", 2026-02-17T05:27:47.882 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1366271510 2026-02-17T05:27:47.882 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:27:47.882 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:27:47.882 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.883 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addrs": { 2026-02-17T05:27:47.883 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:27:47.883 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.883 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:27:47.883 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6804", 2026-02-17T05:27:47.883 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1366271510 2026-02-17T05:27:47.883 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.883 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.883 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:27:47.883 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6805", 2026-02-17T05:27:47.883 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1366271510 2026-02-17T05:27:47.884 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:27:47.884 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:27:47.884 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.884 INFO:tasks.workunit.client.0.trial030.stdout: "public_addr": "127.0.0.1:6801/1366271510", 2026-02-17T05:27:47.884 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addr": "127.0.0.1:6803/1366271510", 2026-02-17T05:27:47.884 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addr": "127.0.0.1:6807/1366271510", 2026-02-17T05:27:47.884 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addr": "127.0.0.1:6805/1366271510", 2026-02-17T05:27:47.884 INFO:tasks.workunit.client.0.trial030.stdout: "state": [ 2026-02-17T05:27:47.884 INFO:tasks.workunit.client.0.trial030.stdout: "exists", 2026-02-17T05:27:47.885 INFO:tasks.workunit.client.0.trial030.stdout: "up" 2026-02-17T05:27:47.885 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:27:47.885 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.885 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.885 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 1, 2026-02-17T05:27:47.885 INFO:tasks.workunit.client.0.trial030.stdout: "uuid": "5524a34c-0b5e-410e-8b07-ebafda9e86f0", 2026-02-17T05:27:47.885 INFO:tasks.workunit.client.0.trial030.stdout: "up": 0, 2026-02-17T05:27:47.885 INFO:tasks.workunit.client.0.trial030.stdout: "in": 1, 2026-02-17T05:27:47.885 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 1, 2026-02-17T05:27:47.885 INFO:tasks.workunit.client.0.trial030.stdout: "primary_affinity": 1, 2026-02-17T05:27:47.885 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_begin": 0, 2026-02-17T05:27:47.886 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_end": 0, 2026-02-17T05:27:47.886 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 10, 2026-02-17T05:27:47.886 INFO:tasks.workunit.client.0.trial030.stdout: "up_thru": 21, 2026-02-17T05:27:47.886 INFO:tasks.workunit.client.0.trial030.stdout: "down_at": 29, 2026-02-17T05:27:47.886 INFO:tasks.workunit.client.0.trial030.stdout: "lost_at": 0, 2026-02-17T05:27:47.886 INFO:tasks.workunit.client.0.trial030.stdout: "public_addrs": { 2026-02-17T05:27:47.886 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:27:47.886 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.886 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:27:47.886 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6810", 2026-02-17T05:27:47.886 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3684006821 2026-02-17T05:27:47.886 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.887 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.887 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:27:47.887 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6811", 2026-02-17T05:27:47.887 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3684006821 2026-02-17T05:27:47.887 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:27:47.887 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:27:47.887 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.887 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addrs": { 2026-02-17T05:27:47.887 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:27:47.887 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.887 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:27:47.888 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6812", 2026-02-17T05:27:47.888 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3684006821 2026-02-17T05:27:47.888 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.888 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.888 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:27:47.888 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6813", 2026-02-17T05:27:47.888 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3684006821 2026-02-17T05:27:47.888 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:27:47.888 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:27:47.888 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.889 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addrs": { 2026-02-17T05:27:47.889 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:27:47.889 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.889 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:27:47.889 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6816", 2026-02-17T05:27:47.889 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3684006821 2026-02-17T05:27:47.889 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.889 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.889 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:27:47.889 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6817", 2026-02-17T05:27:47.889 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3684006821 2026-02-17T05:27:47.890 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:27:47.890 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:27:47.890 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.890 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addrs": { 2026-02-17T05:27:47.890 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:27:47.890 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.890 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:27:47.890 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6814", 2026-02-17T05:27:47.890 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3684006821 2026-02-17T05:27:47.890 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.890 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.891 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:27:47.891 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6815", 2026-02-17T05:27:47.891 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3684006821 2026-02-17T05:27:47.891 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:27:47.891 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:27:47.891 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.891 INFO:tasks.workunit.client.0.trial030.stdout: "public_addr": "127.0.0.1:6811/3684006821", 2026-02-17T05:27:47.891 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addr": "127.0.0.1:6813/3684006821", 2026-02-17T05:27:47.891 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addr": "127.0.0.1:6817/3684006821", 2026-02-17T05:27:47.891 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addr": "127.0.0.1:6815/3684006821", 2026-02-17T05:27:47.892 INFO:tasks.workunit.client.0.trial030.stdout: "state": [ 2026-02-17T05:27:47.892 INFO:tasks.workunit.client.0.trial030.stdout: "exists" 2026-02-17T05:27:47.892 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:27:47.892 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.892 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.892 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2, 2026-02-17T05:27:47.892 INFO:tasks.workunit.client.0.trial030.stdout: "uuid": "e4a4420b-77ab-4a4b-a531-61a8b5f39ca2", 2026-02-17T05:27:47.892 INFO:tasks.workunit.client.0.trial030.stdout: "up": 1, 2026-02-17T05:27:47.892 INFO:tasks.workunit.client.0.trial030.stdout: "in": 1, 2026-02-17T05:27:47.892 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 1, 2026-02-17T05:27:47.892 INFO:tasks.workunit.client.0.trial030.stdout: "primary_affinity": 1, 2026-02-17T05:27:47.893 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_begin": 14, 2026-02-17T05:27:47.893 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_end": 27, 2026-02-17T05:27:47.893 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 36, 2026-02-17T05:27:47.893 INFO:tasks.workunit.client.0.trial030.stdout: "up_thru": 0, 2026-02-17T05:27:47.893 INFO:tasks.workunit.client.0.trial030.stdout: "down_at": 30, 2026-02-17T05:27:47.893 INFO:tasks.workunit.client.0.trial030.stdout: "lost_at": 0, 2026-02-17T05:27:47.893 INFO:tasks.workunit.client.0.trial030.stdout: "public_addrs": { 2026-02-17T05:27:47.893 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:27:47.893 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.893 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:27:47.893 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6810", 2026-02-17T05:27:47.894 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2487313544 2026-02-17T05:27:47.894 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.894 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.894 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:27:47.894 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6811", 2026-02-17T05:27:47.894 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2487313544 2026-02-17T05:27:47.894 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:27:47.894 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:27:47.894 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.894 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addrs": { 2026-02-17T05:27:47.894 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:27:47.894 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.895 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:27:47.895 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6812", 2026-02-17T05:27:47.895 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2487313544 2026-02-17T05:27:47.895 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.895 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.895 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:27:47.895 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6813", 2026-02-17T05:27:47.895 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2487313544 2026-02-17T05:27:47.895 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:27:47.895 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:27:47.895 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.895 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addrs": { 2026-02-17T05:27:47.895 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:27:47.895 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.896 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:27:47.896 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6816", 2026-02-17T05:27:47.896 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2487313544 2026-02-17T05:27:47.896 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.896 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.896 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:27:47.896 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6817", 2026-02-17T05:27:47.896 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2487313544 2026-02-17T05:27:47.896 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:27:47.896 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:27:47.896 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.896 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addrs": { 2026-02-17T05:27:47.896 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:27:47.896 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.896 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:27:47.897 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6814", 2026-02-17T05:27:47.897 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2487313544 2026-02-17T05:27:47.897 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.897 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.897 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:27:47.897 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6815", 2026-02-17T05:27:47.897 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2487313544 2026-02-17T05:27:47.897 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:27:47.897 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:27:47.897 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.897 INFO:tasks.workunit.client.0.trial030.stdout: "public_addr": "127.0.0.1:6811/2487313544", 2026-02-17T05:27:47.897 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addr": "127.0.0.1:6813/2487313544", 2026-02-17T05:27:47.897 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addr": "127.0.0.1:6817/2487313544", 2026-02-17T05:27:47.897 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addr": "127.0.0.1:6815/2487313544", 2026-02-17T05:27:47.898 INFO:tasks.workunit.client.0.trial030.stdout: "state": [ 2026-02-17T05:27:47.898 INFO:tasks.workunit.client.0.trial030.stdout: "exists", 2026-02-17T05:27:47.898 INFO:tasks.workunit.client.0.trial030.stdout: "up" 2026-02-17T05:27:47.898 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:27:47.898 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:27:47.898 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:27:47.898 INFO:tasks.workunit.client.0.trial030.stdout: "osd_xinfo": [ 2026-02-17T05:27:47.898 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.898 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 0, 2026-02-17T05:27:47.898 INFO:tasks.workunit.client.0.trial030.stdout: "down_stamp": "2026-02-17T05:27:12.783269+0000", 2026-02-17T05:27:47.898 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_probability": 0, 2026-02-17T05:27:47.899 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_interval": 0, 2026-02-17T05:27:47.899 INFO:tasks.workunit.client.0.trial030.stdout: "features": 4544132024016699391, 2026-02-17T05:27:47.899 INFO:tasks.workunit.client.0.trial030.stdout: "old_weight": 0, 2026-02-17T05:27:47.899 INFO:tasks.workunit.client.0.trial030.stdout: "last_purged_snaps_scrub": "2026-02-17T05:26:39.305737+0000", 2026-02-17T05:27:47.899 INFO:tasks.workunit.client.0.trial030.stdout: "dead_epoch": 0 2026-02-17T05:27:47.899 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.899 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.899 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 1, 2026-02-17T05:27:47.899 INFO:tasks.workunit.client.0.trial030.stdout: "down_stamp": "2026-02-17T05:27:13.076685+0000", 2026-02-17T05:27:47.899 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_probability": 0, 2026-02-17T05:27:47.899 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_interval": 0, 2026-02-17T05:27:47.899 INFO:tasks.workunit.client.0.trial030.stdout: "features": 4544132024016699391, 2026-02-17T05:27:47.900 INFO:tasks.workunit.client.0.trial030.stdout: "old_weight": 0, 2026-02-17T05:27:47.900 INFO:tasks.workunit.client.0.trial030.stdout: "last_purged_snaps_scrub": "0.000000", 2026-02-17T05:27:47.900 INFO:tasks.workunit.client.0.trial030.stdout: "dead_epoch": 0 2026-02-17T05:27:47.900 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.900 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.900 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2, 2026-02-17T05:27:47.900 INFO:tasks.workunit.client.0.trial030.stdout: "down_stamp": "2026-02-17T05:27:13.366372+0000", 2026-02-17T05:27:47.900 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_probability": 0, 2026-02-17T05:27:47.900 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_interval": 0, 2026-02-17T05:27:47.900 INFO:tasks.workunit.client.0.trial030.stdout: "features": 4544132024016699391, 2026-02-17T05:27:47.900 INFO:tasks.workunit.client.0.trial030.stdout: "old_weight": 0, 2026-02-17T05:27:47.900 INFO:tasks.workunit.client.0.trial030.stdout: "last_purged_snaps_scrub": "2026-02-17T05:26:46.833657+0000", 2026-02-17T05:27:47.900 INFO:tasks.workunit.client.0.trial030.stdout: "dead_epoch": 0 2026-02-17T05:27:47.901 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:27:47.901 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:27:47.901 INFO:tasks.workunit.client.0.trial030.stdout: "pg_upmap": [], 2026-02-17T05:27:47.901 INFO:tasks.workunit.client.0.trial030.stdout: "pg_upmap_items": [], 2026-02-17T05:27:47.901 INFO:tasks.workunit.client.0.trial030.stdout: "pg_upmap_primaries": [], 2026-02-17T05:27:47.901 INFO:tasks.workunit.client.0.trial030.stdout: "pg_temp": [], 2026-02-17T05:27:47.901 INFO:tasks.workunit.client.0.trial030.stdout: "primary_temp": [], 2026-02-17T05:27:47.901 INFO:tasks.workunit.client.0.trial030.stdout: "blocklist": {}, 2026-02-17T05:27:47.901 INFO:tasks.workunit.client.0.trial030.stdout: "range_blocklist": {}, 2026-02-17T05:27:47.901 INFO:tasks.workunit.client.0.trial030.stdout: "erasure_code_profiles": { 2026-02-17T05:27:47.901 INFO:tasks.workunit.client.0.trial030.stdout: "default": { 2026-02-17T05:27:47.901 INFO:tasks.workunit.client.0.trial030.stdout: "k": "2", 2026-02-17T05:27:47.901 INFO:tasks.workunit.client.0.trial030.stdout: "m": "2", 2026-02-17T05:27:47.901 INFO:tasks.workunit.client.0.trial030.stdout: "plugin": "isa", 2026-02-17T05:27:47.902 INFO:tasks.workunit.client.0.trial030.stdout: "technique": "reed_sol_van" 2026-02-17T05:27:47.902 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:27:47.902 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.902 INFO:tasks.workunit.client.0.trial030.stdout: "removed_snaps_queue": [], 2026-02-17T05:27:47.902 INFO:tasks.workunit.client.0.trial030.stdout: "new_removed_snaps": [], 2026-02-17T05:27:47.902 INFO:tasks.workunit.client.0.trial030.stdout: "new_purged_snaps": [], 2026-02-17T05:27:47.902 INFO:tasks.workunit.client.0.trial030.stdout: "crush_node_flags": {}, 2026-02-17T05:27:47.902 INFO:tasks.workunit.client.0.trial030.stdout: "device_class_flags": {}, 2026-02-17T05:27:47.902 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_mode": { 2026-02-17T05:27:47.902 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_mode_enabled": false, 2026-02-17T05:27:47.902 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_bucket_count": 0, 2026-02-17T05:27:47.902 INFO:tasks.workunit.client.0.trial030.stdout: "degraded_stretch_mode": 0, 2026-02-17T05:27:47.902 INFO:tasks.workunit.client.0.trial030.stdout: "recovering_stretch_mode": 0, 2026-02-17T05:27:47.902 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_mode_bucket": 0 2026-02-17T05:27:47.902 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:27:47.902 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.903 INFO:tasks.workunit.client.0.trial030.stdout: "osd_metadata": [ 2026-02-17T05:27:47.903 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.903 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-17T05:27:47.903 INFO:tasks.workunit.client.0.trial030.stdout: "arch": "x86_64", 2026-02-17T05:27:47.903 INFO:tasks.workunit.client.0.trial030.stdout: "back_addr": "[v2:127.0.0.1:6802/1366271510,v1:127.0.0.1:6803/1366271510]", 2026-02-17T05:27:47.903 INFO:tasks.workunit.client.0.trial030.stdout: "back_iface": "", 2026-02-17T05:27:47.903 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs": "1", 2026-02-17T05:27:47.903 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_db": "0", 2026-02-17T05:27:47.903 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T05:27:47.903 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_single_shared_device": "1", 2026-02-17T05:27:47.903 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T05:27:47.903 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocator": "hybrid", 2026-02-17T05:27:47.903 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T05:27:47.903 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T05:27:47.903 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T05:27:47.904 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T05:27:47.904 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T05:27:47.904 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-17T05:27:47.904 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T05:27:47.904 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T05:27:47.904 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T05:27:47.904 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T05:27:47.904 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-17T05:27:47.904 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T05:27:47.904 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T05:27:47.904 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_write_mode": "classic", 2026-02-17T05:27:47.904 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_release": "tentacle", 2026-02-17T05:27:47.904 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version": "ceph version 20.3.0-5271-g32585015 (325850157d309f65985eea9ec9bb9f1d56726fee) tentacle (dev - None)", 2026-02-17T05:27:47.904 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_short": "20.3.0-5271-g32585015", 2026-02-17T05:27:47.904 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_when_created": "ceph version 20.3.0-5271-g32585015 (325850157d309f65985eea9ec9bb9f1d56726fee) tentacle (dev - None)", 2026-02-17T05:27:47.904 INFO:tasks.workunit.client.0.trial030.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T05:27:47.905 INFO:tasks.workunit.client.0.trial030.stdout: "created_at": "2026-02-17T05:26:36.452101Z", 2026-02-17T05:27:47.905 INFO:tasks.workunit.client.0.trial030.stdout: "default_device_class": "ssd", 2026-02-17T05:27:47.905 INFO:tasks.workunit.client.0.trial030.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6B65", 2026-02-17T05:27:47.905 INFO:tasks.workunit.client.0.trial030.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T05:27:47.905 INFO:tasks.workunit.client.0.trial030.stdout: "devices": "nvme0n1", 2026-02-17T05:27:47.905 INFO:tasks.workunit.client.0.trial030.stdout: "distro": "ubuntu", 2026-02-17T05:27:47.905 INFO:tasks.workunit.client.0.trial030.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T05:27:47.905 INFO:tasks.workunit.client.0.trial030.stdout: "distro_version": "22.04", 2026-02-17T05:27:47.905 INFO:tasks.workunit.client.0.trial030.stdout: "front_addr": "[v2:127.0.0.1:6800/1366271510,v1:127.0.0.1:6801/1366271510]", 2026-02-17T05:27:47.905 INFO:tasks.workunit.client.0.trial030.stdout: "front_iface": "", 2026-02-17T05:27:47.905 INFO:tasks.workunit.client.0.trial030.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/1366271510,v1:127.0.0.1:6807/1366271510]", 2026-02-17T05:27:47.905 INFO:tasks.workunit.client.0.trial030.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/1366271510,v1:127.0.0.1:6805/1366271510]", 2026-02-17T05:27:47.905 INFO:tasks.workunit.client.0.trial030.stdout: "hostname": "trial030", 2026-02-17T05:27:47.905 INFO:tasks.workunit.client.0.trial030.stdout: "journal_rotational": "0", 2026-02-17T05:27:47.905 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T05:27:47.905 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T05:27:47.905 INFO:tasks.workunit.client.0.trial030.stdout: "mem_swap_kb": "8388604", 2026-02-17T05:27:47.906 INFO:tasks.workunit.client.0.trial030.stdout: "mem_total_kb": "130961692", 2026-02-17T05:27:47.906 INFO:tasks.workunit.client.0.trial030.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T05:27:47.906 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_node": "0", 2026-02-17T05:27:47.906 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_nodes": "0", 2026-02-17T05:27:47.906 INFO:tasks.workunit.client.0.trial030.stdout: "os": "Linux", 2026-02-17T05:27:47.906 INFO:tasks.workunit.client.0.trial030.stdout: "osd_data": "td/divergent-priors/0", 2026-02-17T05:27:47.906 INFO:tasks.workunit.client.0.trial030.stdout: "osd_objectstore": "bluestore", 2026-02-17T05:27:47.906 INFO:tasks.workunit.client.0.trial030.stdout: "osdspec_affinity": "", 2026-02-17T05:27:47.906 INFO:tasks.workunit.client.0.trial030.stdout: "rotational": "0" 2026-02-17T05:27:47.906 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.906 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.906 INFO:tasks.workunit.client.0.trial030.stdout: "id": 1, 2026-02-17T05:27:47.906 INFO:tasks.workunit.client.0.trial030.stdout: "arch": "x86_64", 2026-02-17T05:27:47.906 INFO:tasks.workunit.client.0.trial030.stdout: "back_addr": "[v2:127.0.0.1:6812/3684006821,v1:127.0.0.1:6813/3684006821]", 2026-02-17T05:27:47.906 INFO:tasks.workunit.client.0.trial030.stdout: "back_iface": "", 2026-02-17T05:27:47.906 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs": "1", 2026-02-17T05:27:47.906 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_db": "0", 2026-02-17T05:27:47.907 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T05:27:47.907 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_single_shared_device": "1", 2026-02-17T05:27:47.907 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T05:27:47.907 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocator": "hybrid", 2026-02-17T05:27:47.907 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T05:27:47.907 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T05:27:47.907 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T05:27:47.907 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T05:27:47.907 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T05:27:47.907 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-17T05:27:47.907 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T05:27:47.907 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T05:27:47.907 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T05:27:47.907 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T05:27:47.907 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-17T05:27:47.907 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T05:27:47.907 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T05:27:47.907 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_write_mode": "classic", 2026-02-17T05:27:47.908 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_release": "tentacle", 2026-02-17T05:27:47.908 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version": "ceph version 20.3.0-5271-g32585015 (325850157d309f65985eea9ec9bb9f1d56726fee) tentacle (dev - None)", 2026-02-17T05:27:47.908 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_short": "20.3.0-5271-g32585015", 2026-02-17T05:27:47.908 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_when_created": "ceph version 20.3.0-5271-g32585015 (325850157d309f65985eea9ec9bb9f1d56726fee) tentacle (dev - None)", 2026-02-17T05:27:47.908 INFO:tasks.workunit.client.0.trial030.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T05:27:47.908 INFO:tasks.workunit.client.0.trial030.stdout: "created_at": "2026-02-17T05:26:40.241538Z", 2026-02-17T05:27:47.908 INFO:tasks.workunit.client.0.trial030.stdout: "default_device_class": "ssd", 2026-02-17T05:27:47.908 INFO:tasks.workunit.client.0.trial030.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6B65", 2026-02-17T05:27:47.908 INFO:tasks.workunit.client.0.trial030.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T05:27:47.908 INFO:tasks.workunit.client.0.trial030.stdout: "devices": "nvme0n1", 2026-02-17T05:27:47.908 INFO:tasks.workunit.client.0.trial030.stdout: "distro": "ubuntu", 2026-02-17T05:27:47.908 INFO:tasks.workunit.client.0.trial030.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T05:27:47.908 INFO:tasks.workunit.client.0.trial030.stdout: "distro_version": "22.04", 2026-02-17T05:27:47.908 INFO:tasks.workunit.client.0.trial030.stdout: "front_addr": "[v2:127.0.0.1:6810/3684006821,v1:127.0.0.1:6811/3684006821]", 2026-02-17T05:27:47.908 INFO:tasks.workunit.client.0.trial030.stdout: "front_iface": "", 2026-02-17T05:27:47.908 INFO:tasks.workunit.client.0.trial030.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/3684006821,v1:127.0.0.1:6817/3684006821]", 2026-02-17T05:27:47.909 INFO:tasks.workunit.client.0.trial030.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/3684006821,v1:127.0.0.1:6815/3684006821]", 2026-02-17T05:27:47.909 INFO:tasks.workunit.client.0.trial030.stdout: "hostname": "trial030", 2026-02-17T05:27:47.909 INFO:tasks.workunit.client.0.trial030.stdout: "journal_rotational": "0", 2026-02-17T05:27:47.909 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T05:27:47.909 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T05:27:47.909 INFO:tasks.workunit.client.0.trial030.stdout: "mem_swap_kb": "8388604", 2026-02-17T05:27:47.909 INFO:tasks.workunit.client.0.trial030.stdout: "mem_total_kb": "130961692", 2026-02-17T05:27:47.909 INFO:tasks.workunit.client.0.trial030.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T05:27:47.909 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_node": "0", 2026-02-17T05:27:47.909 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_nodes": "0", 2026-02-17T05:27:47.909 INFO:tasks.workunit.client.0.trial030.stdout: "os": "Linux", 2026-02-17T05:27:47.909 INFO:tasks.workunit.client.0.trial030.stdout: "osd_data": "td/divergent-priors/1", 2026-02-17T05:27:47.909 INFO:tasks.workunit.client.0.trial030.stdout: "osd_objectstore": "bluestore", 2026-02-17T05:27:47.909 INFO:tasks.workunit.client.0.trial030.stdout: "osdspec_affinity": "", 2026-02-17T05:27:47.909 INFO:tasks.workunit.client.0.trial030.stdout: "rotational": "0" 2026-02-17T05:27:47.909 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.909 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.909 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-17T05:27:47.910 INFO:tasks.workunit.client.0.trial030.stdout: "arch": "x86_64", 2026-02-17T05:27:47.910 INFO:tasks.workunit.client.0.trial030.stdout: "back_addr": "[v2:127.0.0.1:6812/2487313544,v1:127.0.0.1:6813/2487313544]", 2026-02-17T05:27:47.910 INFO:tasks.workunit.client.0.trial030.stdout: "back_iface": "", 2026-02-17T05:27:47.910 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs": "1", 2026-02-17T05:27:47.910 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_db": "0", 2026-02-17T05:27:47.910 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T05:27:47.910 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_single_shared_device": "1", 2026-02-17T05:27:47.910 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T05:27:47.910 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocator": "hybrid", 2026-02-17T05:27:47.910 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T05:27:47.910 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T05:27:47.910 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T05:27:47.910 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T05:27:47.910 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T05:27:47.911 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-17T05:27:47.911 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T05:27:47.911 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T05:27:47.911 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T05:27:47.911 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T05:27:47.911 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-17T05:27:47.911 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T05:27:47.911 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T05:27:47.911 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_write_mode": "classic", 2026-02-17T05:27:47.911 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_release": "tentacle", 2026-02-17T05:27:47.911 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version": "ceph version 20.3.0-5271-g32585015 (325850157d309f65985eea9ec9bb9f1d56726fee) tentacle (dev - None)", 2026-02-17T05:27:47.911 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_short": "20.3.0-5271-g32585015", 2026-02-17T05:27:47.911 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_when_created": "ceph version 20.3.0-5271-g32585015 (325850157d309f65985eea9ec9bb9f1d56726fee) tentacle (dev - None)", 2026-02-17T05:27:47.911 INFO:tasks.workunit.client.0.trial030.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T05:27:47.911 INFO:tasks.workunit.client.0.trial030.stdout: "created_at": "2026-02-17T05:26:44.295736Z", 2026-02-17T05:27:47.911 INFO:tasks.workunit.client.0.trial030.stdout: "default_device_class": "ssd", 2026-02-17T05:27:47.911 INFO:tasks.workunit.client.0.trial030.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6B65", 2026-02-17T05:27:47.911 INFO:tasks.workunit.client.0.trial030.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T05:27:47.912 INFO:tasks.workunit.client.0.trial030.stdout: "devices": "nvme0n1", 2026-02-17T05:27:47.912 INFO:tasks.workunit.client.0.trial030.stdout: "distro": "ubuntu", 2026-02-17T05:27:47.912 INFO:tasks.workunit.client.0.trial030.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T05:27:47.912 INFO:tasks.workunit.client.0.trial030.stdout: "distro_version": "22.04", 2026-02-17T05:27:47.912 INFO:tasks.workunit.client.0.trial030.stdout: "front_addr": "[v2:127.0.0.1:6810/2487313544,v1:127.0.0.1:6811/2487313544]", 2026-02-17T05:27:47.912 INFO:tasks.workunit.client.0.trial030.stdout: "front_iface": "", 2026-02-17T05:27:47.912 INFO:tasks.workunit.client.0.trial030.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/2487313544,v1:127.0.0.1:6817/2487313544]", 2026-02-17T05:27:47.912 INFO:tasks.workunit.client.0.trial030.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/2487313544,v1:127.0.0.1:6815/2487313544]", 2026-02-17T05:27:47.912 INFO:tasks.workunit.client.0.trial030.stdout: "hostname": "trial030", 2026-02-17T05:27:47.912 INFO:tasks.workunit.client.0.trial030.stdout: "journal_rotational": "0", 2026-02-17T05:27:47.912 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T05:27:47.912 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T05:27:47.912 INFO:tasks.workunit.client.0.trial030.stdout: "mem_swap_kb": "8388604", 2026-02-17T05:27:47.912 INFO:tasks.workunit.client.0.trial030.stdout: "mem_total_kb": "130961692", 2026-02-17T05:27:47.912 INFO:tasks.workunit.client.0.trial030.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T05:27:47.912 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_node": "0", 2026-02-17T05:27:47.912 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_nodes": "0", 2026-02-17T05:27:47.912 INFO:tasks.workunit.client.0.trial030.stdout: "os": "Linux", 2026-02-17T05:27:47.912 INFO:tasks.workunit.client.0.trial030.stdout: "osd_data": "td/divergent-priors/2", 2026-02-17T05:27:47.913 INFO:tasks.workunit.client.0.trial030.stdout: "osd_objectstore": "bluestore", 2026-02-17T05:27:47.913 INFO:tasks.workunit.client.0.trial030.stdout: "osdspec_affinity": "", 2026-02-17T05:27:47.913 INFO:tasks.workunit.client.0.trial030.stdout: "rotational": "0" 2026-02-17T05:27:47.913 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:27:47.913 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:27:47.913 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap_clean_epochs": { 2026-02-17T05:27:47.913 INFO:tasks.workunit.client.0.trial030.stdout: "min_last_epoch_clean": 0, 2026-02-17T05:27:47.913 INFO:tasks.workunit.client.0.trial030.stdout: "last_epoch_clean": { 2026-02-17T05:27:47.913 INFO:tasks.workunit.client.0.trial030.stdout: "per_pool": [] 2026-02-17T05:27:47.913 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.913 INFO:tasks.workunit.client.0.trial030.stdout: "osd_epochs": [ 2026-02-17T05:27:47.913 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.913 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-17T05:27:47.913 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 34 2026-02-17T05:27:47.913 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.913 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.913 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-17T05:27:47.913 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 37 2026-02-17T05:27:47.913 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:27:47.913 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:27:47.914 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.914 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap_first_committed": 1, 2026-02-17T05:27:47.914 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap_last_committed": 39, 2026-02-17T05:27:47.914 INFO:tasks.workunit.client.0.trial030.stdout: "crushmap": { 2026-02-17T05:27:47.914 INFO:tasks.workunit.client.0.trial030.stdout: "devices": [ 2026-02-17T05:27:47.914 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.914 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-17T05:27:47.914 INFO:tasks.workunit.client.0.trial030.stdout: "name": "osd.0", 2026-02-17T05:27:47.914 INFO:tasks.workunit.client.0.trial030.stdout: "class": "ssd" 2026-02-17T05:27:47.914 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.914 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.914 INFO:tasks.workunit.client.0.trial030.stdout: "id": 1, 2026-02-17T05:27:47.914 INFO:tasks.workunit.client.0.trial030.stdout: "name": "osd.1", 2026-02-17T05:27:47.914 INFO:tasks.workunit.client.0.trial030.stdout: "class": "ssd" 2026-02-17T05:27:47.914 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.914 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.914 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-17T05:27:47.914 INFO:tasks.workunit.client.0.trial030.stdout: "name": "osd.2", 2026-02-17T05:27:47.914 INFO:tasks.workunit.client.0.trial030.stdout: "class": "ssd" 2026-02-17T05:27:47.914 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:27:47.914 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:27:47.914 INFO:tasks.workunit.client.0.trial030.stdout: "types": [ 2026-02-17T05:27:47.915 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.915 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 0, 2026-02-17T05:27:47.915 INFO:tasks.workunit.client.0.trial030.stdout: "name": "osd" 2026-02-17T05:27:47.915 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.915 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.915 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 1, 2026-02-17T05:27:47.915 INFO:tasks.workunit.client.0.trial030.stdout: "name": "host" 2026-02-17T05:27:47.915 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.915 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.915 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 2, 2026-02-17T05:27:47.915 INFO:tasks.workunit.client.0.trial030.stdout: "name": "chassis" 2026-02-17T05:27:47.915 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.915 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.915 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 3, 2026-02-17T05:27:47.915 INFO:tasks.workunit.client.0.trial030.stdout: "name": "rack" 2026-02-17T05:27:47.915 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.915 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.915 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 4, 2026-02-17T05:27:47.915 INFO:tasks.workunit.client.0.trial030.stdout: "name": "row" 2026-02-17T05:27:47.915 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.915 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.915 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 5, 2026-02-17T05:27:47.915 INFO:tasks.workunit.client.0.trial030.stdout: "name": "pdu" 2026-02-17T05:27:47.916 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.916 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.916 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 6, 2026-02-17T05:27:47.916 INFO:tasks.workunit.client.0.trial030.stdout: "name": "pod" 2026-02-17T05:27:47.916 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.916 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.916 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 7, 2026-02-17T05:27:47.916 INFO:tasks.workunit.client.0.trial030.stdout: "name": "room" 2026-02-17T05:27:47.916 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.916 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.916 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 8, 2026-02-17T05:27:47.916 INFO:tasks.workunit.client.0.trial030.stdout: "name": "datacenter" 2026-02-17T05:27:47.916 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.916 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.916 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 9, 2026-02-17T05:27:47.916 INFO:tasks.workunit.client.0.trial030.stdout: "name": "zone" 2026-02-17T05:27:47.916 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.916 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.916 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 10, 2026-02-17T05:27:47.916 INFO:tasks.workunit.client.0.trial030.stdout: "name": "region" 2026-02-17T05:27:47.916 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.917 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.917 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 11, 2026-02-17T05:27:47.917 INFO:tasks.workunit.client.0.trial030.stdout: "name": "root" 2026-02-17T05:27:47.917 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:27:47.917 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:27:47.917 INFO:tasks.workunit.client.0.trial030.stdout: "buckets": [ 2026-02-17T05:27:47.917 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.917 INFO:tasks.workunit.client.0.trial030.stdout: "id": -1, 2026-02-17T05:27:47.917 INFO:tasks.workunit.client.0.trial030.stdout: "name": "default", 2026-02-17T05:27:47.917 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 11, 2026-02-17T05:27:47.917 INFO:tasks.workunit.client.0.trial030.stdout: "type_name": "root", 2026-02-17T05:27:47.917 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-17T05:27:47.917 INFO:tasks.workunit.client.0.trial030.stdout: "alg": "straw2", 2026-02-17T05:27:47.917 INFO:tasks.workunit.client.0.trial030.stdout: "hash": "rjenkins1", 2026-02-17T05:27:47.917 INFO:tasks.workunit.client.0.trial030.stdout: "items": [ 2026-02-17T05:27:47.917 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.917 INFO:tasks.workunit.client.0.trial030.stdout: "id": -3, 2026-02-17T05:27:47.917 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-17T05:27:47.917 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 0 2026-02-17T05:27:47.917 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:27:47.917 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:27:47.917 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.917 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.918 INFO:tasks.workunit.client.0.trial030.stdout: "id": -2, 2026-02-17T05:27:47.918 INFO:tasks.workunit.client.0.trial030.stdout: "name": "default~ssd", 2026-02-17T05:27:47.918 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 11, 2026-02-17T05:27:47.918 INFO:tasks.workunit.client.0.trial030.stdout: "type_name": "root", 2026-02-17T05:27:47.918 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-17T05:27:47.918 INFO:tasks.workunit.client.0.trial030.stdout: "alg": "straw2", 2026-02-17T05:27:47.918 INFO:tasks.workunit.client.0.trial030.stdout: "hash": "rjenkins1", 2026-02-17T05:27:47.918 INFO:tasks.workunit.client.0.trial030.stdout: "items": [ 2026-02-17T05:27:47.918 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.918 INFO:tasks.workunit.client.0.trial030.stdout: "id": -4, 2026-02-17T05:27:47.918 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-17T05:27:47.918 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 0 2026-02-17T05:27:47.918 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:27:47.918 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:27:47.918 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.918 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.918 INFO:tasks.workunit.client.0.trial030.stdout: "id": -3, 2026-02-17T05:27:47.918 INFO:tasks.workunit.client.0.trial030.stdout: "name": "trial030", 2026-02-17T05:27:47.918 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 1, 2026-02-17T05:27:47.918 INFO:tasks.workunit.client.0.trial030.stdout: "type_name": "host", 2026-02-17T05:27:47.918 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-17T05:27:47.918 INFO:tasks.workunit.client.0.trial030.stdout: "alg": "straw2", 2026-02-17T05:27:47.918 INFO:tasks.workunit.client.0.trial030.stdout: "hash": "rjenkins1", 2026-02-17T05:27:47.919 INFO:tasks.workunit.client.0.trial030.stdout: "items": [ 2026-02-17T05:27:47.919 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.919 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-17T05:27:47.919 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-17T05:27:47.919 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 0 2026-02-17T05:27:47.919 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.919 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.919 INFO:tasks.workunit.client.0.trial030.stdout: "id": 1, 2026-02-17T05:27:47.919 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-17T05:27:47.919 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 1 2026-02-17T05:27:47.919 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.919 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.919 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-17T05:27:47.919 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-17T05:27:47.919 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 2 2026-02-17T05:27:47.919 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:27:47.919 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:27:47.919 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.919 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.919 INFO:tasks.workunit.client.0.trial030.stdout: "id": -4, 2026-02-17T05:27:47.919 INFO:tasks.workunit.client.0.trial030.stdout: "name": "trial030~ssd", 2026-02-17T05:27:47.919 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 1, 2026-02-17T05:27:47.919 INFO:tasks.workunit.client.0.trial030.stdout: "type_name": "host", 2026-02-17T05:27:47.920 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-17T05:27:47.920 INFO:tasks.workunit.client.0.trial030.stdout: "alg": "straw2", 2026-02-17T05:27:47.920 INFO:tasks.workunit.client.0.trial030.stdout: "hash": "rjenkins1", 2026-02-17T05:27:47.920 INFO:tasks.workunit.client.0.trial030.stdout: "items": [ 2026-02-17T05:27:47.920 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.920 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-17T05:27:47.920 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-17T05:27:47.920 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 0 2026-02-17T05:27:47.920 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.920 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.920 INFO:tasks.workunit.client.0.trial030.stdout: "id": 1, 2026-02-17T05:27:47.920 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-17T05:27:47.920 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 1 2026-02-17T05:27:47.920 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.920 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.920 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-17T05:27:47.920 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-17T05:27:47.920 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 2 2026-02-17T05:27:47.920 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:27:47.920 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:27:47.920 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:27:47.920 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:27:47.921 INFO:tasks.workunit.client.0.trial030.stdout: "rules": [ 2026-02-17T05:27:47.921 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.921 INFO:tasks.workunit.client.0.trial030.stdout: "rule_id": 0, 2026-02-17T05:27:47.921 INFO:tasks.workunit.client.0.trial030.stdout: "rule_name": "replicated_rule", 2026-02-17T05:27:47.921 INFO:tasks.workunit.client.0.trial030.stdout: "type": 1, 2026-02-17T05:27:47.921 INFO:tasks.workunit.client.0.trial030.stdout: "steps": [ 2026-02-17T05:27:47.921 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.921 INFO:tasks.workunit.client.0.trial030.stdout: "op": "take", 2026-02-17T05:27:47.921 INFO:tasks.workunit.client.0.trial030.stdout: "item": -1, 2026-02-17T05:27:47.921 INFO:tasks.workunit.client.0.trial030.stdout: "item_name": "default" 2026-02-17T05:27:47.921 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.921 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.921 INFO:tasks.workunit.client.0.trial030.stdout: "op": "choose_firstn", 2026-02-17T05:27:47.921 INFO:tasks.workunit.client.0.trial030.stdout: "num": 0, 2026-02-17T05:27:47.921 INFO:tasks.workunit.client.0.trial030.stdout: "type": "osd" 2026-02-17T05:27:47.921 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.921 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.921 INFO:tasks.workunit.client.0.trial030.stdout: "op": "emit" 2026-02-17T05:27:47.921 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:27:47.921 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:27:47.921 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:27:47.921 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:27:47.921 INFO:tasks.workunit.client.0.trial030.stdout: "tunables": { 2026-02-17T05:27:47.921 INFO:tasks.workunit.client.0.trial030.stdout: "choose_local_tries": 0, 2026-02-17T05:27:47.922 INFO:tasks.workunit.client.0.trial030.stdout: "choose_local_fallback_tries": 0, 2026-02-17T05:27:47.922 INFO:tasks.workunit.client.0.trial030.stdout: "choose_total_tries": 50, 2026-02-17T05:27:47.922 INFO:tasks.workunit.client.0.trial030.stdout: "chooseleaf_descend_once": 1, 2026-02-17T05:27:47.922 INFO:tasks.workunit.client.0.trial030.stdout: "chooseleaf_vary_r": 1, 2026-02-17T05:27:47.922 INFO:tasks.workunit.client.0.trial030.stdout: "chooseleaf_stable": 1, 2026-02-17T05:27:47.922 INFO:tasks.workunit.client.0.trial030.stdout: "msr_descents": 100, 2026-02-17T05:27:47.922 INFO:tasks.workunit.client.0.trial030.stdout: "msr_collision_tries": 100, 2026-02-17T05:27:47.922 INFO:tasks.workunit.client.0.trial030.stdout: "straw_calc_version": 1, 2026-02-17T05:27:47.922 INFO:tasks.workunit.client.0.trial030.stdout: "allowed_bucket_algs": 54, 2026-02-17T05:27:47.922 INFO:tasks.workunit.client.0.trial030.stderr:report 1746987154 2026-02-17T05:27:47.922 INFO:tasks.workunit.client.0.trial030.stdout: "profile": "jewel", 2026-02-17T05:27:47.922 INFO:tasks.workunit.client.0.trial030.stdout: "optimal_tunables": 1, 2026-02-17T05:27:47.923 INFO:tasks.workunit.client.0.trial030.stdout: "legacy_tunables": 0, 2026-02-17T05:27:47.923 INFO:tasks.workunit.client.0.trial030.stdout: "minimum_required_version": "jewel", 2026-02-17T05:27:47.923 INFO:tasks.workunit.client.0.trial030.stdout: "require_feature_tunables": 1, 2026-02-17T05:27:47.923 INFO:tasks.workunit.client.0.trial030.stdout: "require_feature_tunables2": 1, 2026-02-17T05:27:47.923 INFO:tasks.workunit.client.0.trial030.stdout: "has_v2_rules": 0, 2026-02-17T05:27:47.923 INFO:tasks.workunit.client.0.trial030.stdout: "require_feature_tunables3": 1, 2026-02-17T05:27:47.923 INFO:tasks.workunit.client.0.trial030.stdout: "has_v3_rules": 0, 2026-02-17T05:27:47.923 INFO:tasks.workunit.client.0.trial030.stdout: "has_v4_buckets": 1, 2026-02-17T05:27:47.923 INFO:tasks.workunit.client.0.trial030.stdout: "require_feature_tunables5": 1, 2026-02-17T05:27:47.923 INFO:tasks.workunit.client.0.trial030.stdout: "has_v5_rules": 0, 2026-02-17T05:27:47.923 INFO:tasks.workunit.client.0.trial030.stdout: "has_msr_rules": 0 2026-02-17T05:27:47.923 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.923 INFO:tasks.workunit.client.0.trial030.stdout: "choose_args": {} 2026-02-17T05:27:47.923 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.923 INFO:tasks.workunit.client.0.trial030.stdout: "fsmap": { 2026-02-17T05:27:47.923 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 1, 2026-02-17T05:27:47.923 INFO:tasks.workunit.client.0.trial030.stdout: "btime": "2026-02-17T05:26:35:419409+0000", 2026-02-17T05:27:47.923 INFO:tasks.workunit.client.0.trial030.stdout: "default_fscid": -1, 2026-02-17T05:27:47.923 INFO:tasks.workunit.client.0.trial030.stdout: "compat": { 2026-02-17T05:27:47.923 INFO:tasks.workunit.client.0.trial030.stdout: "compat": {}, 2026-02-17T05:27:47.923 INFO:tasks.workunit.client.0.trial030.stdout: "ro_compat": {}, 2026-02-17T05:27:47.923 INFO:tasks.workunit.client.0.trial030.stdout: "incompat": { 2026-02-17T05:27:47.923 INFO:tasks.workunit.client.0.trial030.stdout: "feature_1": "base v0.20", 2026-02-17T05:27:47.923 INFO:tasks.workunit.client.0.trial030.stdout: "feature_2": "client writeable ranges", 2026-02-17T05:27:47.924 INFO:tasks.workunit.client.0.trial030.stdout: "feature_3": "default file layouts on dirs", 2026-02-17T05:27:47.924 INFO:tasks.workunit.client.0.trial030.stdout: "feature_4": "dir inode in separate object", 2026-02-17T05:27:47.924 INFO:tasks.workunit.client.0.trial030.stdout: "feature_5": "mds uses versioned encoding", 2026-02-17T05:27:47.924 INFO:tasks.workunit.client.0.trial030.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-17T05:27:47.924 INFO:tasks.workunit.client.0.trial030.stdout: "feature_8": "no anchor table", 2026-02-17T05:27:47.924 INFO:tasks.workunit.client.0.trial030.stdout: "feature_9": "file layout v2", 2026-02-17T05:27:47.924 INFO:tasks.workunit.client.0.trial030.stdout: "feature_10": "snaprealm v2", 2026-02-17T05:27:47.924 INFO:tasks.workunit.client.0.trial030.stdout: "feature_11": "minor log segments", 2026-02-17T05:27:47.924 INFO:tasks.workunit.client.0.trial030.stdout: "feature_12": "quiesce subvolumes" 2026-02-17T05:27:47.924 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:27:47.924 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.924 INFO:tasks.workunit.client.0.trial030.stdout: "feature_flags": { 2026-02-17T05:27:47.924 INFO:tasks.workunit.client.0.trial030.stdout: "enable_multiple": true, 2026-02-17T05:27:47.924 INFO:tasks.workunit.client.0.trial030.stdout: "ever_enabled_multiple": true 2026-02-17T05:27:47.924 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.924 INFO:tasks.workunit.client.0.trial030.stdout: "standbys": [], 2026-02-17T05:27:47.924 INFO:tasks.workunit.client.0.trial030.stdout: "filesystems": [] 2026-02-17T05:27:47.924 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.924 INFO:tasks.workunit.client.0.trial030.stdout: "mdsmap_first_committed": 1, 2026-02-17T05:27:47.924 INFO:tasks.workunit.client.0.trial030.stdout: "mdsmap_last_committed": 1, 2026-02-17T05:27:47.924 INFO:tasks.workunit.client.0.trial030.stdout: "auth": { 2026-02-17T05:27:47.924 INFO:tasks.workunit.client.0.trial030.stdout: "first_committed": 1, 2026-02-17T05:27:47.925 INFO:tasks.workunit.client.0.trial030.stdout: "last_committed": 5, 2026-02-17T05:27:47.925 INFO:tasks.workunit.client.0.trial030.stdout: "num_secrets": 3 2026-02-17T05:27:47.925 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.925 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg": 1, 2026-02-17T05:27:47.925 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg_active": 1, 2026-02-17T05:27:47.925 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg_unknown": 0, 2026-02-17T05:27:47.925 INFO:tasks.workunit.client.0.trial030.stdout: "num_osd": 3, 2026-02-17T05:27:47.925 INFO:tasks.workunit.client.0.trial030.stdout: "pool_sum": { 2026-02-17T05:27:47.925 INFO:tasks.workunit.client.0.trial030.stdout: "stat_sum": { 2026-02-17T05:27:47.925 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes": 51200, 2026-02-17T05:27:47.925 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects": 100, 2026-02-17T05:27:47.925 INFO:tasks.workunit.client.0.trial030.stdout: "num_object_clones": 0, 2026-02-17T05:27:47.925 INFO:tasks.workunit.client.0.trial030.stdout: "num_object_copies": 300, 2026-02-17T05:27:47.925 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T05:27:47.925 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_missing": 0, 2026-02-17T05:27:47.925 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_degraded": 100, 2026-02-17T05:27:47.925 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_misplaced": 0, 2026-02-17T05:27:47.925 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_unfound": 0, 2026-02-17T05:27:47.925 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_dirty": 100, 2026-02-17T05:27:47.925 INFO:tasks.workunit.client.0.trial030.stdout: "num_whiteouts": 0, 2026-02-17T05:27:47.925 INFO:tasks.workunit.client.0.trial030.stdout: "num_read": 0, 2026-02-17T05:27:47.925 INFO:tasks.workunit.client.0.trial030.stdout: "num_read_kb": 0, 2026-02-17T05:27:47.925 INFO:tasks.workunit.client.0.trial030.stdout: "num_write": 100, 2026-02-17T05:27:47.926 INFO:tasks.workunit.client.0.trial030.stdout: "num_write_kb": 100, 2026-02-17T05:27:47.926 INFO:tasks.workunit.client.0.trial030.stdout: "num_scrub_errors": 0, 2026-02-17T05:27:47.926 INFO:tasks.workunit.client.0.trial030.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T05:27:47.926 INFO:tasks.workunit.client.0.trial030.stdout: "num_deep_scrub_errors": 0, 2026-02-17T05:27:47.926 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_recovered": 0, 2026-02-17T05:27:47.926 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes_recovered": 0, 2026-02-17T05:27:47.926 INFO:tasks.workunit.client.0.trial030.stdout: "num_keys_recovered": 0, 2026-02-17T05:27:47.926 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_omap": 0, 2026-02-17T05:27:47.926 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T05:27:47.926 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T05:27:47.926 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush": 0, 2026-02-17T05:27:47.926 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_kb": 0, 2026-02-17T05:27:47.926 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict": 0, 2026-02-17T05:27:47.926 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_kb": 0, 2026-02-17T05:27:47.926 INFO:tasks.workunit.client.0.trial030.stdout: "num_promote": 0, 2026-02-17T05:27:47.926 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_mode_high": 0, 2026-02-17T05:27:47.926 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_mode_low": 0, 2026-02-17T05:27:47.926 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_mode_some": 0, 2026-02-17T05:27:47.926 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_mode_full": 0, 2026-02-17T05:27:47.926 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_pinned": 0, 2026-02-17T05:27:47.926 INFO:tasks.workunit.client.0.trial030.stdout: "num_legacy_snapsets": 0, 2026-02-17T05:27:47.926 INFO:tasks.workunit.client.0.trial030.stdout: "num_large_omap_objects": 0, 2026-02-17T05:27:47.926 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_manifest": 0, 2026-02-17T05:27:47.927 INFO:tasks.workunit.client.0.trial030.stdout: "num_omap_bytes": 0, 2026-02-17T05:27:47.927 INFO:tasks.workunit.client.0.trial030.stdout: "num_omap_keys": 0, 2026-02-17T05:27:47.927 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_repaired": 0 2026-02-17T05:27:47.927 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.927 INFO:tasks.workunit.client.0.trial030.stdout: "store_stats": { 2026-02-17T05:27:47.927 INFO:tasks.workunit.client.0.trial030.stdout: "total": 0, 2026-02-17T05:27:47.927 INFO:tasks.workunit.client.0.trial030.stdout: "available": 0, 2026-02-17T05:27:47.927 INFO:tasks.workunit.client.0.trial030.stdout: "internally_reserved": 0, 2026-02-17T05:27:47.927 INFO:tasks.workunit.client.0.trial030.stdout: "allocated": 0, 2026-02-17T05:27:47.927 INFO:tasks.workunit.client.0.trial030.stdout: "data_stored": 0, 2026-02-17T05:27:47.927 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed": 0, 2026-02-17T05:27:47.927 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_allocated": 0, 2026-02-17T05:27:47.927 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_original": 0, 2026-02-17T05:27:47.927 INFO:tasks.workunit.client.0.trial030.stdout: "omap_allocated": 0, 2026-02-17T05:27:47.927 INFO:tasks.workunit.client.0.trial030.stdout: "internal_metadata": 0 2026-02-17T05:27:47.927 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.927 INFO:tasks.workunit.client.0.trial030.stdout: "log_size": 16, 2026-02-17T05:27:47.927 INFO:tasks.workunit.client.0.trial030.stdout: "ondisk_log_size": 16, 2026-02-17T05:27:47.927 INFO:tasks.workunit.client.0.trial030.stdout: "up": 2, 2026-02-17T05:27:47.927 INFO:tasks.workunit.client.0.trial030.stdout: "acting": 2, 2026-02-17T05:27:47.927 INFO:tasks.workunit.client.0.trial030.stdout: "num_store_stats": 0 2026-02-17T05:27:47.927 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.927 INFO:tasks.workunit.client.0.trial030.stdout: "osd_sum": { 2026-02-17T05:27:47.927 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 0, 2026-02-17T05:27:47.928 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 0, 2026-02-17T05:27:47.928 INFO:tasks.workunit.client.0.trial030.stdout: "num_pgs": 3, 2026-02-17T05:27:47.928 INFO:tasks.workunit.client.0.trial030.stdout: "num_osds": 3, 2026-02-17T05:27:47.928 INFO:tasks.workunit.client.0.trial030.stdout: "num_per_pool_osds": 3, 2026-02-17T05:27:47.928 INFO:tasks.workunit.client.0.trial030.stdout: "num_per_pool_omap_osds": 3, 2026-02-17T05:27:47.928 INFO:tasks.workunit.client.0.trial030.stdout: "kb": 314572800, 2026-02-17T05:27:47.928 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used": 83844, 2026-02-17T05:27:47.928 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_data": 2064, 2026-02-17T05:27:47.928 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_omap": 24, 2026-02-17T05:27:47.928 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_meta": 81703, 2026-02-17T05:27:47.928 INFO:tasks.workunit.client.0.trial030.stdout: "kb_avail": 314488956, 2026-02-17T05:27:47.928 INFO:tasks.workunit.client.0.trial030.stdout: "statfs": { 2026-02-17T05:27:47.928 INFO:tasks.workunit.client.0.trial030.stdout: "total": 322122547200, 2026-02-17T05:27:47.928 INFO:tasks.workunit.client.0.trial030.stdout: "available": 322036690944, 2026-02-17T05:27:47.928 INFO:tasks.workunit.client.0.trial030.stdout: "internally_reserved": 0, 2026-02-17T05:27:47.928 INFO:tasks.workunit.client.0.trial030.stdout: "allocated": 2113536, 2026-02-17T05:27:47.928 INFO:tasks.workunit.client.0.trial030.stdout: "data_stored": 414811, 2026-02-17T05:27:47.928 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed": 0, 2026-02-17T05:27:47.928 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_allocated": 0, 2026-02-17T05:27:47.928 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_original": 0, 2026-02-17T05:27:47.928 INFO:tasks.workunit.client.0.trial030.stdout: "omap_allocated": 24749, 2026-02-17T05:27:47.928 INFO:tasks.workunit.client.0.trial030.stdout: "internal_metadata": 83664723 2026-02-17T05:27:47.928 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.928 INFO:tasks.workunit.client.0.trial030.stdout: "hb_peers": [], 2026-02-17T05:27:47.928 INFO:tasks.workunit.client.0.trial030.stdout: "snap_trim_queue_len": 0, 2026-02-17T05:27:47.928 INFO:tasks.workunit.client.0.trial030.stdout: "num_snap_trimming": 0, 2026-02-17T05:27:47.929 INFO:tasks.workunit.client.0.trial030.stdout: "num_shards_repaired": 1, 2026-02-17T05:27:47.929 INFO:tasks.workunit.client.0.trial030.stdout: "op_queue_age_hist": { 2026-02-17T05:27:47.929 INFO:tasks.workunit.client.0.trial030.stdout: "histogram": [], 2026-02-17T05:27:47.929 INFO:tasks.workunit.client.0.trial030.stdout: "upper_bound": 1 2026-02-17T05:27:47.929 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.929 INFO:tasks.workunit.client.0.trial030.stdout: "perf_stat": { 2026-02-17T05:27:47.929 INFO:tasks.workunit.client.0.trial030.stdout: "commit_latency_ms": 0, 2026-02-17T05:27:47.929 INFO:tasks.workunit.client.0.trial030.stdout: "apply_latency_ms": 0, 2026-02-17T05:27:47.929 INFO:tasks.workunit.client.0.trial030.stdout: "commit_latency_ns": 0, 2026-02-17T05:27:47.929 INFO:tasks.workunit.client.0.trial030.stdout: "apply_latency_ns": 0 2026-02-17T05:27:47.929 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.929 INFO:tasks.workunit.client.0.trial030.stdout: "alerts": [], 2026-02-17T05:27:47.929 INFO:tasks.workunit.client.0.trial030.stdout: "network_ping_times": [] 2026-02-17T05:27:47.929 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.929 INFO:tasks.workunit.client.0.trial030.stdout: "osd_sum_by_class": { 2026-02-17T05:27:47.929 INFO:tasks.workunit.client.0.trial030.stdout: "ssd": { 2026-02-17T05:27:47.929 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 0, 2026-02-17T05:27:47.929 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 0, 2026-02-17T05:27:47.929 INFO:tasks.workunit.client.0.trial030.stdout: "num_pgs": 3, 2026-02-17T05:27:47.929 INFO:tasks.workunit.client.0.trial030.stdout: "num_osds": 3, 2026-02-17T05:27:47.929 INFO:tasks.workunit.client.0.trial030.stdout: "num_per_pool_osds": 3, 2026-02-17T05:27:47.929 INFO:tasks.workunit.client.0.trial030.stdout: "num_per_pool_omap_osds": 3, 2026-02-17T05:27:47.929 INFO:tasks.workunit.client.0.trial030.stdout: "kb": 314572800, 2026-02-17T05:27:47.929 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used": 83844, 2026-02-17T05:27:47.929 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_data": 2064, 2026-02-17T05:27:47.929 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_omap": 24, 2026-02-17T05:27:47.929 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_meta": 81703, 2026-02-17T05:27:47.930 INFO:tasks.workunit.client.0.trial030.stdout: "kb_avail": 314488956, 2026-02-17T05:27:47.930 INFO:tasks.workunit.client.0.trial030.stdout: "statfs": { 2026-02-17T05:27:47.930 INFO:tasks.workunit.client.0.trial030.stdout: "total": 322122547200, 2026-02-17T05:27:47.930 INFO:tasks.workunit.client.0.trial030.stdout: "available": 322036690944, 2026-02-17T05:27:47.930 INFO:tasks.workunit.client.0.trial030.stdout: "internally_reserved": 0, 2026-02-17T05:27:47.930 INFO:tasks.workunit.client.0.trial030.stdout: "allocated": 2113536, 2026-02-17T05:27:47.930 INFO:tasks.workunit.client.0.trial030.stdout: "data_stored": 414811, 2026-02-17T05:27:47.930 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed": 0, 2026-02-17T05:27:47.930 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_allocated": 0, 2026-02-17T05:27:47.930 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_original": 0, 2026-02-17T05:27:47.930 INFO:tasks.workunit.client.0.trial030.stdout: "omap_allocated": 24749, 2026-02-17T05:27:47.930 INFO:tasks.workunit.client.0.trial030.stdout: "internal_metadata": 83664723 2026-02-17T05:27:47.930 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.930 INFO:tasks.workunit.client.0.trial030.stdout: "hb_peers": [], 2026-02-17T05:27:47.930 INFO:tasks.workunit.client.0.trial030.stdout: "snap_trim_queue_len": 0, 2026-02-17T05:27:47.930 INFO:tasks.workunit.client.0.trial030.stdout: "num_snap_trimming": 0, 2026-02-17T05:27:47.930 INFO:tasks.workunit.client.0.trial030.stdout: "num_shards_repaired": 1, 2026-02-17T05:27:47.930 INFO:tasks.workunit.client.0.trial030.stdout: "op_queue_age_hist": { 2026-02-17T05:27:47.930 INFO:tasks.workunit.client.0.trial030.stdout: "histogram": [], 2026-02-17T05:27:47.930 INFO:tasks.workunit.client.0.trial030.stdout: "upper_bound": 1 2026-02-17T05:27:47.930 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.930 INFO:tasks.workunit.client.0.trial030.stdout: "perf_stat": { 2026-02-17T05:27:47.930 INFO:tasks.workunit.client.0.trial030.stdout: "commit_latency_ms": 0, 2026-02-17T05:27:47.930 INFO:tasks.workunit.client.0.trial030.stdout: "apply_latency_ms": 0, 2026-02-17T05:27:47.930 INFO:tasks.workunit.client.0.trial030.stdout: "commit_latency_ns": 0, 2026-02-17T05:27:47.930 INFO:tasks.workunit.client.0.trial030.stdout: "apply_latency_ns": 0 2026-02-17T05:27:47.930 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.930 INFO:tasks.workunit.client.0.trial030.stdout: "alerts": [], 2026-02-17T05:27:47.931 INFO:tasks.workunit.client.0.trial030.stdout: "network_ping_times": [] 2026-02-17T05:27:47.931 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:27:47.931 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.931 INFO:tasks.workunit.client.0.trial030.stdout: "pool_stats": [ 2026-02-17T05:27:47.931 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.931 INFO:tasks.workunit.client.0.trial030.stdout: "poolid": 1, 2026-02-17T05:27:47.931 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg": 1, 2026-02-17T05:27:47.931 INFO:tasks.workunit.client.0.trial030.stdout: "stat_sum": { 2026-02-17T05:27:47.931 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes": 51200, 2026-02-17T05:27:47.931 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects": 100, 2026-02-17T05:27:47.931 INFO:tasks.workunit.client.0.trial030.stdout: "num_object_clones": 0, 2026-02-17T05:27:47.931 INFO:tasks.workunit.client.0.trial030.stdout: "num_object_copies": 300, 2026-02-17T05:27:47.931 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T05:27:47.931 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_missing": 0, 2026-02-17T05:27:47.931 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_degraded": 100, 2026-02-17T05:27:47.931 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_misplaced": 0, 2026-02-17T05:27:47.931 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_unfound": 0, 2026-02-17T05:27:47.931 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_dirty": 100, 2026-02-17T05:27:47.931 INFO:tasks.workunit.client.0.trial030.stdout: "num_whiteouts": 0, 2026-02-17T05:27:47.931 INFO:tasks.workunit.client.0.trial030.stdout: "num_read": 0, 2026-02-17T05:27:47.931 INFO:tasks.workunit.client.0.trial030.stdout: "num_read_kb": 0, 2026-02-17T05:27:47.931 INFO:tasks.workunit.client.0.trial030.stdout: "num_write": 100, 2026-02-17T05:27:47.931 INFO:tasks.workunit.client.0.trial030.stdout: "num_write_kb": 100, 2026-02-17T05:27:47.931 INFO:tasks.workunit.client.0.trial030.stdout: "num_scrub_errors": 0, 2026-02-17T05:27:47.931 INFO:tasks.workunit.client.0.trial030.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T05:27:47.931 INFO:tasks.workunit.client.0.trial030.stdout: "num_deep_scrub_errors": 0, 2026-02-17T05:27:47.931 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_recovered": 0, 2026-02-17T05:27:47.931 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes_recovered": 0, 2026-02-17T05:27:47.931 INFO:tasks.workunit.client.0.trial030.stdout: "num_keys_recovered": 0, 2026-02-17T05:27:47.932 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_omap": 0, 2026-02-17T05:27:47.932 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T05:27:47.932 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T05:27:47.932 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush": 0, 2026-02-17T05:27:47.932 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_kb": 0, 2026-02-17T05:27:47.932 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict": 0, 2026-02-17T05:27:47.932 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_kb": 0, 2026-02-17T05:27:47.932 INFO:tasks.workunit.client.0.trial030.stdout: "num_promote": 0, 2026-02-17T05:27:47.932 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_mode_high": 0, 2026-02-17T05:27:47.932 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_mode_low": 0, 2026-02-17T05:27:47.932 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_mode_some": 0, 2026-02-17T05:27:47.932 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_mode_full": 0, 2026-02-17T05:27:47.932 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_pinned": 0, 2026-02-17T05:27:47.932 INFO:tasks.workunit.client.0.trial030.stdout: "num_legacy_snapsets": 0, 2026-02-17T05:27:47.932 INFO:tasks.workunit.client.0.trial030.stdout: "num_large_omap_objects": 0, 2026-02-17T05:27:47.932 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_manifest": 0, 2026-02-17T05:27:47.932 INFO:tasks.workunit.client.0.trial030.stdout: "num_omap_bytes": 0, 2026-02-17T05:27:47.932 INFO:tasks.workunit.client.0.trial030.stdout: "num_omap_keys": 0, 2026-02-17T05:27:47.932 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_repaired": 0 2026-02-17T05:27:47.932 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.932 INFO:tasks.workunit.client.0.trial030.stdout: "store_stats": { 2026-02-17T05:27:47.932 INFO:tasks.workunit.client.0.trial030.stdout: "total": 0, 2026-02-17T05:27:47.932 INFO:tasks.workunit.client.0.trial030.stdout: "available": 0, 2026-02-17T05:27:47.932 INFO:tasks.workunit.client.0.trial030.stdout: "internally_reserved": 0, 2026-02-17T05:27:47.932 INFO:tasks.workunit.client.0.trial030.stdout: "allocated": 1228800, 2026-02-17T05:27:47.932 INFO:tasks.workunit.client.0.trial030.stdout: "data_stored": 153600, 2026-02-17T05:27:47.932 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed": 0, 2026-02-17T05:27:47.932 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_allocated": 0, 2026-02-17T05:27:47.933 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_original": 0, 2026-02-17T05:27:47.933 INFO:tasks.workunit.client.0.trial030.stdout: "omap_allocated": 0, 2026-02-17T05:27:47.933 INFO:tasks.workunit.client.0.trial030.stdout: "internal_metadata": 0 2026-02-17T05:27:47.933 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.933 INFO:tasks.workunit.client.0.trial030.stdout: "log_size": 16, 2026-02-17T05:27:47.933 INFO:tasks.workunit.client.0.trial030.stdout: "ondisk_log_size": 16, 2026-02-17T05:27:47.933 INFO:tasks.workunit.client.0.trial030.stdout: "up": 2, 2026-02-17T05:27:47.933 INFO:tasks.workunit.client.0.trial030.stdout: "acting": 2, 2026-02-17T05:27:47.933 INFO:tasks.workunit.client.0.trial030.stdout: "num_store_stats": 3 2026-02-17T05:27:47.933 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:27:47.933 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:27:47.933 INFO:tasks.workunit.client.0.trial030.stdout: "osd_stats": [ 2026-02-17T05:27:47.933 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.933 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 0, 2026-02-17T05:27:47.933 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 146028888073 2026-02-17T05:27:47.933 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.933 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.933 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 1, 2026-02-17T05:27:47.933 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 42949672972 2026-02-17T05:27:47.933 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.933 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.933 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2, 2026-02-17T05:27:47.933 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 154618822664 2026-02-17T05:27:47.933 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:27:47.933 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:27:47.933 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg_by_state": [ 2026-02-17T05:27:47.933 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.933 INFO:tasks.workunit.client.0.trial030.stdout: "state": "active+undersized+degraded", 2026-02-17T05:27:47.933 INFO:tasks.workunit.client.0.trial030.stdout: "num": 1 2026-02-17T05:27:47.934 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:27:47.934 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:27:47.934 INFO:tasks.workunit.client.0.trial030.stdout: "pool_pg_unavailable_map": [ 2026-02-17T05:27:47.934 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.934 INFO:tasks.workunit.client.0.trial030.stdout: "poolid": "1", 2026-02-17T05:27:47.934 INFO:tasks.workunit.client.0.trial030.stdout: "pgs": [] 2026-02-17T05:27:47.934 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:27:47.934 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:27:47.934 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg_by_osd": [ 2026-02-17T05:27:47.934 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.934 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2, 2026-02-17T05:27:47.934 INFO:tasks.workunit.client.0.trial030.stdout: "num_primary_pg": 0, 2026-02-17T05:27:47.934 INFO:tasks.workunit.client.0.trial030.stdout: "num_acting_pg": 1, 2026-02-17T05:27:47.934 INFO:tasks.workunit.client.0.trial030.stdout: "num_up_not_acting_pg": 0 2026-02-17T05:27:47.934 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.934 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.934 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 0, 2026-02-17T05:27:47.934 INFO:tasks.workunit.client.0.trial030.stdout: "num_primary_pg": 1, 2026-02-17T05:27:47.934 INFO:tasks.workunit.client.0.trial030.stdout: "num_acting_pg": 1, 2026-02-17T05:27:47.934 INFO:tasks.workunit.client.0.trial030.stdout: "num_up_not_acting_pg": 0 2026-02-17T05:27:47.934 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.934 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.934 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 1, 2026-02-17T05:27:47.934 INFO:tasks.workunit.client.0.trial030.stdout: "num_primary_pg": 0, 2026-02-17T05:27:47.934 INFO:tasks.workunit.client.0.trial030.stdout: "num_acting_pg": 0, 2026-02-17T05:27:47.934 INFO:tasks.workunit.client.0.trial030.stdout: "num_up_not_acting_pg": 0 2026-02-17T05:27:47.934 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:27:47.934 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:27:47.934 INFO:tasks.workunit.client.0.trial030.stdout: "purged_snaps": [ 2026-02-17T05:27:47.934 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:27:47.935 INFO:tasks.workunit.client.0.trial030.stdout: "pool": 1, 2026-02-17T05:27:47.935 INFO:tasks.workunit.client.0.trial030.stdout: "purged_snaps": {} 2026-02-17T05:27:47.935 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:27:47.935 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:27:47.935 INFO:tasks.workunit.client.0.trial030.stdout: "servicemap": { 2026-02-17T05:27:47.935 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 3, 2026-02-17T05:27:47.935 INFO:tasks.workunit.client.0.trial030.stdout: "modified": "2026-02-17T05:27:43.854320+0000", 2026-02-17T05:27:47.935 INFO:tasks.workunit.client.0.trial030.stdout: "services": { 2026-02-17T05:27:47.935 INFO:tasks.workunit.client.0.trial030.stdout: "osd": { 2026-02-17T05:27:47.935 INFO:tasks.workunit.client.0.trial030.stdout: "daemons": { 2026-02-17T05:27:47.935 INFO:tasks.workunit.client.0.trial030.stdout: "summary": "", 2026-02-17T05:27:47.935 INFO:tasks.workunit.client.0.trial030.stdout: "0": { 2026-02-17T05:27:47.935 INFO:tasks.workunit.client.0.trial030.stdout: "start_epoch": 0, 2026-02-17T05:27:47.935 INFO:tasks.workunit.client.0.trial030.stdout: "start_stamp": "0.000000", 2026-02-17T05:27:47.935 INFO:tasks.workunit.client.0.trial030.stdout: "gid": 0, 2026-02-17T05:27:47.935 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-17T05:27:47.935 INFO:tasks.workunit.client.0.trial030.stdout: "metadata": {}, 2026-02-17T05:27:47.935 INFO:tasks.workunit.client.0.trial030.stdout: "task_status": {} 2026-02-17T05:27:47.935 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.935 INFO:tasks.workunit.client.0.trial030.stdout: "2": { 2026-02-17T05:27:47.935 INFO:tasks.workunit.client.0.trial030.stdout: "start_epoch": 0, 2026-02-17T05:27:47.935 INFO:tasks.workunit.client.0.trial030.stdout: "start_stamp": "0.000000", 2026-02-17T05:27:47.935 INFO:tasks.workunit.client.0.trial030.stdout: "gid": 0, 2026-02-17T05:27:47.935 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-17T05:27:47.935 INFO:tasks.workunit.client.0.trial030.stdout: "metadata": {}, 2026-02-17T05:27:47.935 INFO:tasks.workunit.client.0.trial030.stdout: "task_status": {} 2026-02-17T05:27:47.935 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:27:47.935 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:27:47.935 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:27:47.935 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:27:47.935 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:27:47.936 INFO:tasks.workunit.client.0.trial030.stdout: "mgrstat_first_committed": 1, 2026-02-17T05:27:47.936 INFO:tasks.workunit.client.0.trial030.stdout: "mgrstat_last_committed": 36, 2026-02-17T05:27:47.936 INFO:tasks.workunit.client.0.trial030.stdout: "logm_first_committed": 1, 2026-02-17T05:27:47.936 INFO:tasks.workunit.client.0.trial030.stdout: "logm_last_committed": 225, 2026-02-17T05:27:47.936 INFO:tasks.workunit.client.0.trial030.stdout: "paxos": { 2026-02-17T05:27:47.936 INFO:tasks.workunit.client.0.trial030.stdout: "first_committed": 1, 2026-02-17T05:27:47.936 INFO:tasks.workunit.client.0.trial030.stdout: "last_committed": 311, 2026-02-17T05:27:47.936 INFO:tasks.workunit.client.0.trial030.stdout: "last_pn": 0, 2026-02-17T05:27:47.936 INFO:tasks.workunit.client.0.trial030.stdout: "accepted_pn": 0 2026-02-17T05:27:47.936 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:27:47.936 INFO:tasks.workunit.client.0.trial030.stdout:} 2026-02-17T05:27:47.936 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-17T05:27:47.936 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:150: TEST_divergent: expr 2 + 2 2026-02-17T05:27:47.936 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:150: TEST_divergent: objname=existing_4 2026-02-17T05:27:47.936 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:151: TEST_divergent: echo 'writing non-divergent object existing_4' 2026-02-17T05:27:47.937 INFO:tasks.workunit.client.0.trial030.stdout:writing non-divergent object existing_4 2026-02-17T05:27:47.937 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:152: TEST_divergent: ceph pg dump pgs 2026-02-17T05:27:48.077 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T05:27:48.077 INFO:tasks.workunit.client.0.trial030.stdout:1.0 100 0 100 0 0 51200 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:27:18.160784+0000 27'100 39:132 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:26:47.528723+0000 0'0 2026-02-17T05:26:47.528723+0000 0 0 periodic scrub scheduled @ 2026-02-18T13:23:45.895516+0000 0 0 2026-02-17T05:27:48.077 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-17T05:27:48.077 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T05:27:48.077 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:27:48.088 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:154: TEST_divergent: dd if=/dev/urandom bs=1000 count=1 2026-02-17T05:27:48.088 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:154: TEST_divergent: rados -p test put existing_4 - 2026-02-17T05:27:48.089 INFO:tasks.workunit.client.0.trial030.stderr:1+0 records in 2026-02-17T05:27:48.089 INFO:tasks.workunit.client.0.trial030.stderr:1+0 records out 2026-02-17T05:27:48.089 INFO:tasks.workunit.client.0.trial030.stderr:1000 bytes (1.0 kB) copied, 2.8865e-05 s, 34.6 MB/s 2026-02-17T05:27:48.111 INFO:tasks.workunit.client.0.trial030.stdout:delay recovery 2026-02-17T05:27:48.112 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:157: TEST_divergent: echo 'delay recovery' 2026-02-17T05:27:48.112 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:158: TEST_divergent: ceph pg dump pgs 2026-02-17T05:27:48.314 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T05:27:48.314 INFO:tasks.workunit.client.0.trial030.stdout:1.0 100 0 100 0 0 51200 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:27:18.160784+0000 27'100 39:132 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:26:47.528723+0000 0'0 2026-02-17T05:26:47.528723+0000 0 0 periodic scrub scheduled @ 2026-02-18T13:23:45.895516+0000 0 0 2026-02-17T05:27:48.315 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-17T05:27:48.315 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T05:27:48.315 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:27:48.323 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:159: TEST_divergent: for i in $non_divergent 2026-02-17T05:27:48.324 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: get_asok_path osd.0 2026-02-17T05:27:48.324 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-17T05:27:48.324 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-17T05:27:48.324 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T05:27:48.325 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:27:48.325 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:27:48.325 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19532/ceph-osd.0.asok 2026-02-17T05:27:48.325 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: CEPH_ARGS= 2026-02-17T05:27:48.325 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.19532/ceph-osd.0.asok set_recovery_delay 100000 2026-02-17T05:27:48.380 INFO:tasks.workunit.client.0.trial030.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-17T05:27:48.385 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:159: TEST_divergent: for i in $non_divergent 2026-02-17T05:27:48.386 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: get_asok_path osd.2 2026-02-17T05:27:48.387 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-17T05:27:48.387 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-17T05:27:48.387 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T05:27:48.387 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:27:48.387 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:27:48.387 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19532/ceph-osd.2.asok 2026-02-17T05:27:48.388 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: CEPH_ARGS= 2026-02-17T05:27:48.388 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.19532/ceph-osd.2.asok set_recovery_delay 100000 2026-02-17T05:27:48.442 INFO:tasks.workunit.client.0.trial030.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-17T05:27:48.447 INFO:tasks.workunit.client.0.trial030.stdout:revive divergent 1 2026-02-17T05:27:48.447 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:165: TEST_divergent: echo 'revive divergent 1' 2026-02-17T05:27:48.447 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:166: TEST_divergent: ceph pg dump pgs 2026-02-17T05:27:48.668 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T05:27:48.668 INFO:tasks.workunit.client.0.trial030.stdout:1.0 100 0 100 0 0 51200 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:27:18.160784+0000 27'100 39:132 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:26:47.528723+0000 0'0 2026-02-17T05:26:47.528723+0000 0 0 periodic scrub scheduled @ 2026-02-18T13:23:45.895516+0000 0 0 2026-02-17T05:27:48.668 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-17T05:27:48.668 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T05:27:48.668 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:27:48.677 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:167: TEST_divergent: ceph osd set noup 2026-02-17T05:27:49.004 INFO:tasks.workunit.client.0.trial030.stderr:noup is set 2026-02-17T05:27:49.018 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:168: TEST_divergent: activate_osd td/divergent-priors 1 2026-02-17T05:27:49.018 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-17T05:27:49.018 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T05:27:49.018 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T05:27:49.019 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T05:27:49.019 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-17T05:27:49.019 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T05:27:49.019 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:27:49.019 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:27:49.019 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:27:49.019 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-17T05:27:49.019 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-17T05:27:49.019 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T05:27:49.019 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T05:27:49.019 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T05:27:49.020 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T05:27:49.020 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:27:49.020 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:27:49.020 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:27:49.020 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:27:49.020 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:27:49.020 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:27:49.020 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:27:49.020 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:27:49.020 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T05:27:49.020 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T05:27:49.020 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:27:49.020 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:27:49.020 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:27:49.021 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:27:49.021 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T05:27:49.021 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T05:27:49.021 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-17T05:27:49.021 INFO:tasks.workunit.client.0.trial030.stdout:start osd.1 2026-02-17T05:27:49.022 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T05:27:49.022 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T05:27:49.022 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-17T05:27:49.022 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T05:27:49.022 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T05:27:49.022 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T05:27:49.023 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T05:27:49.046 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:27:49.040+0000 7efc0b1d7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:27:49.048 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:27:49.044+0000 7efc0b1d7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:27:49.049 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:27:49.044+0000 7efc0b1d7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:27:49.241 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: return 0 2026-02-17T05:27:49.241 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:169: TEST_divergent: sleep 5 2026-02-17T05:27:49.396 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:27:49.392+0000 7efc0b1d7a40 -1 Falling back to public interface 2026-02-17T05:27:50.016 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:27:50.012+0000 7efc0b1d7a40 -1 osd.1 27 log_to_monitors true 2026-02-17T05:27:54.242 INFO:tasks.workunit.client.0.trial030.stdout:delay recovery divergent 2026-02-17T05:27:54.243 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:171: TEST_divergent: echo 'delay recovery divergent' 2026-02-17T05:27:54.243 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:172: TEST_divergent: ceph pg dump pgs 2026-02-17T05:27:54.443 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T05:27:54.443 INFO:tasks.workunit.client.0.trial030.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-17T05:27:18.160784+0000 39'101 42:138 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:26:47.528723+0000 0'0 2026-02-17T05:26:47.528723+0000 0 0 periodic scrub scheduled @ 2026-02-18T13:23:45.895516+0000 0 0 2026-02-17T05:27:54.443 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-17T05:27:54.443 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T05:27:54.444 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:27:54.452 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:173: TEST_divergent: get_asok_path osd.1 2026-02-17T05:27:54.452 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-17T05:27:54.452 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-17T05:27:54.453 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T05:27:54.453 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:27:54.453 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:27:54.453 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19532/ceph-osd.1.asok 2026-02-17T05:27:54.453 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:173: TEST_divergent: CEPH_ARGS= 2026-02-17T05:27:54.453 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:173: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.19532/ceph-osd.1.asok set_recovery_delay 100000 2026-02-17T05:27:54.509 INFO:tasks.workunit.client.0.trial030.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-17T05:27:54.514 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:175: TEST_divergent: ceph osd unset noup 2026-02-17T05:27:54.828 INFO:tasks.workunit.client.0.trial030.stderr:noup is unset 2026-02-17T05:27:54.841 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:177: TEST_divergent: wait_for_osd up 0 2026-02-17T05:27:54.841 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:27:54.841 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T05:27:54.841 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:27:54.842 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:27:54.842 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:27:54.842 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:27:54.842 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:27:54.843 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:27:54.843 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T05:27:55.058 INFO:tasks.workunit.client.0.trial030.stdout:osd.0 up in weight 1 up_from 34 up_thru 38 down_at 28 last_clean_interval [5,27) [v2:127.0.0.1:6800/1366271510,v1:127.0.0.1:6801/1366271510] [v2:127.0.0.1:6802/1366271510,v1:127.0.0.1:6803/1366271510] exists,up 352e74ee-ecc2-4670-94d6-94c5b9b5c4be 2026-02-17T05:27:55.059 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:27:55.059 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:27:55.059 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:27:55.059 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:178: TEST_divergent: wait_for_osd up 1 2026-02-17T05:27:55.059 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:27:55.059 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T05:27:55.059 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:27:55.059 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:27:55.059 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:27:55.059 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:27:55.059 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:27:55.060 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:27:55.060 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T05:27:55.271 INFO:tasks.workunit.client.0.trial030.stdout:osd.1 up in weight 1 up_from 44 up_thru 44 down_at 29 last_clean_interval [10,27) [v2:127.0.0.1:6818/699098196,v1:127.0.0.1:6819/699098196] [v2:127.0.0.1:6820/699098196,v1:127.0.0.1:6821/699098196] exists,up 5524a34c-0b5e-410e-8b07-ebafda9e86f0 2026-02-17T05:27:55.272 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:27:55.272 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:27:55.272 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:27:55.272 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:179: TEST_divergent: wait_for_osd up 2 2026-02-17T05:27:55.272 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:27:55.272 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T05:27:55.272 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:27:55.272 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:27:55.272 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:27:55.272 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:27:55.272 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:27:55.272 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:27:55.272 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T05:27:55.484 INFO:tasks.workunit.client.0.trial030.stdout:osd.2 up in weight 1 up_from 36 up_thru 0 down_at 30 last_clean_interval [14,27) [v2:127.0.0.1:6810/2487313544,v1:127.0.0.1:6811/2487313544] [v2:127.0.0.1:6812/2487313544,v1:127.0.0.1:6813/2487313544] exists,up e4a4420b-77ab-4a4b-a531-61a8b5f39ca2 2026-02-17T05:27:55.484 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:27:55.484 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:27:55.485 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:27:55.485 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:181: TEST_divergent: ceph pg dump pgs 2026-02-17T05:27:55.686 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T05:27:55.686 INFO:tasks.workunit.client.0.trial030.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-17T05:27:18.160784+0000 39'101 42:138 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:26:47.528723+0000 0'0 2026-02-17T05:26:47.528723+0000 0 0 periodic scrub scheduled @ 2026-02-18T13:23:45.895516+0000 0 0 2026-02-17T05:27:55.686 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-17T05:27:55.686 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T05:27:55.687 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:27:55.694 INFO:tasks.workunit.client.0.trial030.stdout:wait for peering 2026-02-17T05:27:55.695 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:182: TEST_divergent: echo 'wait for peering' 2026-02-17T05:27:55.695 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:183: TEST_divergent: ceph pg dump pgs 2026-02-17T05:27:55.903 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T05:27:55.903 INFO:tasks.workunit.client.0.trial030.stdout:1.0 100 2 2 0 0 51688 0 0 17 84 17 active+recovering+degraded 2026-02-17T05:27:54.931494+0000 39'101 45:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:26:47.528723+0000 0'0 2026-02-17T05:26:47.528723+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:27:55.903 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-17T05:27:55.903 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T05:27:55.903 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:27:55.914 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:184: TEST_divergent: rados -p test put foo /tmp/tmp.8HyEvfVyHy 2026-02-17T05:27:55.937 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:186: TEST_divergent: echo 'killing divergent 1' 2026-02-17T05:27:55.938 INFO:tasks.workunit.client.0.trial030.stdout:killing divergent 1 2026-02-17T05:27:55.938 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:187: TEST_divergent: ceph pg dump pgs 2026-02-17T05:27:56.148 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T05:27:56.148 INFO:tasks.workunit.client.0.trial030.stdout:1.0 100 2 2 0 0 51688 0 0 17 84 17 active+recovering+degraded 2026-02-17T05:27:54.931494+0000 39'101 45:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:26:47.528723+0000 0'0 2026-02-17T05:26:47.528723+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:27:56.148 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-17T05:27:56.148 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T05:27:56.148 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:27:56.157 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:188: TEST_divergent: kill_daemons td/divergent-priors KILL osd.1 2026-02-17T05:27:56.157 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:27:56.157 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:27:56.158 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:27:56.158 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:27:56.158 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:27:56.265 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:27:56.265 INFO:tasks.workunit.client.0.trial030.stdout:reviving divergent 1 2026-02-17T05:27:56.265 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:190: TEST_divergent: echo 'reviving divergent 1' 2026-02-17T05:27:56.265 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:191: TEST_divergent: ceph pg dump pgs 2026-02-17T05:27:56.463 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T05:27:56.463 INFO:tasks.workunit.client.0.trial030.stdout:1.0 100 2 2 0 0 51688 0 0 17 84 17 active+recovering+degraded 2026-02-17T05:27:54.931494+0000 39'101 45:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:26:47.528723+0000 0'0 2026-02-17T05:26:47.528723+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:27:56.463 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-17T05:27:56.463 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T05:27:56.463 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:27:56.472 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:192: TEST_divergent: activate_osd td/divergent-priors 1 2026-02-17T05:27:56.472 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-17T05:27:56.472 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T05:27:56.472 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T05:27:56.472 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T05:27:56.472 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-17T05:27:56.472 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T05:27:56.472 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:27:56.472 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:27:56.472 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:27:56.472 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-17T05:27:56.472 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-17T05:27:56.472 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T05:27:56.472 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T05:27:56.472 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T05:27:56.473 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T05:27:56.473 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:27:56.473 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:27:56.473 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:27:56.473 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:27:56.473 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:27:56.473 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:27:56.473 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:27:56.473 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:27:56.473 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T05:27:56.473 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T05:27:56.473 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:27:56.474 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:27:56.474 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:27:56.474 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:27:56.474 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T05:27:56.474 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T05:27:56.474 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-17T05:27:56.474 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T05:27:56.474 INFO:tasks.workunit.client.0.trial030.stdout:start osd.1 2026-02-17T05:27:56.475 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T05:27:56.475 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-17T05:27:56.476 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T05:27:56.476 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T05:27:56.476 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T05:27:56.477 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T05:27:56.495 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:27:56.492+0000 7fa3a3efea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:27:56.497 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:27:56.492+0000 7fa3a3efea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:27:56.498 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:27:56.492+0000 7fa3a3efea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:27:56.691 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T05:27:56.691 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:27:56.692 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T05:27:56.692 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:27:56.692 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:27:56.692 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:27:56.692 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:27:56.693 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:27:56.693 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:27:56.693 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T05:27:56.916 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:27:56.912+0000 7fa3a3efea40 -1 Falling back to public interface 2026-02-17T05:27:56.919 INFO:tasks.workunit.client.0.trial030.stdout:osd.1 up in weight 1 up_from 44 up_thru 44 down_at 29 last_clean_interval [10,27) [v2:127.0.0.1:6818/699098196,v1:127.0.0.1:6819/699098196] [v2:127.0.0.1:6820/699098196,v1:127.0.0.1:6821/699098196] exists,up 5524a34c-0b5e-410e-8b07-ebafda9e86f0 2026-02-17T05:27:56.919 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:27:56.919 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:27:56.919 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:27:56.919 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:194: TEST_divergent: sleep 20 2026-02-17T05:27:57.542 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:27:57.536+0000 7fa3a3efea40 -1 osd.1 46 log_to_monitors true 2026-02-17T05:28:16.921 INFO:tasks.workunit.client.0.trial030.stdout:allowing recovery 2026-02-17T05:28:16.921 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:196: TEST_divergent: echo 'allowing recovery' 2026-02-17T05:28:16.921 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:197: TEST_divergent: ceph pg dump pgs 2026-02-17T05:28:17.129 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T05:28:17.129 INFO:tasks.workunit.client.0.trial030.stdout:1.0 101 0 0 0 0 52200 0 0 18 84 18 active+clean 2026-02-17T05:27:58.759780+0000 46'102 50:163 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:26:47.528723+0000 0'0 2026-02-17T05:26:47.528723+0000 0 0 periodic scrub scheduled @ 2026-02-18T11:07:31.808085+0000 0 0 2026-02-17T05:28:17.129 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-17T05:28:17.129 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T05:28:17.130 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:28:17.138 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:199: TEST_divergent: for i in $osds 2026-02-17T05:28:17.138 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:201: TEST_divergent: ceph tell osd.0 debug kick_recovery_wq 0 2026-02-17T05:28:17.229 INFO:tasks.workunit.client.0.trial030.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-17T05:28:17.236 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:199: TEST_divergent: for i in $osds 2026-02-17T05:28:17.236 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:201: TEST_divergent: ceph tell osd.1 debug kick_recovery_wq 0 2026-02-17T05:28:17.315 INFO:tasks.workunit.client.0.trial030.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-17T05:28:17.322 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:199: TEST_divergent: for i in $osds 2026-02-17T05:28:17.322 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:201: TEST_divergent: ceph tell osd.2 debug kick_recovery_wq 0 2026-02-17T05:28:17.403 INFO:tasks.workunit.client.0.trial030.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-17T05:28:17.410 INFO:tasks.workunit.client.0.trial030.stdout:reading divergent objects 2026-02-17T05:28:17.410 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:204: TEST_divergent: echo 'reading divergent objects' 2026-02-17T05:28:17.411 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:205: TEST_divergent: ceph pg dump pgs 2026-02-17T05:28:17.620 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T05:28:17.620 INFO:tasks.workunit.client.0.trial030.stdout:1.0 101 0 0 0 0 52200 0 0 18 84 18 active+clean 2026-02-17T05:27:58.759780+0000 46'102 50:163 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:26:47.528723+0000 0'0 2026-02-17T05:26:47.528723+0000 0 0 periodic scrub scheduled @ 2026-02-18T11:07:31.808085+0000 0 0 2026-02-17T05:28:17.620 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-17T05:28:17.620 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T05:28:17.620 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:28:17.630 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: expr 2 + 2 2026-02-17T05:28:17.631 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: seq 1 4 2026-02-17T05:28:17.632 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T05:28:17.632 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:208: TEST_divergent: rados -p test get existing_1 td/divergent-priors/existing 2026-02-17T05:28:17.653 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T05:28:17.653 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:208: TEST_divergent: rados -p test get existing_2 td/divergent-priors/existing 2026-02-17T05:28:17.684 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T05:28:17.684 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:208: TEST_divergent: rados -p test get existing_3 td/divergent-priors/existing 2026-02-17T05:28:17.709 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T05:28:17.710 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:208: TEST_divergent: rados -p test get existing_4 td/divergent-priors/existing 2026-02-17T05:28:17.729 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:210: TEST_divergent: rm -f td/divergent-priors/existing 2026-02-17T05:28:17.730 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:212: TEST_divergent: find td/divergent-priors -name '*osd*log' 2026-02-17T05:28:17.731 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:212: TEST_divergent: grep _merge_object_divergent_entries td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-17T05:28:17.736 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:27:54.900+0000 7efbe9155640 20 _merge_object_divergent_entries: merging hoid 1:c156033e:::existing_100:head entries: 27'101 (27'100) modify 1:c156033e:::existing_100:head by client.4532.0:1 2026-02-17T05:27:01.881231+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-17T05:28:17.736 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:27:54.900+0000 7efbe9155640 20 _merge_object_divergent_entries: keeping 27'101 (27'100) modify 1:c156033e:::existing_100:head by client.4532.0:1 2026-02-17T05:27:01.881231+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-17T05:28:17.736 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:27:54.900+0000 7efbe9155640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-17T05:28:17.736 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:27:54.900+0000 7efbe9155640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head prior_version: 27'100 first_divergent_update: 27'101 last_divergent_update: 27'101 2026-02-17T05:28:17.736 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:27:54.900+0000 7efbe9155640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head has no more recent entries in log 2026-02-17T05:28:17.736 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:27:54.900+0000 7efbe9155640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head must be rolled back or recovered, attempting to rollback 2026-02-17T05:28:17.736 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:27:54.900+0000 7efbe9155640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head olog_can_rollback_to: 27'101 2026-02-17T05:28:17.737 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:27:54.900+0000 7efbe9155640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head cannot rollback 27'101 (27'100) modify 1:c156033e:::existing_100:head by client.4532.0:1 2026-02-17T05:27:01.881231+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-17T05:28:17.737 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:27:54.900+0000 7efbe9155640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head cannot roll back, removing and adding to missing 2026-02-17T05:28:17.737 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:214: TEST_divergent: find td/divergent-priors -name '*osd*log' 2026-02-17T05:28:17.738 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:214: TEST_divergent: grep -q '_merge_object_divergent_entries.*cannot roll back, removing and adding to missing' td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-17T05:28:17.740 INFO:tasks.workunit.client.0.trial030.stdout:success 2026-02-17T05:28:17.740 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:219: TEST_divergent: echo success 2026-02-17T05:28:17.741 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:221: TEST_divergent: rm -f /tmp/tmp.8HyEvfVyHy 2026-02-17T05:28:17.741 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:222: TEST_divergent: delete_pool test 2026-02-17T05:28:17.741 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test 2026-02-17T05:28:17.742 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2026-02-17T05:28:18.007 INFO:tasks.workunit.client.0.trial030.stderr:pool 'test' does not exist 2026-02-17T05:28:18.016 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:223: TEST_divergent: kill_daemons td/divergent-priors 2026-02-17T05:28:18.016 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:28:18.016 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:28:18.017 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:28:18.017 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:28:18.017 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:28:23.333 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:28:23.333 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:47: run: teardown td/divergent-priors 2026-02-17T05:28:23.333 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-17T05:28:23.334 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T05:28:23.334 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-17T05:28:23.334 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:28:23.334 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:28:23.335 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:28:23.335 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:28:23.335 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:28:23.340 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:28:23.341 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T05:28:23.342 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T05:28:23.342 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T05:28:23.343 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T05:28:23.344 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T05:28:23.344 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T05:28:23.345 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:28:23.345 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T05:28:23.346 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T05:28:23.346 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:28:23.347 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T05:28:23.348 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T05:28:23.348 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-17T05:28:23.368 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T05:28:23.368 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:28:23.368 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:28:23.368 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.19532 2026-02-17T05:28:23.370 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T05:28:23.370 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T05:28:23.370 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:44: run: for func in $funcs 2026-02-17T05:28:23.371 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:45: run: setup td/divergent-priors 2026-02-17T05:28:23.371 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/divergent-priors 2026-02-17T05:28:23.371 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/divergent-priors 2026-02-17T05:28:23.371 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-17T05:28:23.371 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T05:28:23.371 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-17T05:28:23.371 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:28:23.371 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:28:23.371 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:28:23.371 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:28:23.371 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:28:23.372 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:28:23.373 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T05:28:23.373 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T05:28:23.374 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T05:28:23.375 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T05:28:23.375 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T05:28:23.375 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T05:28:23.376 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:28:23.376 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T05:28:23.377 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T05:28:23.377 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:28:23.378 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T05:28:23.379 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T05:28:23.379 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-17T05:28:23.380 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T05:28:23.380 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:28:23.380 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:28:23.380 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.19532 2026-02-17T05:28:23.381 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T05:28:23.382 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T05:28:23.382 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/divergent-priors 2026-02-17T05:28:23.383 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T05:28:23.383 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:28:23.383 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:28:23.383 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.19532 2026-02-17T05:28:23.384 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T05:28:23.385 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-17T05:28:23.385 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T05:28:23.385 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/divergent-priors 1' TERM HUP INT 2026-02-17T05:28:23.385 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:46: run: TEST_divergent_2 td/divergent-priors 2026-02-17T05:28:23.385 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:422: TEST_divergent_2: local dir=td/divergent-priors 2026-02-17T05:28:23.385 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:424: TEST_divergent_2: file_with_random_data 2026-02-17T05:28:23.385 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=512 2026-02-17T05:28:23.386 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-17T05:28:23.386 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:23.387 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.EN2bIN7jPO bs=512 count=1 2026-02-17T05:28:23.388 INFO:tasks.workunit.client.0.trial030.stderr:1+0 records in 2026-02-17T05:28:23.388 INFO:tasks.workunit.client.0.trial030.stderr:1+0 records out 2026-02-17T05:28:23.388 INFO:tasks.workunit.client.0.trial030.stderr:512 bytes copied, 0.00025219 s, 2.0 MB/s 2026-02-17T05:28:23.388 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:23.388 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:424: TEST_divergent_2: local dummyfile=/tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:23.389 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:426: TEST_divergent_2: file_with_random_data 1000 2026-02-17T05:28:23.389 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=1000 2026-02-17T05:28:23.389 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-17T05:28:23.390 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.3XecWzKabF 2026-02-17T05:28:23.390 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.3XecWzKabF bs=1000 count=1 2026-02-17T05:28:23.391 INFO:tasks.workunit.client.0.trial030.stderr:1+0 records in 2026-02-17T05:28:23.391 INFO:tasks.workunit.client.0.trial030.stderr:1+0 records out 2026-02-17T05:28:23.391 INFO:tasks.workunit.client.0.trial030.stderr:1000 bytes (1.0 kB) copied, 0.000106147 s, 9.4 MB/s 2026-02-17T05:28:23.391 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.3XecWzKabF 2026-02-17T05:28:23.392 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:426: TEST_divergent_2: local dummyfile2=/tmp/tmp.3XecWzKabF 2026-02-17T05:28:23.392 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:428: TEST_divergent_2: local num_osds=3 2026-02-17T05:28:23.392 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:429: TEST_divergent_2: expr 3 - 1 2026-02-17T05:28:23.393 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:429: TEST_divergent_2: seq 0 2 2026-02-17T05:28:23.395 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:429: TEST_divergent_2: local 'osds=0 2026-02-17T05:28:23.395 INFO:tasks.workunit.client.0.trial030.stderr:1 2026-02-17T05:28:23.395 INFO:tasks.workunit.client.0.trial030.stderr:2' 2026-02-17T05:28:23.395 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:430: TEST_divergent_2: run_mon td/divergent-priors a 2026-02-17T05:28:23.395 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/divergent-priors 2026-02-17T05:28:23.395 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T05:28:23.395 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T05:28:23.395 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T05:28:23.396 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/divergent-priors/a 2026-02-17T05:28:23.396 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/divergent-priors/a --run-dir=td/divergent-priors 2026-02-17T05:28:23.418 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T05:28:23.418 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:28:23.418 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:28:23.419 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:28:23.419 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:28:23.419 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:28:23.419 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:28:23.419 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/divergent-priors/a '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' --mon-cluster-log-file=td/divergent-priors/log --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T05:28:23.448 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T05:28:23.449 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T05:28:23.449 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T05:28:23.449 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T05:28:23.449 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T05:28:23.449 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T05:28:23.450 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T05:28:23.450 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T05:28:23.450 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T05:28:23.450 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T05:28:23.450 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:28:23.450 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:28:23.450 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19532/ceph-mon.a.asok 2026-02-17T05:28:23.451 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T05:28:23.451 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.19532/ceph-mon.a.asok config get fsid 2026-02-17T05:28:23.507 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T05:28:23.507 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T05:28:23.507 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T05:28:23.507 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T05:28:23.507 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T05:28:23.507 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T05:28:23.507 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T05:28:23.507 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T05:28:23.508 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T05:28:23.509 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:28:23.509 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:28:23.509 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19532/ceph-mon.a.asok 2026-02-17T05:28:23.509 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T05:28:23.509 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.19532/ceph-mon.a.asok config get mon_host 2026-02-17T05:28:23.561 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:431: TEST_divergent_2: run_mgr td/divergent-priors x 2026-02-17T05:28:23.562 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/divergent-priors 2026-02-17T05:28:23.562 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T05:28:23.562 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T05:28:23.562 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T05:28:23.562 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/divergent-priors/x 2026-02-17T05:28:23.562 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T05:28:23.672 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T05:28:23.672 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:28:23.672 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:28:23.672 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:28:23.672 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:28:23.672 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:28:23.672 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:28:23.673 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T05:28:23.674 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/divergent-priors/x '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T05:28:23.697 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:432: TEST_divergent_2: for i in $osds 2026-02-17T05:28:23.698 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:434: TEST_divergent_2: run_osd td/divergent-priors 0 2026-02-17T05:28:23.698 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-17T05:28:23.698 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T05:28:23.698 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T05:28:23.698 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T05:28:23.698 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/0 2026-02-17T05:28:23.698 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T05:28:23.698 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:28:23.698 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:28:23.698 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:28:23.698 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-17T05:28:23.699 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-17T05:28:23.699 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T05:28:23.699 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T05:28:23.699 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T05:28:23.699 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T05:28:23.699 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:28:23.699 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:28:23.699 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:28:23.699 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:28:23.699 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:28:23.699 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:28:23.699 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:28:23.700 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:28:23.700 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T05:28:23.700 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T05:28:23.700 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T05:28:23.700 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T05:28:23.700 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:28:23.700 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:28:23.700 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:28:23.700 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:28:23.700 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T05:28:23.700 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T05:28:23.700 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/0 2026-02-17T05:28:23.701 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T05:28:23.701 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=65554143-3837-4f4a-8373-1db6c1d20c59 2026-02-17T05:28:23.702 INFO:tasks.workunit.client.0.trial030.stdout:add osd0 65554143-3837-4f4a-8373-1db6c1d20c59 2026-02-17T05:28:23.702 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 65554143-3837-4f4a-8373-1db6c1d20c59' 2026-02-17T05:28:23.702 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T05:28:23.712 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQB3/JNpVG1jKhAAP1yEElnmBOUuj8lg/TKIwg== 2026-02-17T05:28:23.712 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQB3/JNpVG1jKhAAP1yEElnmBOUuj8lg/TKIwg=="}' 2026-02-17T05:28:23.712 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 65554143-3837-4f4a-8373-1db6c1d20c59 -i td/divergent-priors/0/new.json 2026-02-17T05:28:23.831 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:28:23.839 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/0/new.json 2026-02-17T05:28:23.840 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQB3/JNpVG1jKhAAP1yEElnmBOUuj8lg/TKIwg== --osd-uuid 65554143-3837-4f4a-8373-1db6c1d20c59 2026-02-17T05:28:23.860 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:28:23.856+0000 7fe826d50a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:28:23.861 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:28:23.856+0000 7fe826d50a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:28:23.862 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:28:23.860+0000 7fe826d50a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:28:23.863 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:28:23.860+0000 7fe826d50a40 -1 bdev(0x55d912d5a400 td/divergent-priors/0/block) open stat got: (1) Operation not permitted 2026-02-17T05:28:23.863 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:28:23.860+0000 7fe826d50a40 -1 bluestore(td/divergent-priors/0) _read_fsid unparsable uuid 2026-02-17T05:28:24.641 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/0/keyring 2026-02-17T05:28:24.642 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T05:28:24.643 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T05:28:24.643 INFO:tasks.workunit.client.0.trial030.stdout:adding osd0 key to auth repository 2026-02-17T05:28:24.644 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T05:28:24.765 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T05:28:24.766 INFO:tasks.workunit.client.0.trial030.stdout:start osd.0 2026-02-17T05:28:24.767 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T05:28:24.767 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T05:28:24.767 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T05:28:24.767 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T05:28:24.797 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:28:24.792+0000 7f3f51efba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:28:24.799 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:28:24.796+0000 7f3f51efba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:28:24.800 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:28:24.796+0000 7f3f51efba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:28:24.879 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T05:28:24.879 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:28:24.879 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T05:28:24.879 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:28:24.879 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:28:24.879 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:28:24.879 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:28:24.879 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:28:24.880 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:28:24.880 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T05:28:24.988 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:28:25.212 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:28:25.208+0000 7f3f51efba40 -1 Falling back to public interface 2026-02-17T05:28:25.989 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:28:25.989 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:28:25.989 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T05:28:25.989 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-17T05:28:25.990 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:28:25.990 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T05:28:26.205 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:28:26.199+0000 7f3f51efba40 -1 osd.0 0 log_to_monitors true 2026-02-17T05:28:26.206 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:28:27.207 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:28:27.207 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:28:27.208 INFO:tasks.workunit.client.0.trial030.stdout:2 2026-02-17T05:28:27.208 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T05:28:27.209 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:28:27.209 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T05:28:27.420 INFO:tasks.workunit.client.0.trial030.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/432937877,v1:127.0.0.1:6801/432937877] [v2:127.0.0.1:6802/432937877,v1:127.0.0.1:6803/432937877] exists,up 65554143-3837-4f4a-8373-1db6c1d20c59 2026-02-17T05:28:27.424 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:28:27.424 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:28:27.424 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:28:27.424 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:432: TEST_divergent_2: for i in $osds 2026-02-17T05:28:27.424 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:434: TEST_divergent_2: run_osd td/divergent-priors 1 2026-02-17T05:28:27.424 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-17T05:28:27.424 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T05:28:27.424 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-17T05:28:27.424 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T05:28:27.424 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/1 2026-02-17T05:28:27.425 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T05:28:27.425 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:28:27.425 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:28:27.425 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:28:27.425 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-17T05:28:27.425 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-17T05:28:27.425 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T05:28:27.425 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T05:28:27.425 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T05:28:27.425 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T05:28:27.425 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:28:27.425 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:28:27.426 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:28:27.426 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:28:27.426 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:28:27.426 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:28:27.426 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:28:27.426 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:28:27.426 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T05:28:27.426 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T05:28:27.426 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T05:28:27.426 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T05:28:27.426 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:28:27.426 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:28:27.426 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:28:27.427 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:28:27.427 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T05:28:27.427 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T05:28:27.427 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/1 2026-02-17T05:28:27.428 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T05:28:27.428 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=1895d426-e99b-4201-96c2-911240090080 2026-02-17T05:28:27.428 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 1895d426-e99b-4201-96c2-911240090080' 2026-02-17T05:28:27.428 INFO:tasks.workunit.client.0.trial030.stdout:add osd1 1895d426-e99b-4201-96c2-911240090080 2026-02-17T05:28:27.429 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T05:28:27.440 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQB7/JNpW4IpGhAAIh6tGZXRONZG9rV/c1wCwA== 2026-02-17T05:28:27.440 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQB7/JNpW4IpGhAAIh6tGZXRONZG9rV/c1wCwA=="}' 2026-02-17T05:28:27.440 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 1895d426-e99b-4201-96c2-911240090080 -i td/divergent-priors/1/new.json 2026-02-17T05:28:27.665 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-17T05:28:27.673 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/1/new.json 2026-02-17T05:28:27.674 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQB7/JNpW4IpGhAAIh6tGZXRONZG9rV/c1wCwA== --osd-uuid 1895d426-e99b-4201-96c2-911240090080 2026-02-17T05:28:27.694 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:28:27.687+0000 7fe5be85da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:28:27.695 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:28:27.691+0000 7fe5be85da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:28:27.696 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:28:27.691+0000 7fe5be85da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:28:27.697 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:28:27.691+0000 7fe5be85da40 -1 bdev(0x55f7dce80400 td/divergent-priors/1/block) open stat got: (1) Operation not permitted 2026-02-17T05:28:27.697 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:28:27.691+0000 7fe5be85da40 -1 bluestore(td/divergent-priors/1) _read_fsid unparsable uuid 2026-02-17T05:28:28.327 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/1/keyring 2026-02-17T05:28:28.327 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T05:28:28.328 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-17T05:28:28.328 INFO:tasks.workunit.client.0.trial030.stdout:adding osd1 key to auth repository 2026-02-17T05:28:28.328 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T05:28:28.620 INFO:tasks.workunit.client.0.trial030.stdout:start osd.1 2026-02-17T05:28:28.620 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-17T05:28:28.620 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T05:28:28.620 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T05:28:28.620 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T05:28:28.621 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T05:28:28.649 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:28:28.643+0000 7f32fcce8a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:28:28.651 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:28:28.647+0000 7f32fcce8a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:28:28.652 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:28:28.647+0000 7f32fcce8a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:28:28.843 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-17T05:28:28.843 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:28:28.843 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T05:28:28.843 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:28:28.843 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:28:28.843 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:28:28.844 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:28:28.844 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:28:28.844 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:28:28.844 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T05:28:29.059 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:28:29.108 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:28:29.103+0000 7f32fcce8a40 -1 Falling back to public interface 2026-02-17T05:28:29.747 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:28:29.743+0000 7f32fcce8a40 -1 osd.1 0 log_to_monitors true 2026-02-17T05:28:30.060 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:28:30.060 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:28:30.060 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T05:28:30.060 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-17T05:28:30.060 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:28:30.060 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T05:28:30.294 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:28:31.295 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:28:31.295 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:28:31.295 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T05:28:31.296 INFO:tasks.workunit.client.0.trial030.stdout:2 2026-02-17T05:28:31.296 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:28:31.296 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T05:28:31.512 INFO:tasks.workunit.client.0.trial030.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/418378196,v1:127.0.0.1:6811/418378196] [v2:127.0.0.1:6812/418378196,v1:127.0.0.1:6813/418378196] exists,up 1895d426-e99b-4201-96c2-911240090080 2026-02-17T05:28:31.515 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:28:31.516 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:28:31.516 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:28:31.516 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:432: TEST_divergent_2: for i in $osds 2026-02-17T05:28:31.516 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:434: TEST_divergent_2: run_osd td/divergent-priors 2 2026-02-17T05:28:31.516 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-17T05:28:31.516 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T05:28:31.516 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-17T05:28:31.516 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T05:28:31.517 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/2 2026-02-17T05:28:31.517 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T05:28:31.517 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:28:31.517 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:28:31.517 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:28:31.517 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-17T05:28:31.517 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-17T05:28:31.517 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T05:28:31.517 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T05:28:31.517 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T05:28:31.518 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T05:28:31.518 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:28:31.518 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:28:31.518 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:28:31.518 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:28:31.518 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:28:31.518 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:28:31.518 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:28:31.518 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:28:31.518 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T05:28:31.518 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T05:28:31.519 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T05:28:31.519 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T05:28:31.519 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:28:31.519 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:28:31.519 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:28:31.519 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:28:31.519 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T05:28:31.519 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T05:28:31.519 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/2 2026-02-17T05:28:31.519 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T05:28:31.520 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=8578ec30-73af-421b-931c-481a868d1bde 2026-02-17T05:28:31.520 INFO:tasks.workunit.client.0.trial030.stdout:add osd2 8578ec30-73af-421b-931c-481a868d1bde 2026-02-17T05:28:31.521 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 8578ec30-73af-421b-931c-481a868d1bde' 2026-02-17T05:28:31.521 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T05:28:31.531 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQB//JNpnf2bHxAAq4+S97tMRNGePRb8mFRjOw== 2026-02-17T05:28:31.531 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQB//JNpnf2bHxAAq4+S97tMRNGePRb8mFRjOw=="}' 2026-02-17T05:28:31.532 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 8578ec30-73af-421b-931c-481a868d1bde -i td/divergent-priors/2/new.json 2026-02-17T05:28:31.753 INFO:tasks.workunit.client.0.trial030.stdout:2 2026-02-17T05:28:31.764 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/2/new.json 2026-02-17T05:28:31.765 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQB//JNpnf2bHxAAq4+S97tMRNGePRb8mFRjOw== --osd-uuid 8578ec30-73af-421b-931c-481a868d1bde 2026-02-17T05:28:31.791 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:28:31.787+0000 7f4491587a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:28:31.793 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:28:31.787+0000 7f4491587a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:28:31.794 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:28:31.787+0000 7f4491587a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:28:31.794 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:28:31.791+0000 7f4491587a40 -1 bdev(0x55f0fab82400 td/divergent-priors/2/block) open stat got: (1) Operation not permitted 2026-02-17T05:28:31.794 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:28:31.791+0000 7f4491587a40 -1 bluestore(td/divergent-priors/2) _read_fsid unparsable uuid 2026-02-17T05:28:32.409 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/2/keyring 2026-02-17T05:28:32.409 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T05:28:32.410 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-17T05:28:32.411 INFO:tasks.workunit.client.0.trial030.stdout:adding osd2 key to auth repository 2026-02-17T05:28:32.411 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T05:28:32.697 INFO:tasks.workunit.client.0.trial030.stdout:start osd.2 2026-02-17T05:28:32.698 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-17T05:28:32.699 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T05:28:32.699 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T05:28:32.699 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T05:28:32.699 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T05:28:32.728 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:28:32.723+0000 7fd7687afa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:28:32.730 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:28:32.723+0000 7fd7687afa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:28:32.731 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:28:32.727+0000 7fd7687afa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:28:32.918 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-17T05:28:32.918 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:28:32.918 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T05:28:32.918 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:28:32.918 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:28:32.918 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:28:32.918 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:28:32.919 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:28:32.919 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:28:32.919 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T05:28:33.080 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:28:33.075+0000 7fd7687afa40 -1 Falling back to public interface 2026-02-17T05:28:33.132 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:28:33.675 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:28:33.671+0000 7fd7687afa40 -1 osd.2 0 log_to_monitors true 2026-02-17T05:28:34.134 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:28:34.134 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:28:34.134 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-17T05:28:34.135 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T05:28:34.135 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:28:34.135 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T05:28:34.352 INFO:tasks.workunit.client.0.trial030.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1959802158,v1:127.0.0.1:6819/1959802158] [v2:127.0.0.1:6820/1959802158,v1:127.0.0.1:6821/1959802158] exists,up 8578ec30-73af-421b-931c-481a868d1bde 2026-02-17T05:28:34.352 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:28:34.352 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:28:34.352 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:28:34.352 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:437: TEST_divergent_2: ceph osd set noout 2026-02-17T05:28:34.665 INFO:tasks.workunit.client.0.trial030.stderr:noout is set 2026-02-17T05:28:34.674 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:438: TEST_divergent_2: ceph osd set noin 2026-02-17T05:28:34.969 INFO:tasks.workunit.client.0.trial030.stderr:noin is set 2026-02-17T05:28:34.984 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:439: TEST_divergent_2: ceph osd set nodown 2026-02-17T05:28:35.273 INFO:tasks.workunit.client.0.trial030.stderr:nodown is set 2026-02-17T05:28:35.286 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:440: TEST_divergent_2: create_pool test 1 1 2026-02-17T05:28:35.286 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2026-02-17T05:28:35.528 INFO:tasks.workunit.client.0.trial030.stderr:pool 'test' already exists 2026-02-17T05:28:35.537 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T05:28:36.538 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:441: TEST_divergent_2: ceph osd pool set test size 3 2026-02-17T05:28:36.847 INFO:tasks.workunit.client.0.trial030.stderr:set pool 1 size to 3 2026-02-17T05:28:36.858 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:442: TEST_divergent_2: ceph osd pool set test min_size 2 2026-02-17T05:28:37.152 INFO:tasks.workunit.client.0.trial030.stderr:set pool 1 min_size to 2 2026-02-17T05:28:37.164 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:444: TEST_divergent_2: flush_pg_stats 2026-02-17T05:28:37.164 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T05:28:37.164 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:28:37.389 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:28:37.390 INFO:tasks.workunit.client.0.trial030.stderr:1 2026-02-17T05:28:37.390 INFO:tasks.workunit.client.0.trial030.stderr:2' 2026-02-17T05:28:37.390 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:28:37.390 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:28:37.390 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T05:28:37.471 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836485 2026-02-17T05:28:37.471 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836485 2026-02-17T05:28:37.471 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485' 2026-02-17T05:28:37.471 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:28:37.471 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T05:28:37.557 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705668 2026-02-17T05:28:37.558 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705668 2026-02-17T05:28:37.558 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-38654705668' 2026-02-17T05:28:37.558 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:28:37.558 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T05:28:37.641 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542147 2026-02-17T05:28:37.641 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542147 2026-02-17T05:28:37.641 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-38654705668 2-60129542147' 2026-02-17T05:28:37.641 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:28:37.641 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836485 2026-02-17T05:28:37.641 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:28:37.642 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:28:37.643 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836485 2026-02-17T05:28:37.643 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:28:37.644 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836485 2026-02-17T05:28:37.644 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.0 seq 21474836485 2026-02-17T05:28:37.645 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2026-02-17T05:28:37.645 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:28:37.868 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836485 2026-02-17T05:28:37.868 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:28:38.870 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T05:28:38.870 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:28:39.087 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836485 -lt 21474836485 2026-02-17T05:28:39.087 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:28:39.087 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705668 2026-02-17T05:28:39.088 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:28:39.089 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:28:39.089 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705668 2026-02-17T05:28:39.090 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:28:39.091 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705668 2026-02-17T05:28:39.091 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.1 seq 38654705668 2026-02-17T05:28:39.091 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705668' 2026-02-17T05:28:39.091 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:28:39.314 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705668 -lt 38654705668 2026-02-17T05:28:39.314 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:28:39.315 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542147 2026-02-17T05:28:39.315 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:28:39.316 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:28:39.317 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542147 2026-02-17T05:28:39.317 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:28:39.318 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542147 2026-02-17T05:28:39.318 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542147' 2026-02-17T05:28:39.318 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.2 seq 60129542147 2026-02-17T05:28:39.319 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:28:39.539 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542147 -lt 60129542147 2026-02-17T05:28:39.539 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:445: TEST_divergent_2: wait_for_clean 2026-02-17T05:28:39.539 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T05:28:39.539 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T05:28:39.539 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T05:28:39.539 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T05:28:39.540 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T05:28:39.540 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T05:28:39.540 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T05:28:39.540 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T05:28:39.540 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T05:28:39.634 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T05:28:39.634 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T05:28:39.634 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T05:28:39.634 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T05:28:39.634 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T05:28:39.634 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:28:39.851 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:28:39.851 INFO:tasks.workunit.client.0.trial030.stderr:1 2026-02-17T05:28:39.851 INFO:tasks.workunit.client.0.trial030.stderr:2' 2026-02-17T05:28:39.851 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:28:39.851 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:28:39.851 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T05:28:39.935 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-17T05:28:39.935 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-17T05:28:39.935 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487' 2026-02-17T05:28:39.935 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:28:39.936 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T05:28:40.020 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705670 2026-02-17T05:28:40.020 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705670 2026-02-17T05:28:40.020 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-38654705670' 2026-02-17T05:28:40.020 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:28:40.020 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T05:28:40.104 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542150 2026-02-17T05:28:40.104 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542150 2026-02-17T05:28:40.104 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-38654705670 2-60129542150' 2026-02-17T05:28:40.104 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:28:40.104 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836487 2026-02-17T05:28:40.104 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:28:40.105 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:28:40.106 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-17T05:28:40.106 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:28:40.107 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836487 2026-02-17T05:28:40.107 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.0 seq 21474836487 2026-02-17T05:28:40.107 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-17T05:28:40.107 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:28:40.329 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836485 -lt 21474836487 2026-02-17T05:28:40.329 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:28:41.330 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T05:28:41.330 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:28:41.545 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836485 -lt 21474836487 2026-02-17T05:28:41.545 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:28:42.546 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T05:28:42.547 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:28:42.769 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-17T05:28:42.769 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:28:42.770 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705670 2026-02-17T05:28:42.770 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:28:42.771 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:28:42.772 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705670 2026-02-17T05:28:42.772 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:28:42.773 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705670 2026-02-17T05:28:42.773 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.1 seq 38654705670 2026-02-17T05:28:42.774 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705670' 2026-02-17T05:28:42.774 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:28:42.997 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705671 -lt 38654705670 2026-02-17T05:28:42.997 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:28:42.997 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542150 2026-02-17T05:28:42.998 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:28:42.999 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:28:42.999 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542150 2026-02-17T05:28:42.999 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:28:43.001 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542150 2026-02-17T05:28:43.001 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542150' 2026-02-17T05:28:43.001 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.2 seq 60129542150 2026-02-17T05:28:43.001 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:28:43.229 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542150 -lt 60129542150 2026-02-17T05:28:43.230 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T05:28:43.230 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:28:43.230 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:28:43.514 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T05:28:43.514 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:28:43.514 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:28:43.514 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:28:43.515 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:28:43.515 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:28:43.515 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:28:43.515 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:28:43.721 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T05:28:43.722 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:28:43.722 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:28:43.722 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:28:43.999 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T05:28:43.999 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T05:28:43.999 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T05:28:43.999 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:448: TEST_divergent_2: ceph pg dump pgs --format=json 2026-02-17T05:28:43.999 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:448: TEST_divergent_2: jq '.pg_stats[0].up_primary' 2026-02-17T05:28:44.207 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:28:44.218 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:448: TEST_divergent_2: local divergent=1 2026-02-17T05:28:44.218 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:449: TEST_divergent_2: echo 'primary and soon to be divergent is 1' 2026-02-17T05:28:44.219 INFO:tasks.workunit.client.0.trial030.stdout:primary and soon to be divergent is 1 2026-02-17T05:28:44.219 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:450: TEST_divergent_2: ceph pg dump pgs 2026-02-17T05:28:44.421 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T05:28:44.421 INFO:tasks.workunit.client.0.trial030.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T05:28:36.225612+0000 0'0 28:22 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:28:35.475420+0000 0'0 2026-02-17T05:28:35.475420+0000 0 0 periodic scrub scheduled @ 2026-02-18T12:52:22.514309+0000 0 0 2026-02-17T05:28:44.421 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-17T05:28:44.421 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T05:28:44.421 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:28:44.430 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:451: TEST_divergent_2: local non_divergent= 2026-02-17T05:28:44.430 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:452: TEST_divergent_2: for i in $osds 2026-02-17T05:28:44.430 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:454: TEST_divergent_2: '[' 0 = 1 ']' 2026-02-17T05:28:44.430 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:457: TEST_divergent_2: non_divergent=' 0' 2026-02-17T05:28:44.430 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:452: TEST_divergent_2: for i in $osds 2026-02-17T05:28:44.430 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:454: TEST_divergent_2: '[' 1 = 1 ']' 2026-02-17T05:28:44.430 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:455: TEST_divergent_2: continue 2026-02-17T05:28:44.430 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:452: TEST_divergent_2: for i in $osds 2026-02-17T05:28:44.430 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:454: TEST_divergent_2: '[' 2 = 1 ']' 2026-02-17T05:28:44.430 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:457: TEST_divergent_2: non_divergent=' 0 2' 2026-02-17T05:28:44.430 INFO:tasks.workunit.client.0.trial030.stdout:writing initial objects 2026-02-17T05:28:44.430 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:460: TEST_divergent_2: echo 'writing initial objects' 2026-02-17T05:28:44.430 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: seq 1 100 2026-02-17T05:28:44.431 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:44.431 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_1 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:44.454 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:44.455 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_2 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:44.483 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:44.483 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_3 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:44.509 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:44.510 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_4 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:44.535 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:44.535 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_5 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:44.562 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:44.562 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_6 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:44.591 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:44.591 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_7 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:44.619 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:44.619 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_8 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:44.644 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:44.644 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_9 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:44.673 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:44.673 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_10 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:44.700 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:44.700 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_11 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:44.728 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:44.728 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_12 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:44.756 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:44.756 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_13 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:44.784 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:44.784 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_14 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:44.812 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:44.813 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_15 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:44.834 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:44.834 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_16 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:44.856 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:44.857 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_17 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:44.884 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:44.885 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_18 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:44.912 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:44.912 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_19 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:44.933 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:44.933 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_20 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:44.961 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:44.962 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_21 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:44.989 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:44.990 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_22 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:45.019 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:45.019 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_23 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:45.048 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:45.048 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_24 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:45.076 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:45.076 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_25 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:45.104 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:45.104 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_26 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:45.132 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:45.132 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_27 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:45.161 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:45.161 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_28 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:45.189 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:45.189 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_29 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:45.216 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:45.217 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_30 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:45.242 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:45.242 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_31 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:45.271 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:45.271 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_32 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:45.300 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:45.300 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_33 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:45.328 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:45.329 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_34 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:45.356 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:45.356 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_35 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:45.384 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:45.384 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_36 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:45.412 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:45.412 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_37 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:45.441 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:45.441 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_38 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:45.462 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:45.462 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_39 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:45.491 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:45.492 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_40 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:45.518 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:45.518 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_41 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:45.545 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:45.546 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_42 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:45.572 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:45.573 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_43 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:45.601 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:45.601 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_44 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:45.628 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:45.628 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_45 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:45.656 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:45.657 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_46 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:45.684 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:45.684 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_47 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:45.712 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:45.712 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_48 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:45.739 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:45.739 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_49 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:45.760 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:45.761 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_50 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:45.789 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:45.790 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_51 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:45.810 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:45.810 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_52 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:45.839 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:45.839 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_53 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:45.865 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:45.865 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_54 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:45.892 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:45.892 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_55 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:45.920 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:45.920 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_56 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:45.941 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:45.941 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_57 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:45.969 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:45.969 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_58 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:45.994 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:45.994 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_59 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:46.023 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:46.023 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_60 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:46.051 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:46.051 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_61 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:46.080 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:46.081 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_62 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:46.108 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:46.108 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_63 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:46.136 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:46.136 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_64 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:46.164 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:46.164 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_65 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:46.192 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:46.192 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_66 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:46.216 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:46.217 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_67 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:46.244 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:46.244 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_68 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:46.272 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:46.273 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_69 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:46.300 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:46.300 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_70 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:46.328 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:46.328 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_71 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:46.356 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:46.356 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_72 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:46.378 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:46.378 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_73 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:46.399 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:46.399 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_74 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:46.426 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:46.426 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_75 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:46.453 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:46.453 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_76 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:46.480 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:46.480 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_77 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:46.507 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:46.507 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_78 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:46.536 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:46.536 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_79 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:46.563 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:46.564 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_80 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:46.588 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:46.589 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_81 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:46.617 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:46.617 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_82 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:46.644 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:46.644 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_83 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:46.672 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:46.672 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_84 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:46.700 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:46.700 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_85 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:46.728 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:46.728 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_86 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:46.756 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:46.756 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_87 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:46.785 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:46.785 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_88 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:46.813 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:46.814 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_89 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:46.841 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:46.841 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_90 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:46.867 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:46.867 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_91 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:46.897 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:46.897 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_92 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:46.918 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:46.918 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_93 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:46.937 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:46.938 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_94 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:46.967 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:46.967 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_95 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:46.993 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:46.993 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_96 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:47.018 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:47.019 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_97 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:47.048 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:47.048 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_98 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:47.075 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:47.076 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_99 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:47.103 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T05:28:47.103 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_100 /tmp/tmp.EN2bIN7jPO 2026-02-17T05:28:47.129 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:467: TEST_divergent_2: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-17T05:28:47.129 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:467: TEST_divergent_2: wait_for_clean 2026-02-17T05:28:47.129 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T05:28:47.130 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T05:28:47.130 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T05:28:47.130 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-17T05:28:47.131 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T05:28:47.131 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T05:28:47.131 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T05:28:47.131 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T05:28:47.131 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T05:28:47.202 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-17T05:28:47.203 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T05:28:47.203 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T05:28:47.203 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T05:28:47.203 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T05:28:47.203 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:28:47.426 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:28:47.426 INFO:tasks.workunit.client.0.trial030.stderr:1 2026-02-17T05:28:47.426 INFO:tasks.workunit.client.0.trial030.stderr:2' 2026-02-17T05:28:47.426 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:28:47.427 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:28:47.427 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T05:28:47.511 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836491 2026-02-17T05:28:47.511 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836491 2026-02-17T05:28:47.511 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491' 2026-02-17T05:28:47.511 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:28:47.511 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T05:28:47.594 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705674 2026-02-17T05:28:47.594 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705674 2026-02-17T05:28:47.594 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-38654705674' 2026-02-17T05:28:47.595 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:28:47.595 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T05:28:47.676 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542153 2026-02-17T05:28:47.676 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542153 2026-02-17T05:28:47.676 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-38654705674 2-60129542153' 2026-02-17T05:28:47.677 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:28:47.677 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836491 2026-02-17T05:28:47.677 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:28:47.678 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:28:47.678 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836491 2026-02-17T05:28:47.678 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:28:47.679 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836491 2026-02-17T05:28:47.680 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.0 seq 21474836491 2026-02-17T05:28:47.680 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836491' 2026-02-17T05:28:47.680 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:28:47.897 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836488 -lt 21474836491 2026-02-17T05:28:47.897 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:28:48.899 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T05:28:48.899 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:28:49.114 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836491 -lt 21474836491 2026-02-17T05:28:49.114 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:28:49.115 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705674 2026-02-17T05:28:49.115 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:28:49.115 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:28:49.116 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705674 2026-02-17T05:28:49.116 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:28:49.117 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705674 2026-02-17T05:28:49.118 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.1 seq 38654705674 2026-02-17T05:28:49.118 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705674' 2026-02-17T05:28:49.118 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:28:49.345 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705674 -lt 38654705674 2026-02-17T05:28:49.345 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:28:49.346 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542153 2026-02-17T05:28:49.346 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:28:49.347 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:28:49.348 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542153 2026-02-17T05:28:49.348 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:28:49.349 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542153 2026-02-17T05:28:49.349 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.2 seq 60129542153 2026-02-17T05:28:49.350 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542153' 2026-02-17T05:28:49.350 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:28:49.576 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542153 -lt 60129542153 2026-02-17T05:28:49.577 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T05:28:49.577 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:28:49.577 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:28:49.856 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T05:28:49.856 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:28:49.856 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:28:49.857 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:28:49.857 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:28:49.857 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:28:49.857 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:28:49.857 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:28:50.066 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T05:28:50.067 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:28:50.067 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:28:50.067 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:28:50.351 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T05:28:50.352 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T05:28:50.352 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T05:28:50.352 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:469: TEST_divergent_2: get_pg test existing_1 2026-02-17T05:28:50.352 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=test 2026-02-17T05:28:50.352 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=existing_1 2026-02-17T05:28:50.352 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map test existing_1 2026-02-17T05:28:50.352 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-17T05:28:50.569 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:469: TEST_divergent_2: local pgid=1.0 2026-02-17T05:28:50.569 INFO:tasks.workunit.client.0.trial030.stdout:blackholing osds 0 2 2026-02-17T05:28:50.570 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:472: TEST_divergent_2: echo 'blackholing osds 0 2' 2026-02-17T05:28:50.570 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:473: TEST_divergent_2: ceph pg dump pgs 2026-02-17T05:28:50.781 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T05:28:50.781 INFO:tasks.workunit.client.0.trial030.stdout:1.0 100 0 0 0 0 51200 0 0 16 84 16 active+clean 2026-02-17T05:28:36.225612+0000 28'100 28:122 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:28:35.475420+0000 0'0 2026-02-17T05:28:35.475420+0000 0 0 periodic scrub scheduled @ 2026-02-18T12:52:22.514309+0000 0 0 2026-02-17T05:28:50.781 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-17T05:28:50.781 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T05:28:50.781 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:28:50.790 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:474: TEST_divergent_2: for i in $non_divergent 2026-02-17T05:28:50.791 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: get_asok_path osd.0 2026-02-17T05:28:50.791 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-17T05:28:50.791 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-17T05:28:50.791 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T05:28:50.792 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:28:50.792 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:28:50.792 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19532/ceph-osd.0.asok 2026-02-17T05:28:50.792 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: CEPH_ARGS= 2026-02-17T05:28:50.792 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.19532/ceph-osd.0.asok config set objectstore_blackhole 1 2026-02-17T05:28:50.847 INFO:tasks.workunit.client.0.trial030.stdout:{ 2026-02-17T05:28:50.847 INFO:tasks.workunit.client.0.trial030.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-17T05:28:50.847 INFO:tasks.workunit.client.0.trial030.stdout:} 2026-02-17T05:28:50.854 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:474: TEST_divergent_2: for i in $non_divergent 2026-02-17T05:28:50.854 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: get_asok_path osd.2 2026-02-17T05:28:50.854 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-17T05:28:50.854 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-17T05:28:50.854 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T05:28:50.854 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:28:50.854 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:28:50.855 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19532/ceph-osd.2.asok 2026-02-17T05:28:50.855 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: CEPH_ARGS= 2026-02-17T05:28:50.855 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.19532/ceph-osd.2.asok config set objectstore_blackhole 1 2026-02-17T05:28:50.909 INFO:tasks.workunit.client.0.trial030.stdout:{ 2026-02-17T05:28:50.909 INFO:tasks.workunit.client.0.trial030.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-17T05:28:50.909 INFO:tasks.workunit.client.0.trial030.stdout:} 2026-02-17T05:28:50.915 INFO:tasks.workunit.client.0.trial030.stdout:create new divergent objects 2026-02-17T05:28:50.915 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:480: TEST_divergent_2: echo 'create new divergent objects' 2026-02-17T05:28:50.915 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:481: TEST_divergent_2: seq 1 2 2026-02-17T05:28:50.916 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:481: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-17T05:28:50.916 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:481: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-17T05:28:50.916 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:483: TEST_divergent_2: rados -p test create newobject_1 2026-02-17T05:28:50.916 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:486: TEST_divergent_2: echo 'writing divergent objects' 2026-02-17T05:28:50.917 INFO:tasks.workunit.client.0.trial030.stdout:writing divergent objects 2026-02-17T05:28:50.917 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:483: TEST_divergent_2: rados -p test create newobject_2 2026-02-17T05:28:50.917 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:487: TEST_divergent_2: seq 1 2 2026-02-17T05:28:50.918 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:487: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_WRITE) 2026-02-17T05:28:50.918 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:487: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_WRITE) 2026-02-17T05:28:50.918 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:489: TEST_divergent_2: rados -p test put existing_1 /tmp/tmp.3XecWzKabF 2026-02-17T05:28:50.919 INFO:tasks.workunit.client.0.trial030.stdout:remove divergent objects 2026-02-17T05:28:50.919 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:492: TEST_divergent_2: echo 'remove divergent objects' 2026-02-17T05:28:50.919 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:489: TEST_divergent_2: rados -p test put existing_2 /tmp/tmp.3XecWzKabF 2026-02-17T05:28:50.919 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:493: TEST_divergent_2: seq 1 2 2026-02-17T05:28:50.920 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:493: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_REMOVE) 2026-02-17T05:28:50.920 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:495: TEST_divergent_2: expr 1 + 2 2026-02-17T05:28:50.921 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:495: TEST_divergent_2: rmi=3 2026-02-17T05:28:50.922 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:493: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_REMOVE) 2026-02-17T05:28:50.922 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:496: TEST_divergent_2: rados -p test rm existing_3 2026-02-17T05:28:50.922 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:495: TEST_divergent_2: expr 2 + 2 2026-02-17T05:28:50.923 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:495: TEST_divergent_2: rmi=4 2026-02-17T05:28:50.924 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:498: TEST_divergent_2: sleep 10 2026-02-17T05:28:50.924 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:496: TEST_divergent_2: rados -p test rm existing_4 2026-02-17T05:29:00.925 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:499: TEST_divergent_2: killall -9 rados 2026-02-17T05:29:00.973 INFO:tasks.workunit.client.0.trial030.stderr:rados: no process found 2026-02-17T05:29:00.974 INFO:tasks.workunit.client.0.trial030.stdout:killing all the osds 2026-02-17T05:29:00.974 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:502: TEST_divergent_2: echo 'killing all the osds' 2026-02-17T05:29:00.975 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:503: TEST_divergent_2: ceph pg dump pgs 2026-02-17T05:29:01.195 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T05:29:01.195 INFO:tasks.workunit.client.0.trial030.stdout:1.0 100 0 0 0 0 51152 0 0 16 90 16 active+clean 2026-02-17T05:28:36.225612+0000 28'106 28:128 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:28:35.475420+0000 0'0 2026-02-17T05:28:35.475420+0000 0 0 periodic scrub scheduled @ 2026-02-18T12:52:22.514309+0000 0 0 2026-02-17T05:29:01.195 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-17T05:29:01.195 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T05:29:01.196 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:29:01.205 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:504: TEST_divergent_2: kill_daemons td/divergent-priors KILL osd 2026-02-17T05:29:01.206 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:29:01.206 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:29:01.207 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:29:01.207 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:29:01.207 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:29:01.316 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:29:01.316 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:505: TEST_divergent_2: for i in $osds 2026-02-17T05:29:01.316 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:507: TEST_divergent_2: ceph osd down osd.0 2026-02-17T05:29:01.585 INFO:tasks.workunit.client.0.trial030.stderr:osd.0 is already down. 2026-02-17T05:29:01.596 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:505: TEST_divergent_2: for i in $osds 2026-02-17T05:29:01.596 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:507: TEST_divergent_2: ceph osd down osd.1 2026-02-17T05:29:01.892 INFO:tasks.workunit.client.0.trial030.stderr:osd.1 is already down. 2026-02-17T05:29:01.901 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:505: TEST_divergent_2: for i in $osds 2026-02-17T05:29:01.901 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:507: TEST_divergent_2: ceph osd down osd.2 2026-02-17T05:29:02.182 INFO:tasks.workunit.client.0.trial030.stderr:osd.2 is already down. 2026-02-17T05:29:02.192 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:509: TEST_divergent_2: for i in $non_divergent 2026-02-17T05:29:02.192 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:511: TEST_divergent_2: ceph osd out osd.0 2026-02-17T05:29:02.468 INFO:tasks.workunit.client.0.trial030.stderr:osd.0 is already out. 2026-02-17T05:29:02.479 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:509: TEST_divergent_2: for i in $non_divergent 2026-02-17T05:29:02.479 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:511: TEST_divergent_2: ceph osd out osd.2 2026-02-17T05:29:02.753 INFO:tasks.workunit.client.0.trial030.stderr:osd.2 is already out. 2026-02-17T05:29:02.763 INFO:tasks.workunit.client.0.trial030.stdout:bringing up non_divergent 0 2 2026-02-17T05:29:02.764 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:515: TEST_divergent_2: echo 'bringing up non_divergent 0 2' 2026-02-17T05:29:02.764 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:516: TEST_divergent_2: ceph pg dump pgs 2026-02-17T05:29:02.981 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T05:29:02.981 INFO:tasks.workunit.client.0.trial030.stdout:1.0 100 0 0 0 0 51152 0 0 16 90 16 stale+active+clean 2026-02-17T05:28:36.225612+0000 28'106 28:128 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:28:35.475420+0000 0'0 2026-02-17T05:28:35.475420+0000 0 0 periodic scrub scheduled @ 2026-02-18T12:52:22.514309+0000 0 0 2026-02-17T05:29:02.981 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-17T05:29:02.981 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T05:29:02.981 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:29:02.995 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:517: TEST_divergent_2: for i in $non_divergent 2026-02-17T05:29:02.996 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:519: TEST_divergent_2: activate_osd td/divergent-priors 0 2026-02-17T05:29:02.996 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-17T05:29:02.996 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T05:29:02.996 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T05:29:02.996 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T05:29:02.996 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/0 2026-02-17T05:29:02.996 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T05:29:02.996 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:29:02.996 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:29:02.996 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:29:02.997 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-17T05:29:02.997 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-17T05:29:02.997 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T05:29:02.997 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T05:29:02.997 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T05:29:02.997 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T05:29:02.997 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:29:02.997 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:29:02.997 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:29:02.997 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:29:02.997 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:29:02.997 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:29:02.998 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:29:02.998 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:29:02.998 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T05:29:02.998 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T05:29:02.998 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:29:02.998 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:29:02.998 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:29:02.998 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:29:02.998 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T05:29:02.998 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T05:29:02.998 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/0 2026-02-17T05:29:02.999 INFO:tasks.workunit.client.0.trial030.stdout:start osd.0 2026-02-17T05:29:03.000 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T05:29:03.000 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T05:29:03.000 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/0/whoami 2026-02-17T05:29:03.000 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T05:29:03.000 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T05:29:03.000 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T05:29:03.001 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T05:29:03.023 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:29:03.019+0000 7fefb523ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:29:03.025 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:29:03.019+0000 7fefb523ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:29:03.026 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:29:03.023+0000 7fefb523ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:29:03.215 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T05:29:03.215 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:29:03.215 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T05:29:03.215 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:29:03.215 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:29:03.215 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:29:03.215 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:29:03.216 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:29:03.216 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:29:03.216 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T05:29:03.440 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:29:03.523 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:29:03.519+0000 7fefb523ba40 -1 Falling back to public interface 2026-02-17T05:29:04.179 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:29:04.175+0000 7fefb523ba40 -1 osd.0 28 log_to_monitors true 2026-02-17T05:29:04.442 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:29:04.442 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:29:04.442 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T05:29:04.442 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-17T05:29:04.443 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:29:04.443 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T05:29:04.661 INFO:tasks.workunit.client.0.trial030.stdout:osd.0 up out weight 0 up_from 35 up_thru 0 down_at 29 last_clean_interval [5,28) [v2:127.0.0.1:6800/4213725056,v1:127.0.0.1:6801/4213725056] [v2:127.0.0.1:6802/4213725056,v1:127.0.0.1:6803/4213725056] exists,up 65554143-3837-4f4a-8373-1db6c1d20c59 2026-02-17T05:29:04.665 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:29:04.665 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:29:04.665 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:29:04.666 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:517: TEST_divergent_2: for i in $non_divergent 2026-02-17T05:29:04.666 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:519: TEST_divergent_2: activate_osd td/divergent-priors 2 2026-02-17T05:29:04.666 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-17T05:29:04.666 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T05:29:04.666 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-17T05:29:04.666 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T05:29:04.666 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/2 2026-02-17T05:29:04.666 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T05:29:04.666 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:29:04.666 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:29:04.666 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:29:04.667 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-17T05:29:04.667 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-17T05:29:04.667 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T05:29:04.667 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T05:29:04.667 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T05:29:04.667 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T05:29:04.667 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:29:04.667 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:29:04.667 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:29:04.667 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:29:04.667 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:29:04.667 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:29:04.667 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:29:04.668 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:29:04.668 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T05:29:04.668 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T05:29:04.668 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:29:04.668 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:29:04.668 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:29:04.668 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:29:04.668 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T05:29:04.668 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T05:29:04.668 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/2 2026-02-17T05:29:04.669 INFO:tasks.workunit.client.0.trial030.stdout:start osd.2 2026-02-17T05:29:04.670 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-17T05:29:04.670 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T05:29:04.670 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/2/whoami 2026-02-17T05:29:04.670 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-17T05:29:04.670 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T05:29:04.671 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T05:29:04.671 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T05:29:04.686 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:29:04.683+0000 7f9ea242ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:29:04.688 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:29:04.683+0000 7f9ea242ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:29:04.689 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:29:04.683+0000 7f9ea242ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:29:04.881 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-17T05:29:04.881 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:29:04.881 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T05:29:04.881 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:29:04.881 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:29:04.882 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:29:04.882 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:29:04.883 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:29:04.883 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:29:04.883 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T05:29:05.051 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:29:05.047+0000 7f9ea242ea40 -1 Falling back to public interface 2026-02-17T05:29:05.095 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:29:05.699 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:29:05.695+0000 7f9ea242ea40 -1 osd.2 28 log_to_monitors true 2026-02-17T05:29:06.097 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:29:06.097 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:29:06.098 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T05:29:06.098 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-17T05:29:06.098 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:29:06.099 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T05:29:06.318 INFO:tasks.workunit.client.0.trial030.stdout:osd.2 up out weight 0 up_from 38 up_thru 0 down_at 31 last_clean_interval [14,28) [v2:127.0.0.1:6810/2612200958,v1:127.0.0.1:6811/2612200958] [v2:127.0.0.1:6812/2612200958,v1:127.0.0.1:6813/2612200958] exists,up 8578ec30-73af-421b-931c-481a868d1bde 2026-02-17T05:29:06.318 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:29:06.318 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:29:06.318 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:29:06.318 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:521: TEST_divergent_2: for i in $non_divergent 2026-02-17T05:29:06.318 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:523: TEST_divergent_2: ceph osd in osd.0 2026-02-17T05:29:06.566 INFO:tasks.workunit.client.0.trial030.stderr:osd.0 is already in. 2026-02-17T05:29:06.576 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:521: TEST_divergent_2: for i in $non_divergent 2026-02-17T05:29:06.576 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:523: TEST_divergent_2: ceph osd in osd.2 2026-02-17T05:29:06.874 INFO:tasks.workunit.client.0.trial030.stderr:osd.2 is already in. 2026-02-17T05:29:06.884 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:526: TEST_divergent_2: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-17T05:29:06.884 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:526: TEST_divergent_2: wait_for_clean 2026-02-17T05:29:06.884 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T05:29:06.884 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T05:29:06.884 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T05:29:06.885 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-17T05:29:06.885 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T05:29:06.886 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T05:29:06.886 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T05:29:06.886 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T05:29:06.886 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T05:29:06.947 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-17T05:29:06.947 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T05:29:06.947 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T05:29:06.947 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T05:29:06.947 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T05:29:06.947 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:29:07.169 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:29:07.170 INFO:tasks.workunit.client.0.trial030.stderr:1 2026-02-17T05:29:07.170 INFO:tasks.workunit.client.0.trial030.stderr:2' 2026-02-17T05:29:07.170 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:29:07.170 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:29:07.170 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T05:29:07.251 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855363 2026-02-17T05:29:07.251 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855363 2026-02-17T05:29:07.251 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855363' 2026-02-17T05:29:07.251 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:29:07.251 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T05:29:07.319 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-17T05:29:07.319 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: true 2026-02-17T05:29:07.319 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-17T05:29:07.319 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: continue 2026-02-17T05:29:07.319 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:29:07.319 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T05:29:07.403 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=163208757251 2026-02-17T05:29:07.403 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 163208757251 2026-02-17T05:29:07.403 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855363 2-163208757251' 2026-02-17T05:29:07.403 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:29:07.404 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-150323855363 2026-02-17T05:29:07.404 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:29:07.405 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:29:07.406 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-150323855363 2026-02-17T05:29:07.406 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:29:07.407 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=150323855363 2026-02-17T05:29:07.407 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 150323855363' 2026-02-17T05:29:07.407 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.0 seq 150323855363 2026-02-17T05:29:07.407 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:29:07.629 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 150323855363 2026-02-17T05:29:07.629 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:29:08.630 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T05:29:08.631 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:29:08.845 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855363 -lt 150323855363 2026-02-17T05:29:08.846 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:29:08.846 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-163208757251 2026-02-17T05:29:08.846 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:29:08.847 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:29:08.848 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-163208757251 2026-02-17T05:29:08.848 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:29:08.850 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=163208757251 2026-02-17T05:29:08.850 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 163208757251' 2026-02-17T05:29:08.850 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.2 seq 163208757251 2026-02-17T05:29:08.850 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:29:09.076 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 163208757251 -lt 163208757251 2026-02-17T05:29:09.076 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T05:29:09.077 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:29:09.077 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:29:09.365 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T05:29:09.366 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:29:09.366 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:29:09.366 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:29:09.366 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:29:09.366 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:29:09.366 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:29:09.366 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:29:09.582 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:29:09.583 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:29:09.583 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:29:09.583 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:29:09.869 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T05:29:09.869 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-17T05:29:09.869 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-17T05:29:09.869 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-17T05:29:09.869 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T05:29:09.869 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-17T05:29:09.970 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T05:29:09.970 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:29:09.970 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:29:09.971 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:29:09.971 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:29:09.971 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:29:09.971 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:29:09.971 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:29:10.180 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:29:10.181 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:29:10.181 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:29:10.181 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:29:10.464 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T05:29:10.464 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T05:29:10.464 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T05:29:10.464 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T05:29:10.465 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T05:29:10.465 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T05:29:10.465 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T05:29:10.465 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T05:29:10.465 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T05:29:10.752 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T05:29:10.753 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T05:29:10.753 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-17T05:29:10.753 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T05:29:10.753 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-17T05:29:10.953 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T05:29:10.953 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:29:10.953 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:29:10.953 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:29:10.953 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:29:10.953 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:29:10.953 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:29:10.953 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:29:11.165 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:29:11.165 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:29:11.166 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:29:11.166 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:29:11.460 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T05:29:11.460 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T05:29:11.460 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T05:29:11.460 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T05:29:11.460 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T05:29:11.460 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T05:29:11.460 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T05:29:11.461 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T05:29:11.461 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T05:29:11.754 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T05:29:11.754 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T05:29:11.754 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-17T05:29:11.754 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T05:29:11.754 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-17T05:29:12.155 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T05:29:12.155 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:29:12.156 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:29:12.156 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:29:12.156 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:29:12.156 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:29:12.156 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:29:12.156 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:29:12.375 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:29:12.375 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:29:12.376 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:29:12.376 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:29:12.684 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T05:29:12.684 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T05:29:12.684 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T05:29:12.684 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T05:29:12.684 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T05:29:12.684 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T05:29:12.684 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T05:29:12.684 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T05:29:12.685 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T05:29:12.982 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T05:29:12.982 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T05:29:12.982 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-17T05:29:12.982 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T05:29:12.982 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-17T05:29:13.782 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T05:29:13.783 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:29:13.784 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:29:13.784 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:29:13.784 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:29:13.784 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:29:13.784 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:29:13.784 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:29:14.000 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:29:14.001 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:29:14.001 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:29:14.001 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:29:14.285 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T05:29:14.285 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T05:29:14.286 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T05:29:14.286 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T05:29:14.286 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T05:29:14.286 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T05:29:14.286 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T05:29:14.286 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T05:29:14.286 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T05:29:14.572 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T05:29:14.573 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T05:29:14.573 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-17T05:29:14.573 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T05:29:14.573 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-17T05:29:16.173 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T05:29:16.173 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:29:16.173 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:29:16.173 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:29:16.173 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:29:16.173 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:29:16.174 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:29:16.174 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:29:16.387 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:29:16.387 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:29:16.388 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:29:16.388 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:29:16.679 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T05:29:16.679 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T05:29:16.679 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T05:29:16.679 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T05:29:16.679 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T05:29:16.679 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T05:29:16.679 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T05:29:16.680 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T05:29:16.680 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T05:29:16.971 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T05:29:16.972 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T05:29:16.972 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-17T05:29:16.972 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T05:29:16.972 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-17T05:29:20.172 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T05:29:20.173 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:29:20.173 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:29:20.173 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:29:20.173 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:29:20.173 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:29:20.174 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:29:20.174 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:29:20.391 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:29:20.391 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:29:20.392 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:29:20.392 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:29:20.684 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T05:29:20.684 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T05:29:20.684 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T05:29:20.684 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T05:29:20.684 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T05:29:20.684 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T05:29:20.684 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T05:29:20.685 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T05:29:20.685 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T05:29:20.974 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T05:29:20.974 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T05:29:20.974 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-17T05:29:20.974 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T05:29:20.974 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-17T05:29:27.375 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T05:29:27.375 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:29:27.376 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:29:27.376 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:29:27.376 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:29:27.376 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:29:27.376 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:29:27.376 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:29:27.591 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:29:27.592 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:29:27.592 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:29:27.592 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:29:27.878 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T05:29:27.879 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T05:29:27.879 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T05:29:27.879 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T05:29:27.879 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T05:29:27.879 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T05:29:27.879 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T05:29:27.879 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T05:29:27.879 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T05:29:28.174 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T05:29:28.174 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T05:29:28.174 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-17T05:29:28.174 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T05:29:28.174 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-17T05:29:35.474 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T05:29:35.474 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:29:35.475 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:29:35.475 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:29:35.475 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:29:35.475 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:29:35.476 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:29:35.476 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:29:35.698 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:29:35.699 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:29:35.699 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:29:35.699 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:29:35.992 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T05:29:35.992 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T05:29:35.992 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T05:29:35.992 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T05:29:35.992 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T05:29:35.993 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T05:29:35.993 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T05:29:35.993 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T05:29:35.993 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T05:29:36.280 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T05:29:36.280 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T05:29:36.280 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-17T05:29:36.280 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-17T05:29:36.555 INFO:tasks.workunit.client.0.trial030.stdout:{ 2026-02-17T05:29:36.555 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_fingerprint": "72fe2734-63a8-4933-a888-0eaa4f77a5dc", 2026-02-17T05:29:36.556 INFO:tasks.workunit.client.0.trial030.stdout: "version": "20.3.0-5271-g32585015", 2026-02-17T05:29:36.556 INFO:tasks.workunit.client.0.trial030.stdout: "commit": "325850157d309f65985eea9ec9bb9f1d56726fee", 2026-02-17T05:29:36.556 INFO:tasks.workunit.client.0.trial030.stdout: "timestamp": "2026-02-17T05:29:36.555286+0000", 2026-02-17T05:29:36.556 INFO:tasks.workunit.client.0.trial030.stdout: "tag": "", 2026-02-17T05:29:36.556 INFO:tasks.workunit.client.0.trial030.stdout: "health": { 2026-02-17T05:29:36.556 INFO:tasks.workunit.client.0.trial030.stdout: "status": "HEALTH_WARN", 2026-02-17T05:29:36.556 INFO:tasks.workunit.client.0.trial030.stdout: "checks": { 2026-02-17T05:29:36.556 INFO:tasks.workunit.client.0.trial030.stdout: "OSDMAP_FLAGS": { 2026-02-17T05:29:36.556 INFO:tasks.workunit.client.0.trial030.stdout: "severity": "HEALTH_WARN", 2026-02-17T05:29:36.556 INFO:tasks.workunit.client.0.trial030.stdout: "summary": { 2026-02-17T05:29:36.556 INFO:tasks.workunit.client.0.trial030.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-17T05:29:36.557 INFO:tasks.workunit.client.0.trial030.stdout: "count": 17 2026-02-17T05:29:36.557 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.557 INFO:tasks.workunit.client.0.trial030.stdout: "detail": [], 2026-02-17T05:29:36.557 INFO:tasks.workunit.client.0.trial030.stdout: "muted": false 2026-02-17T05:29:36.557 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.557 INFO:tasks.workunit.client.0.trial030.stdout: "OSD_DOWN": { 2026-02-17T05:29:36.557 INFO:tasks.workunit.client.0.trial030.stdout: "severity": "HEALTH_WARN", 2026-02-17T05:29:36.557 INFO:tasks.workunit.client.0.trial030.stdout: "summary": { 2026-02-17T05:29:36.557 INFO:tasks.workunit.client.0.trial030.stdout: "message": "1 osds down", 2026-02-17T05:29:36.557 INFO:tasks.workunit.client.0.trial030.stdout: "count": 1 2026-02-17T05:29:36.557 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.557 INFO:tasks.workunit.client.0.trial030.stdout: "detail": [ 2026-02-17T05:29:36.557 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.558 INFO:tasks.workunit.client.0.trial030.stdout: "message": "osd.1 (root=default,host=trial030) is down" 2026-02-17T05:29:36.558 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:29:36.558 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:29:36.558 INFO:tasks.workunit.client.0.trial030.stdout: "muted": false 2026-02-17T05:29:36.558 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.558 INFO:tasks.workunit.client.0.trial030.stdout: "PG_DEGRADED": { 2026-02-17T05:29:36.558 INFO:tasks.workunit.client.0.trial030.stdout: "severity": "HEALTH_WARN", 2026-02-17T05:29:36.558 INFO:tasks.workunit.client.0.trial030.stdout: "summary": { 2026-02-17T05:29:36.558 INFO:tasks.workunit.client.0.trial030.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 1 pg degraded", 2026-02-17T05:29:36.558 INFO:tasks.workunit.client.0.trial030.stdout: "count": 1 2026-02-17T05:29:36.558 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.558 INFO:tasks.workunit.client.0.trial030.stdout: "detail": [ 2026-02-17T05:29:36.559 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.559 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [0,2]" 2026-02-17T05:29:36.559 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:29:36.559 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:29:36.559 INFO:tasks.workunit.client.0.trial030.stdout: "muted": false 2026-02-17T05:29:36.559 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:29:36.559 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.559 INFO:tasks.workunit.client.0.trial030.stdout: "mutes": [] 2026-02-17T05:29:36.559 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.559 INFO:tasks.workunit.client.0.trial030.stdout: "monmap_first_committed": 1, 2026-02-17T05:29:36.559 INFO:tasks.workunit.client.0.trial030.stdout: "monmap_last_committed": 1, 2026-02-17T05:29:36.559 INFO:tasks.workunit.client.0.trial030.stdout: "monmap": { 2026-02-17T05:29:36.560 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 1, 2026-02-17T05:29:36.560 INFO:tasks.workunit.client.0.trial030.stdout: "fsid": "931b36d9-02d4-44f0-bc8b-c9190b7fdb00", 2026-02-17T05:29:36.560 INFO:tasks.workunit.client.0.trial030.stdout: "modified": "2026-02-17T05:28:23.410859Z", 2026-02-17T05:29:36.560 INFO:tasks.workunit.client.0.trial030.stdout: "created": "2026-02-17T05:28:23.410859Z", 2026-02-17T05:29:36.560 INFO:tasks.workunit.client.0.trial030.stdout: "min_mon_release": 20, 2026-02-17T05:29:36.560 INFO:tasks.workunit.client.0.trial030.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:29:36.560 INFO:tasks.workunit.client.0.trial030.stdout: "election_strategy": 1, 2026-02-17T05:29:36.560 INFO:tasks.workunit.client.0.trial030.stdout: "disallowed_leaders": "", 2026-02-17T05:29:36.560 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_mode": false, 2026-02-17T05:29:36.560 INFO:tasks.workunit.client.0.trial030.stdout: "tiebreaker_mon": "", 2026-02-17T05:29:36.560 INFO:tasks.workunit.client.0.trial030.stdout: "removed_ranks": "", 2026-02-17T05:29:36.560 INFO:tasks.workunit.client.0.trial030.stdout: "features": { 2026-02-17T05:29:36.561 INFO:tasks.workunit.client.0.trial030.stdout: "persistent": [ 2026-02-17T05:29:36.561 INFO:tasks.workunit.client.0.trial030.stdout: "kraken", 2026-02-17T05:29:36.561 INFO:tasks.workunit.client.0.trial030.stdout: "luminous", 2026-02-17T05:29:36.561 INFO:tasks.workunit.client.0.trial030.stdout: "mimic", 2026-02-17T05:29:36.561 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap-prune", 2026-02-17T05:29:36.561 INFO:tasks.workunit.client.0.trial030.stdout: "nautilus", 2026-02-17T05:29:36.561 INFO:tasks.workunit.client.0.trial030.stdout: "octopus", 2026-02-17T05:29:36.561 INFO:tasks.workunit.client.0.trial030.stdout: "pacific", 2026-02-17T05:29:36.561 INFO:tasks.workunit.client.0.trial030.stdout: "elector-pinging", 2026-02-17T05:29:36.561 INFO:tasks.workunit.client.0.trial030.stdout: "quincy", 2026-02-17T05:29:36.561 INFO:tasks.workunit.client.0.trial030.stdout: "reef", 2026-02-17T05:29:36.561 INFO:tasks.workunit.client.0.trial030.stdout: "squid", 2026-02-17T05:29:36.561 INFO:tasks.workunit.client.0.trial030.stdout: "tentacle", 2026-02-17T05:29:36.562 INFO:tasks.workunit.client.0.trial030.stdout: "nvmeof_beacon_diff" 2026-02-17T05:29:36.562 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:29:36.562 INFO:tasks.workunit.client.0.trial030.stdout: "optional": [] 2026-02-17T05:29:36.562 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.562 INFO:tasks.workunit.client.0.trial030.stdout: "mons": [ 2026-02-17T05:29:36.562 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.562 INFO:tasks.workunit.client.0.trial030.stdout: "rank": 0, 2026-02-17T05:29:36.562 INFO:tasks.workunit.client.0.trial030.stdout: "name": "a", 2026-02-17T05:29:36.562 INFO:tasks.workunit.client.0.trial030.stdout: "public_addrs": { 2026-02-17T05:29:36.562 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:29:36.562 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.562 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:29:36.563 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:7115", 2026-02-17T05:29:36.563 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 0 2026-02-17T05:29:36.563 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:29:36.563 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:29:36.563 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.563 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:7115/0", 2026-02-17T05:29:36.563 INFO:tasks.workunit.client.0.trial030.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-17T05:29:36.563 INFO:tasks.workunit.client.0.trial030.stdout: "priority": 0, 2026-02-17T05:29:36.563 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 0, 2026-02-17T05:29:36.563 INFO:tasks.workunit.client.0.trial030.stdout: "time_added": "2026-02-17T05:28:23:410856+0000", 2026-02-17T05:29:36.563 INFO:tasks.workunit.client.0.trial030.stdout: "crush_location": [] 2026-02-17T05:29:36.563 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:29:36.563 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:29:36.564 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.564 INFO:tasks.workunit.client.0.trial030.stdout: "quorum": [ 2026-02-17T05:29:36.564 INFO:tasks.workunit.client.0.trial030.stdout: 0 2026-02-17T05:29:36.564 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:29:36.564 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap": { 2026-02-17T05:29:36.564 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 41, 2026-02-17T05:29:36.564 INFO:tasks.workunit.client.0.trial030.stdout: "fsid": "931b36d9-02d4-44f0-bc8b-c9190b7fdb00", 2026-02-17T05:29:36.564 INFO:tasks.workunit.client.0.trial030.stdout: "created": "2026-02-17T05:28:23.487786+0000", 2026-02-17T05:29:36.564 INFO:tasks.workunit.client.0.trial030.stdout: "modified": "2026-02-17T05:29:06.911551+0000", 2026-02-17T05:29:36.564 INFO:tasks.workunit.client.0.trial030.stdout: "last_up_change": "2026-02-17T05:29:05.855901+0000", 2026-02-17T05:29:36.564 INFO:tasks.workunit.client.0.trial030.stdout: "last_in_change": "2026-02-17T05:29:06.809631+0000", 2026-02-17T05:29:36.564 INFO:tasks.workunit.client.0.trial030.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-17T05:29:36.565 INFO:tasks.workunit.client.0.trial030.stdout: "flags_num": 5800384, 2026-02-17T05:29:36.565 INFO:tasks.workunit.client.0.trial030.stdout: "flags_set": [ 2026-02-17T05:29:36.565 INFO:tasks.workunit.client.0.trial030.stdout: "nodown", 2026-02-17T05:29:36.565 INFO:tasks.workunit.client.0.trial030.stdout: "noin", 2026-02-17T05:29:36.565 INFO:tasks.workunit.client.0.trial030.stdout: "noout", 2026-02-17T05:29:36.565 INFO:tasks.workunit.client.0.trial030.stdout: "pglog_hardlimit", 2026-02-17T05:29:36.565 INFO:tasks.workunit.client.0.trial030.stdout: "purged_snapdirs", 2026-02-17T05:29:36.565 INFO:tasks.workunit.client.0.trial030.stdout: "recovery_deletes", 2026-02-17T05:29:36.565 INFO:tasks.workunit.client.0.trial030.stdout: "sortbitwise" 2026-02-17T05:29:36.565 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:29:36.565 INFO:tasks.workunit.client.0.trial030.stdout: "crush_version": 9, 2026-02-17T05:29:36.565 INFO:tasks.workunit.client.0.trial030.stdout: "full_ratio": 0.99000000953674316, 2026-02-17T05:29:36.566 INFO:tasks.workunit.client.0.trial030.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-17T05:29:36.566 INFO:tasks.workunit.client.0.trial030.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-17T05:29:36.566 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_snapshot": "", 2026-02-17T05:29:36.566 INFO:tasks.workunit.client.0.trial030.stdout: "pool_max": 1, 2026-02-17T05:29:36.566 INFO:tasks.workunit.client.0.trial030.stdout: "max_osd": 3, 2026-02-17T05:29:36.566 INFO:tasks.workunit.client.0.trial030.stdout: "require_min_compat_client": "luminous", 2026-02-17T05:29:36.566 INFO:tasks.workunit.client.0.trial030.stdout: "min_compat_client": "jewel", 2026-02-17T05:29:36.566 INFO:tasks.workunit.client.0.trial030.stdout: "require_osd_release": "tentacle", 2026-02-17T05:29:36.566 INFO:tasks.workunit.client.0.trial030.stdout: "allow_crimson": false, 2026-02-17T05:29:36.566 INFO:tasks.workunit.client.0.trial030.stdout: "pools": [ 2026-02-17T05:29:36.566 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.566 INFO:tasks.workunit.client.0.trial030.stdout: "pool": 1, 2026-02-17T05:29:36.566 INFO:tasks.workunit.client.0.trial030.stdout: "pool_name": "test", 2026-02-17T05:29:36.567 INFO:tasks.workunit.client.0.trial030.stdout: "create_time": "2026-02-17T05:28:35.450190+0000", 2026-02-17T05:29:36.567 INFO:tasks.workunit.client.0.trial030.stdout: "flags": 1, 2026-02-17T05:29:36.567 INFO:tasks.workunit.client.0.trial030.stdout: "flags_names": "hashpspool", 2026-02-17T05:29:36.567 INFO:tasks.workunit.client.0.trial030.stdout: "type": 1, 2026-02-17T05:29:36.567 INFO:tasks.workunit.client.0.trial030.stdout: "size": 3, 2026-02-17T05:29:36.567 INFO:tasks.workunit.client.0.trial030.stdout: "min_size": 2, 2026-02-17T05:29:36.567 INFO:tasks.workunit.client.0.trial030.stdout: "crush_rule": 0, 2026-02-17T05:29:36.567 INFO:tasks.workunit.client.0.trial030.stdout: "peering_crush_bucket_count": 0, 2026-02-17T05:29:36.567 INFO:tasks.workunit.client.0.trial030.stdout: "peering_crush_bucket_target": 0, 2026-02-17T05:29:36.567 INFO:tasks.workunit.client.0.trial030.stdout: "peering_crush_bucket_barrier": 0, 2026-02-17T05:29:36.567 INFO:tasks.workunit.client.0.trial030.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-17T05:29:36.567 INFO:tasks.workunit.client.0.trial030.stdout: "is_stretch_pool": false, 2026-02-17T05:29:36.568 INFO:tasks.workunit.client.0.trial030.stdout: "object_hash": 2, 2026-02-17T05:29:36.568 INFO:tasks.workunit.client.0.trial030.stdout: "pg_autoscale_mode": "off", 2026-02-17T05:29:36.568 INFO:tasks.workunit.client.0.trial030.stdout: "pg_num": 1, 2026-02-17T05:29:36.568 INFO:tasks.workunit.client.0.trial030.stdout: "pg_placement_num": 1, 2026-02-17T05:29:36.568 INFO:tasks.workunit.client.0.trial030.stdout: "pg_placement_num_target": 1, 2026-02-17T05:29:36.568 INFO:tasks.workunit.client.0.trial030.stdout: "pg_num_target": 1, 2026-02-17T05:29:36.568 INFO:tasks.workunit.client.0.trial030.stdout: "pg_num_pending": 1, 2026-02-17T05:29:36.568 INFO:tasks.workunit.client.0.trial030.stdout: "last_pg_merge_meta": { 2026-02-17T05:29:36.568 INFO:tasks.workunit.client.0.trial030.stdout: "source_pgid": "0.0", 2026-02-17T05:29:36.568 INFO:tasks.workunit.client.0.trial030.stdout: "ready_epoch": 0, 2026-02-17T05:29:36.568 INFO:tasks.workunit.client.0.trial030.stdout: "last_epoch_started": 0, 2026-02-17T05:29:36.568 INFO:tasks.workunit.client.0.trial030.stdout: "last_epoch_clean": 0, 2026-02-17T05:29:36.569 INFO:tasks.workunit.client.0.trial030.stdout: "source_version": "0'0", 2026-02-17T05:29:36.569 INFO:tasks.workunit.client.0.trial030.stdout: "target_version": "0'0" 2026-02-17T05:29:36.569 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.569 INFO:tasks.workunit.client.0.trial030.stdout: "last_change": "28", 2026-02-17T05:29:36.569 INFO:tasks.workunit.client.0.trial030.stdout: "last_force_op_resend": "0", 2026-02-17T05:29:36.569 INFO:tasks.workunit.client.0.trial030.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-17T05:29:36.569 INFO:tasks.workunit.client.0.trial030.stdout: "last_force_op_resend_preluminous": "0", 2026-02-17T05:29:36.569 INFO:tasks.workunit.client.0.trial030.stdout: "auid": 0, 2026-02-17T05:29:36.569 INFO:tasks.workunit.client.0.trial030.stdout: "snap_mode": "selfmanaged", 2026-02-17T05:29:36.569 INFO:tasks.workunit.client.0.trial030.stdout: "snap_seq": 0, 2026-02-17T05:29:36.569 INFO:tasks.workunit.client.0.trial030.stdout: "snap_epoch": 0, 2026-02-17T05:29:36.569 INFO:tasks.workunit.client.0.trial030.stdout: "pool_snaps": [], 2026-02-17T05:29:36.569 INFO:tasks.workunit.client.0.trial030.stdout: "removed_snaps": "[]", 2026-02-17T05:29:36.570 INFO:tasks.workunit.client.0.trial030.stdout: "quota_max_bytes": 0, 2026-02-17T05:29:36.570 INFO:tasks.workunit.client.0.trial030.stdout: "quota_max_objects": 0, 2026-02-17T05:29:36.570 INFO:tasks.workunit.client.0.trial030.stdout: "tiers": [], 2026-02-17T05:29:36.570 INFO:tasks.workunit.client.0.trial030.stdout: "tier_of": -1, 2026-02-17T05:29:36.570 INFO:tasks.workunit.client.0.trial030.stdout: "read_tier": -1, 2026-02-17T05:29:36.570 INFO:tasks.workunit.client.0.trial030.stdout: "write_tier": -1, 2026-02-17T05:29:36.570 INFO:tasks.workunit.client.0.trial030.stdout: "cache_mode": "none", 2026-02-17T05:29:36.570 INFO:tasks.workunit.client.0.trial030.stdout: "target_max_bytes": 0, 2026-02-17T05:29:36.570 INFO:tasks.workunit.client.0.trial030.stdout: "target_max_objects": 0, 2026-02-17T05:29:36.570 INFO:tasks.workunit.client.0.trial030.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-17T05:29:36.570 INFO:tasks.workunit.client.0.trial030.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-17T05:29:36.570 INFO:tasks.workunit.client.0.trial030.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-17T05:29:36.570 INFO:tasks.workunit.client.0.trial030.stdout: "cache_min_flush_age": 0, 2026-02-17T05:29:36.571 INFO:tasks.workunit.client.0.trial030.stdout: "cache_min_evict_age": 0, 2026-02-17T05:29:36.571 INFO:tasks.workunit.client.0.trial030.stdout: "erasure_code_profile": "", 2026-02-17T05:29:36.571 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_params": { 2026-02-17T05:29:36.571 INFO:tasks.workunit.client.0.trial030.stdout: "type": "none" 2026-02-17T05:29:36.571 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.571 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_period": 0, 2026-02-17T05:29:36.571 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_count": 0, 2026-02-17T05:29:36.571 INFO:tasks.workunit.client.0.trial030.stdout: "use_gmt_hitset": true, 2026-02-17T05:29:36.571 INFO:tasks.workunit.client.0.trial030.stdout: "min_read_recency_for_promote": 0, 2026-02-17T05:29:36.571 INFO:tasks.workunit.client.0.trial030.stdout: "min_write_recency_for_promote": 0, 2026-02-17T05:29:36.571 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_grade_decay_rate": 0, 2026-02-17T05:29:36.571 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_search_last_n": 0, 2026-02-17T05:29:36.572 INFO:tasks.workunit.client.0.trial030.stdout: "grade_table": [], 2026-02-17T05:29:36.572 INFO:tasks.workunit.client.0.trial030.stdout: "stripe_width": 0, 2026-02-17T05:29:36.572 INFO:tasks.workunit.client.0.trial030.stdout: "expected_num_objects": 0, 2026-02-17T05:29:36.572 INFO:tasks.workunit.client.0.trial030.stdout: "fast_read": false, 2026-02-17T05:29:36.572 INFO:tasks.workunit.client.0.trial030.stdout: "nonprimary_shards": "{}", 2026-02-17T05:29:36.572 INFO:tasks.workunit.client.0.trial030.stdout: "options": {}, 2026-02-17T05:29:36.572 INFO:tasks.workunit.client.0.trial030.stdout: "application_metadata": {}, 2026-02-17T05:29:36.572 INFO:tasks.workunit.client.0.trial030.stdout: "read_balance": { 2026-02-17T05:29:36.572 INFO:tasks.workunit.client.0.trial030.stdout: "score_type": "Fair distribution", 2026-02-17T05:29:36.572 INFO:tasks.workunit.client.0.trial030.stdout: "score_acting": 2.9900000095367432, 2026-02-17T05:29:36.572 INFO:tasks.workunit.client.0.trial030.stdout: "score_stable": 2.9900000095367432, 2026-02-17T05:29:36.572 INFO:tasks.workunit.client.0.trial030.stdout: "optimal_score": 0.67000001668930054, 2026-02-17T05:29:36.572 INFO:tasks.workunit.client.0.trial030.stdout: "raw_score_acting": 2, 2026-02-17T05:29:36.573 INFO:tasks.workunit.client.0.trial030.stdout: "raw_score_stable": 2, 2026-02-17T05:29:36.573 INFO:tasks.workunit.client.0.trial030.stdout: "primary_affinity_weighted": 1, 2026-02-17T05:29:36.573 INFO:tasks.workunit.client.0.trial030.stdout: "average_primary_affinity": 1, 2026-02-17T05:29:36.573 INFO:tasks.workunit.client.0.trial030.stdout: "average_primary_affinity_weighted": 1 2026-02-17T05:29:36.573 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:29:36.573 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:29:36.573 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:29:36.573 INFO:tasks.workunit.client.0.trial030.stdout: "osds": [ 2026-02-17T05:29:36.573 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.573 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 0, 2026-02-17T05:29:36.573 INFO:tasks.workunit.client.0.trial030.stdout: "uuid": "65554143-3837-4f4a-8373-1db6c1d20c59", 2026-02-17T05:29:36.573 INFO:tasks.workunit.client.0.trial030.stdout: "up": 1, 2026-02-17T05:29:36.573 INFO:tasks.workunit.client.0.trial030.stdout: "in": 1, 2026-02-17T05:29:36.574 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 1, 2026-02-17T05:29:36.574 INFO:tasks.workunit.client.0.trial030.stdout: "primary_affinity": 1, 2026-02-17T05:29:36.574 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_begin": 5, 2026-02-17T05:29:36.574 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_end": 28, 2026-02-17T05:29:36.574 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 35, 2026-02-17T05:29:36.574 INFO:tasks.workunit.client.0.trial030.stdout: "up_thru": 40, 2026-02-17T05:29:36.574 INFO:tasks.workunit.client.0.trial030.stdout: "down_at": 29, 2026-02-17T05:29:36.574 INFO:tasks.workunit.client.0.trial030.stdout: "lost_at": 0, 2026-02-17T05:29:36.574 INFO:tasks.workunit.client.0.trial030.stdout: "public_addrs": { 2026-02-17T05:29:36.574 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:29:36.574 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.574 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:29:36.575 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6800", 2026-02-17T05:29:36.575 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 4213725056 2026-02-17T05:29:36.575 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.575 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.575 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:29:36.575 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6801", 2026-02-17T05:29:36.575 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 4213725056 2026-02-17T05:29:36.575 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:29:36.575 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:29:36.575 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.575 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addrs": { 2026-02-17T05:29:36.575 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:29:36.576 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.576 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:29:36.576 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6802", 2026-02-17T05:29:36.576 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 4213725056 2026-02-17T05:29:36.576 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.576 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.576 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:29:36.576 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6803", 2026-02-17T05:29:36.576 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 4213725056 2026-02-17T05:29:36.576 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:29:36.576 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:29:36.576 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.576 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addrs": { 2026-02-17T05:29:36.577 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:29:36.577 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.577 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:29:36.577 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6806", 2026-02-17T05:29:36.577 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 4213725056 2026-02-17T05:29:36.577 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.577 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.577 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:29:36.577 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6807", 2026-02-17T05:29:36.577 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 4213725056 2026-02-17T05:29:36.577 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:29:36.577 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:29:36.577 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.578 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addrs": { 2026-02-17T05:29:36.578 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:29:36.578 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.578 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:29:36.578 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6804", 2026-02-17T05:29:36.578 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 4213725056 2026-02-17T05:29:36.578 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.578 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.578 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:29:36.578 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6805", 2026-02-17T05:29:36.578 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 4213725056 2026-02-17T05:29:36.578 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:29:36.578 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:29:36.579 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.579 INFO:tasks.workunit.client.0.trial030.stdout: "public_addr": "127.0.0.1:6801/4213725056", 2026-02-17T05:29:36.579 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addr": "127.0.0.1:6803/4213725056", 2026-02-17T05:29:36.579 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addr": "127.0.0.1:6807/4213725056", 2026-02-17T05:29:36.579 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addr": "127.0.0.1:6805/4213725056", 2026-02-17T05:29:36.579 INFO:tasks.workunit.client.0.trial030.stdout: "state": [ 2026-02-17T05:29:36.579 INFO:tasks.workunit.client.0.trial030.stdout: "exists", 2026-02-17T05:29:36.579 INFO:tasks.workunit.client.0.trial030.stdout: "up" 2026-02-17T05:29:36.579 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:29:36.579 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.579 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.579 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 1, 2026-02-17T05:29:36.579 INFO:tasks.workunit.client.0.trial030.stdout: "uuid": "1895d426-e99b-4201-96c2-911240090080", 2026-02-17T05:29:36.579 INFO:tasks.workunit.client.0.trial030.stdout: "up": 0, 2026-02-17T05:29:36.580 INFO:tasks.workunit.client.0.trial030.stdout: "in": 1, 2026-02-17T05:29:36.580 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 1, 2026-02-17T05:29:36.580 INFO:tasks.workunit.client.0.trial030.stdout: "primary_affinity": 1, 2026-02-17T05:29:36.580 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_begin": 0, 2026-02-17T05:29:36.580 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_end": 0, 2026-02-17T05:29:36.580 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 9, 2026-02-17T05:29:36.580 INFO:tasks.workunit.client.0.trial030.stdout: "up_thru": 22, 2026-02-17T05:29:36.580 INFO:tasks.workunit.client.0.trial030.stdout: "down_at": 30, 2026-02-17T05:29:36.580 INFO:tasks.workunit.client.0.trial030.stdout: "lost_at": 0, 2026-02-17T05:29:36.580 INFO:tasks.workunit.client.0.trial030.stdout: "public_addrs": { 2026-02-17T05:29:36.580 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:29:36.580 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.580 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:29:36.580 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6810", 2026-02-17T05:29:36.581 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 418378196 2026-02-17T05:29:36.581 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.581 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.581 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:29:36.581 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6811", 2026-02-17T05:29:36.581 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 418378196 2026-02-17T05:29:36.581 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:29:36.581 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:29:36.581 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.581 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addrs": { 2026-02-17T05:29:36.581 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:29:36.581 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.581 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:29:36.581 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6812", 2026-02-17T05:29:36.582 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 418378196 2026-02-17T05:29:36.582 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.582 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.582 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:29:36.582 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6813", 2026-02-17T05:29:36.582 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 418378196 2026-02-17T05:29:36.582 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:29:36.582 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:29:36.582 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.582 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addrs": { 2026-02-17T05:29:36.582 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:29:36.582 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.582 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:29:36.582 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6816", 2026-02-17T05:29:36.582 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 418378196 2026-02-17T05:29:36.582 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.583 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.583 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:29:36.583 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6817", 2026-02-17T05:29:36.583 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 418378196 2026-02-17T05:29:36.583 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:29:36.583 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:29:36.583 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.583 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addrs": { 2026-02-17T05:29:36.583 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:29:36.583 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.583 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:29:36.583 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6814", 2026-02-17T05:29:36.583 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 418378196 2026-02-17T05:29:36.583 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.583 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.583 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:29:36.584 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6815", 2026-02-17T05:29:36.584 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 418378196 2026-02-17T05:29:36.584 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:29:36.584 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:29:36.584 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.584 INFO:tasks.workunit.client.0.trial030.stdout: "public_addr": "127.0.0.1:6811/418378196", 2026-02-17T05:29:36.584 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addr": "127.0.0.1:6813/418378196", 2026-02-17T05:29:36.584 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addr": "127.0.0.1:6817/418378196", 2026-02-17T05:29:36.584 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addr": "127.0.0.1:6815/418378196", 2026-02-17T05:29:36.584 INFO:tasks.workunit.client.0.trial030.stdout: "state": [ 2026-02-17T05:29:36.584 INFO:tasks.workunit.client.0.trial030.stdout: "exists" 2026-02-17T05:29:36.584 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:29:36.585 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.585 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.585 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2, 2026-02-17T05:29:36.585 INFO:tasks.workunit.client.0.trial030.stdout: "uuid": "8578ec30-73af-421b-931c-481a868d1bde", 2026-02-17T05:29:36.585 INFO:tasks.workunit.client.0.trial030.stdout: "up": 1, 2026-02-17T05:29:36.585 INFO:tasks.workunit.client.0.trial030.stdout: "in": 1, 2026-02-17T05:29:36.585 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 1, 2026-02-17T05:29:36.585 INFO:tasks.workunit.client.0.trial030.stdout: "primary_affinity": 1, 2026-02-17T05:29:36.585 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_begin": 14, 2026-02-17T05:29:36.585 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_end": 28, 2026-02-17T05:29:36.585 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 38, 2026-02-17T05:29:36.585 INFO:tasks.workunit.client.0.trial030.stdout: "up_thru": 0, 2026-02-17T05:29:36.585 INFO:tasks.workunit.client.0.trial030.stdout: "down_at": 31, 2026-02-17T05:29:36.586 INFO:tasks.workunit.client.0.trial030.stdout: "lost_at": 0, 2026-02-17T05:29:36.586 INFO:tasks.workunit.client.0.trial030.stdout: "public_addrs": { 2026-02-17T05:29:36.586 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:29:36.586 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.586 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:29:36.586 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6810", 2026-02-17T05:29:36.586 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2612200958 2026-02-17T05:29:36.586 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.586 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.586 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:29:36.586 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6811", 2026-02-17T05:29:36.586 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2612200958 2026-02-17T05:29:36.586 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:29:36.586 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:29:36.586 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.587 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addrs": { 2026-02-17T05:29:36.587 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:29:36.587 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.587 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:29:36.587 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6812", 2026-02-17T05:29:36.587 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2612200958 2026-02-17T05:29:36.587 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.587 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.587 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:29:36.587 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6813", 2026-02-17T05:29:36.587 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2612200958 2026-02-17T05:29:36.587 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:29:36.587 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:29:36.587 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.587 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addrs": { 2026-02-17T05:29:36.588 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:29:36.588 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.588 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:29:36.588 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6816", 2026-02-17T05:29:36.588 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2612200958 2026-02-17T05:29:36.588 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.588 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.588 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:29:36.588 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6817", 2026-02-17T05:29:36.588 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2612200958 2026-02-17T05:29:36.588 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:29:36.588 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:29:36.588 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.588 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addrs": { 2026-02-17T05:29:36.588 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:29:36.588 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.589 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:29:36.589 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6814", 2026-02-17T05:29:36.589 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2612200958 2026-02-17T05:29:36.589 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.589 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.589 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:29:36.589 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6815", 2026-02-17T05:29:36.589 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2612200958 2026-02-17T05:29:36.589 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:29:36.589 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:29:36.589 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.589 INFO:tasks.workunit.client.0.trial030.stdout: "public_addr": "127.0.0.1:6811/2612200958", 2026-02-17T05:29:36.589 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addr": "127.0.0.1:6813/2612200958", 2026-02-17T05:29:36.589 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addr": "127.0.0.1:6817/2612200958", 2026-02-17T05:29:36.589 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addr": "127.0.0.1:6815/2612200958", 2026-02-17T05:29:36.589 INFO:tasks.workunit.client.0.trial030.stdout: "state": [ 2026-02-17T05:29:36.589 INFO:tasks.workunit.client.0.trial030.stdout: "exists", 2026-02-17T05:29:36.590 INFO:tasks.workunit.client.0.trial030.stdout: "up" 2026-02-17T05:29:36.590 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:29:36.590 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:29:36.590 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:29:36.590 INFO:tasks.workunit.client.0.trial030.stdout: "osd_xinfo": [ 2026-02-17T05:29:36.590 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.590 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 0, 2026-02-17T05:29:36.590 INFO:tasks.workunit.client.0.trial030.stdout: "down_stamp": "2026-02-17T05:29:01.527220+0000", 2026-02-17T05:29:36.590 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_probability": 0, 2026-02-17T05:29:36.590 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_interval": 0, 2026-02-17T05:29:36.590 INFO:tasks.workunit.client.0.trial030.stdout: "features": 4544132024016699391, 2026-02-17T05:29:36.590 INFO:tasks.workunit.client.0.trial030.stdout: "old_weight": 0, 2026-02-17T05:29:36.590 INFO:tasks.workunit.client.0.trial030.stdout: "last_purged_snaps_scrub": "2026-02-17T05:28:27.184949+0000", 2026-02-17T05:29:36.590 INFO:tasks.workunit.client.0.trial030.stdout: "dead_epoch": 0 2026-02-17T05:29:36.590 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.590 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.591 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 1, 2026-02-17T05:29:36.591 INFO:tasks.workunit.client.0.trial030.stdout: "down_stamp": "2026-02-17T05:29:01.832135+0000", 2026-02-17T05:29:36.591 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_probability": 0, 2026-02-17T05:29:36.591 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_interval": 0, 2026-02-17T05:29:36.591 INFO:tasks.workunit.client.0.trial030.stdout: "features": 4544132024016699391, 2026-02-17T05:29:36.591 INFO:tasks.workunit.client.0.trial030.stdout: "old_weight": 0, 2026-02-17T05:29:36.591 INFO:tasks.workunit.client.0.trial030.stdout: "last_purged_snaps_scrub": "2026-02-17T05:28:30.768834+0000", 2026-02-17T05:29:36.591 INFO:tasks.workunit.client.0.trial030.stdout: "dead_epoch": 0 2026-02-17T05:29:36.591 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.591 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.591 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2, 2026-02-17T05:29:36.591 INFO:tasks.workunit.client.0.trial030.stdout: "down_stamp": "2026-02-17T05:29:02.125677+0000", 2026-02-17T05:29:36.591 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_probability": 0, 2026-02-17T05:29:36.591 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_interval": 0, 2026-02-17T05:29:36.591 INFO:tasks.workunit.client.0.trial030.stdout: "features": 4544132024016699391, 2026-02-17T05:29:36.591 INFO:tasks.workunit.client.0.trial030.stdout: "old_weight": 0, 2026-02-17T05:29:36.592 INFO:tasks.workunit.client.0.trial030.stdout: "last_purged_snaps_scrub": "2026-02-17T05:28:34.681315+0000", 2026-02-17T05:29:36.592 INFO:tasks.workunit.client.0.trial030.stdout: "dead_epoch": 0 2026-02-17T05:29:36.592 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:29:36.592 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:29:36.592 INFO:tasks.workunit.client.0.trial030.stdout: "pg_upmap": [], 2026-02-17T05:29:36.592 INFO:tasks.workunit.client.0.trial030.stdout: "pg_upmap_items": [], 2026-02-17T05:29:36.592 INFO:tasks.workunit.client.0.trial030.stdout: "pg_upmap_primaries": [], 2026-02-17T05:29:36.592 INFO:tasks.workunit.client.0.trial030.stdout: "pg_temp": [], 2026-02-17T05:29:36.592 INFO:tasks.workunit.client.0.trial030.stdout: "primary_temp": [], 2026-02-17T05:29:36.592 INFO:tasks.workunit.client.0.trial030.stdout: "blocklist": {}, 2026-02-17T05:29:36.592 INFO:tasks.workunit.client.0.trial030.stdout: "range_blocklist": {}, 2026-02-17T05:29:36.592 INFO:tasks.workunit.client.0.trial030.stdout: "erasure_code_profiles": { 2026-02-17T05:29:36.592 INFO:tasks.workunit.client.0.trial030.stdout: "default": { 2026-02-17T05:29:36.592 INFO:tasks.workunit.client.0.trial030.stdout: "k": "2", 2026-02-17T05:29:36.592 INFO:tasks.workunit.client.0.trial030.stdout: "m": "2", 2026-02-17T05:29:36.592 INFO:tasks.workunit.client.0.trial030.stdout: "plugin": "isa", 2026-02-17T05:29:36.592 INFO:tasks.workunit.client.0.trial030.stdout: "technique": "reed_sol_van" 2026-02-17T05:29:36.593 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:29:36.593 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.593 INFO:tasks.workunit.client.0.trial030.stdout: "removed_snaps_queue": [], 2026-02-17T05:29:36.593 INFO:tasks.workunit.client.0.trial030.stdout: "new_removed_snaps": [], 2026-02-17T05:29:36.593 INFO:tasks.workunit.client.0.trial030.stdout: "new_purged_snaps": [], 2026-02-17T05:29:36.593 INFO:tasks.workunit.client.0.trial030.stdout: "crush_node_flags": {}, 2026-02-17T05:29:36.593 INFO:tasks.workunit.client.0.trial030.stdout: "device_class_flags": {}, 2026-02-17T05:29:36.593 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_mode": { 2026-02-17T05:29:36.593 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_mode_enabled": false, 2026-02-17T05:29:36.593 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_bucket_count": 0, 2026-02-17T05:29:36.593 INFO:tasks.workunit.client.0.trial030.stdout: "degraded_stretch_mode": 0, 2026-02-17T05:29:36.593 INFO:tasks.workunit.client.0.trial030.stdout: "recovering_stretch_mode": 0, 2026-02-17T05:29:36.593 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_mode_bucket": 0 2026-02-17T05:29:36.593 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:29:36.593 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.593 INFO:tasks.workunit.client.0.trial030.stdout: "osd_metadata": [ 2026-02-17T05:29:36.594 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.594 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-17T05:29:36.594 INFO:tasks.workunit.client.0.trial030.stdout: "arch": "x86_64", 2026-02-17T05:29:36.594 INFO:tasks.workunit.client.0.trial030.stdout: "back_addr": "[v2:127.0.0.1:6802/4213725056,v1:127.0.0.1:6803/4213725056]", 2026-02-17T05:29:36.594 INFO:tasks.workunit.client.0.trial030.stdout: "back_iface": "", 2026-02-17T05:29:36.594 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs": "1", 2026-02-17T05:29:36.594 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_db": "0", 2026-02-17T05:29:36.594 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T05:29:36.594 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_single_shared_device": "1", 2026-02-17T05:29:36.594 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T05:29:36.594 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocator": "hybrid", 2026-02-17T05:29:36.594 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T05:29:36.594 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T05:29:36.594 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T05:29:36.594 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T05:29:36.594 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T05:29:36.594 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-17T05:29:36.594 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T05:29:36.594 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T05:29:36.595 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T05:29:36.595 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T05:29:36.595 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-17T05:29:36.595 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T05:29:36.595 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T05:29:36.595 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_write_mode": "classic", 2026-02-17T05:29:36.595 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_release": "tentacle", 2026-02-17T05:29:36.595 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version": "ceph version 20.3.0-5271-g32585015 (325850157d309f65985eea9ec9bb9f1d56726fee) tentacle (dev - None)", 2026-02-17T05:29:36.595 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_short": "20.3.0-5271-g32585015", 2026-02-17T05:29:36.595 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_when_created": "ceph version 20.3.0-5271-g32585015 (325850157d309f65985eea9ec9bb9f1d56726fee) tentacle (dev - None)", 2026-02-17T05:29:36.595 INFO:tasks.workunit.client.0.trial030.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T05:29:36.595 INFO:tasks.workunit.client.0.trial030.stdout: "created_at": "2026-02-17T05:28:24.472114Z", 2026-02-17T05:29:36.595 INFO:tasks.workunit.client.0.trial030.stdout: "default_device_class": "ssd", 2026-02-17T05:29:36.595 INFO:tasks.workunit.client.0.trial030.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6B65", 2026-02-17T05:29:36.595 INFO:tasks.workunit.client.0.trial030.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T05:29:36.595 INFO:tasks.workunit.client.0.trial030.stdout: "devices": "nvme0n1", 2026-02-17T05:29:36.595 INFO:tasks.workunit.client.0.trial030.stdout: "distro": "ubuntu", 2026-02-17T05:29:36.595 INFO:tasks.workunit.client.0.trial030.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T05:29:36.596 INFO:tasks.workunit.client.0.trial030.stdout: "distro_version": "22.04", 2026-02-17T05:29:36.596 INFO:tasks.workunit.client.0.trial030.stdout: "front_addr": "[v2:127.0.0.1:6800/4213725056,v1:127.0.0.1:6801/4213725056]", 2026-02-17T05:29:36.596 INFO:tasks.workunit.client.0.trial030.stdout: "front_iface": "", 2026-02-17T05:29:36.596 INFO:tasks.workunit.client.0.trial030.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/4213725056,v1:127.0.0.1:6807/4213725056]", 2026-02-17T05:29:36.596 INFO:tasks.workunit.client.0.trial030.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/4213725056,v1:127.0.0.1:6805/4213725056]", 2026-02-17T05:29:36.596 INFO:tasks.workunit.client.0.trial030.stdout: "hostname": "trial030", 2026-02-17T05:29:36.596 INFO:tasks.workunit.client.0.trial030.stdout: "journal_rotational": "0", 2026-02-17T05:29:36.596 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T05:29:36.596 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T05:29:36.596 INFO:tasks.workunit.client.0.trial030.stdout: "mem_swap_kb": "8388604", 2026-02-17T05:29:36.596 INFO:tasks.workunit.client.0.trial030.stdout: "mem_total_kb": "130961692", 2026-02-17T05:29:36.596 INFO:tasks.workunit.client.0.trial030.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T05:29:36.596 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_node": "0", 2026-02-17T05:29:36.596 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_nodes": "0", 2026-02-17T05:29:36.596 INFO:tasks.workunit.client.0.trial030.stdout: "os": "Linux", 2026-02-17T05:29:36.596 INFO:tasks.workunit.client.0.trial030.stdout: "osd_data": "td/divergent-priors/0", 2026-02-17T05:29:36.596 INFO:tasks.workunit.client.0.trial030.stdout: "osd_objectstore": "bluestore", 2026-02-17T05:29:36.596 INFO:tasks.workunit.client.0.trial030.stdout: "osdspec_affinity": "", 2026-02-17T05:29:36.597 INFO:tasks.workunit.client.0.trial030.stdout: "rotational": "0" 2026-02-17T05:29:36.597 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.597 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.597 INFO:tasks.workunit.client.0.trial030.stdout: "id": 1, 2026-02-17T05:29:36.597 INFO:tasks.workunit.client.0.trial030.stdout: "arch": "x86_64", 2026-02-17T05:29:36.597 INFO:tasks.workunit.client.0.trial030.stdout: "back_addr": "[v2:127.0.0.1:6812/418378196,v1:127.0.0.1:6813/418378196]", 2026-02-17T05:29:36.597 INFO:tasks.workunit.client.0.trial030.stdout: "back_iface": "", 2026-02-17T05:29:36.597 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs": "1", 2026-02-17T05:29:36.597 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_db": "0", 2026-02-17T05:29:36.597 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T05:29:36.597 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_single_shared_device": "1", 2026-02-17T05:29:36.597 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T05:29:36.597 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocator": "hybrid", 2026-02-17T05:29:36.597 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T05:29:36.597 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T05:29:36.597 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T05:29:36.597 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T05:29:36.597 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T05:29:36.597 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-17T05:29:36.598 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T05:29:36.598 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T05:29:36.598 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T05:29:36.598 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T05:29:36.598 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-17T05:29:36.598 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T05:29:36.598 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T05:29:36.598 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_write_mode": "classic", 2026-02-17T05:29:36.598 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_release": "tentacle", 2026-02-17T05:29:36.598 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version": "ceph version 20.3.0-5271-g32585015 (325850157d309f65985eea9ec9bb9f1d56726fee) tentacle (dev - None)", 2026-02-17T05:29:36.598 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_short": "20.3.0-5271-g32585015", 2026-02-17T05:29:36.598 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_when_created": "ceph version 20.3.0-5271-g32585015 (325850157d309f65985eea9ec9bb9f1d56726fee) tentacle (dev - None)", 2026-02-17T05:29:36.598 INFO:tasks.workunit.client.0.trial030.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T05:29:36.598 INFO:tasks.workunit.client.0.trial030.stdout: "created_at": "2026-02-17T05:28:28.225769Z", 2026-02-17T05:29:36.598 INFO:tasks.workunit.client.0.trial030.stdout: "default_device_class": "ssd", 2026-02-17T05:29:36.598 INFO:tasks.workunit.client.0.trial030.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6B65", 2026-02-17T05:29:36.598 INFO:tasks.workunit.client.0.trial030.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T05:29:36.598 INFO:tasks.workunit.client.0.trial030.stdout: "devices": "nvme0n1", 2026-02-17T05:29:36.598 INFO:tasks.workunit.client.0.trial030.stdout: "distro": "ubuntu", 2026-02-17T05:29:36.598 INFO:tasks.workunit.client.0.trial030.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T05:29:36.598 INFO:tasks.workunit.client.0.trial030.stdout: "distro_version": "22.04", 2026-02-17T05:29:36.599 INFO:tasks.workunit.client.0.trial030.stdout: "front_addr": "[v2:127.0.0.1:6810/418378196,v1:127.0.0.1:6811/418378196]", 2026-02-17T05:29:36.599 INFO:tasks.workunit.client.0.trial030.stdout: "front_iface": "", 2026-02-17T05:29:36.599 INFO:tasks.workunit.client.0.trial030.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/418378196,v1:127.0.0.1:6817/418378196]", 2026-02-17T05:29:36.599 INFO:tasks.workunit.client.0.trial030.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/418378196,v1:127.0.0.1:6815/418378196]", 2026-02-17T05:29:36.599 INFO:tasks.workunit.client.0.trial030.stdout: "hostname": "trial030", 2026-02-17T05:29:36.599 INFO:tasks.workunit.client.0.trial030.stdout: "journal_rotational": "0", 2026-02-17T05:29:36.599 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T05:29:36.599 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T05:29:36.599 INFO:tasks.workunit.client.0.trial030.stdout: "mem_swap_kb": "8388604", 2026-02-17T05:29:36.599 INFO:tasks.workunit.client.0.trial030.stdout: "mem_total_kb": "130961692", 2026-02-17T05:29:36.599 INFO:tasks.workunit.client.0.trial030.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T05:29:36.599 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_node": "0", 2026-02-17T05:29:36.599 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_nodes": "0", 2026-02-17T05:29:36.599 INFO:tasks.workunit.client.0.trial030.stdout: "os": "Linux", 2026-02-17T05:29:36.599 INFO:tasks.workunit.client.0.trial030.stdout: "osd_data": "td/divergent-priors/1", 2026-02-17T05:29:36.599 INFO:tasks.workunit.client.0.trial030.stdout: "osd_objectstore": "bluestore", 2026-02-17T05:29:36.599 INFO:tasks.workunit.client.0.trial030.stdout: "osdspec_affinity": "", 2026-02-17T05:29:36.599 INFO:tasks.workunit.client.0.trial030.stdout: "rotational": "0" 2026-02-17T05:29:36.599 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.599 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.599 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-17T05:29:36.599 INFO:tasks.workunit.client.0.trial030.stdout: "arch": "x86_64", 2026-02-17T05:29:36.599 INFO:tasks.workunit.client.0.trial030.stdout: "back_addr": "[v2:127.0.0.1:6812/2612200958,v1:127.0.0.1:6813/2612200958]", 2026-02-17T05:29:36.600 INFO:tasks.workunit.client.0.trial030.stdout: "back_iface": "", 2026-02-17T05:29:36.600 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs": "1", 2026-02-17T05:29:36.600 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_db": "0", 2026-02-17T05:29:36.600 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T05:29:36.600 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_single_shared_device": "1", 2026-02-17T05:29:36.600 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T05:29:36.600 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocator": "hybrid", 2026-02-17T05:29:36.600 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T05:29:36.600 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T05:29:36.600 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T05:29:36.600 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T05:29:36.600 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T05:29:36.600 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-17T05:29:36.600 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T05:29:36.600 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T05:29:36.600 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T05:29:36.600 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T05:29:36.600 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-17T05:29:36.600 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T05:29:36.600 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T05:29:36.600 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_write_mode": "classic", 2026-02-17T05:29:36.600 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_release": "tentacle", 2026-02-17T05:29:36.600 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version": "ceph version 20.3.0-5271-g32585015 (325850157d309f65985eea9ec9bb9f1d56726fee) tentacle (dev - None)", 2026-02-17T05:29:36.600 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_short": "20.3.0-5271-g32585015", 2026-02-17T05:29:36.601 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_when_created": "ceph version 20.3.0-5271-g32585015 (325850157d309f65985eea9ec9bb9f1d56726fee) tentacle (dev - None)", 2026-02-17T05:29:36.601 INFO:tasks.workunit.client.0.trial030.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T05:29:36.601 INFO:tasks.workunit.client.0.trial030.stdout: "created_at": "2026-02-17T05:28:32.297604Z", 2026-02-17T05:29:36.601 INFO:tasks.workunit.client.0.trial030.stdout: "default_device_class": "ssd", 2026-02-17T05:29:36.601 INFO:tasks.workunit.client.0.trial030.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6B65", 2026-02-17T05:29:36.601 INFO:tasks.workunit.client.0.trial030.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T05:29:36.601 INFO:tasks.workunit.client.0.trial030.stdout: "devices": "nvme0n1", 2026-02-17T05:29:36.601 INFO:tasks.workunit.client.0.trial030.stdout: "distro": "ubuntu", 2026-02-17T05:29:36.601 INFO:tasks.workunit.client.0.trial030.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T05:29:36.601 INFO:tasks.workunit.client.0.trial030.stdout: "distro_version": "22.04", 2026-02-17T05:29:36.601 INFO:tasks.workunit.client.0.trial030.stdout: "front_addr": "[v2:127.0.0.1:6810/2612200958,v1:127.0.0.1:6811/2612200958]", 2026-02-17T05:29:36.601 INFO:tasks.workunit.client.0.trial030.stdout: "front_iface": "", 2026-02-17T05:29:36.601 INFO:tasks.workunit.client.0.trial030.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/2612200958,v1:127.0.0.1:6817/2612200958]", 2026-02-17T05:29:36.601 INFO:tasks.workunit.client.0.trial030.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/2612200958,v1:127.0.0.1:6815/2612200958]", 2026-02-17T05:29:36.601 INFO:tasks.workunit.client.0.trial030.stdout: "hostname": "trial030", 2026-02-17T05:29:36.601 INFO:tasks.workunit.client.0.trial030.stdout: "journal_rotational": "0", 2026-02-17T05:29:36.601 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T05:29:36.601 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T05:29:36.601 INFO:tasks.workunit.client.0.trial030.stdout: "mem_swap_kb": "8388604", 2026-02-17T05:29:36.601 INFO:tasks.workunit.client.0.trial030.stdout: "mem_total_kb": "130961692", 2026-02-17T05:29:36.601 INFO:tasks.workunit.client.0.trial030.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T05:29:36.601 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_node": "0", 2026-02-17T05:29:36.601 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_nodes": "0", 2026-02-17T05:29:36.601 INFO:tasks.workunit.client.0.trial030.stdout: "os": "Linux", 2026-02-17T05:29:36.602 INFO:tasks.workunit.client.0.trial030.stdout: "osd_data": "td/divergent-priors/2", 2026-02-17T05:29:36.602 INFO:tasks.workunit.client.0.trial030.stdout: "osd_objectstore": "bluestore", 2026-02-17T05:29:36.602 INFO:tasks.workunit.client.0.trial030.stdout: "osdspec_affinity": "", 2026-02-17T05:29:36.602 INFO:tasks.workunit.client.0.trial030.stdout: "rotational": "0" 2026-02-17T05:29:36.602 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:29:36.602 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:29:36.602 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap_clean_epochs": { 2026-02-17T05:29:36.602 INFO:tasks.workunit.client.0.trial030.stdout: "min_last_epoch_clean": 0, 2026-02-17T05:29:36.602 INFO:tasks.workunit.client.0.trial030.stdout: "last_epoch_clean": { 2026-02-17T05:29:36.602 INFO:tasks.workunit.client.0.trial030.stdout: "per_pool": [] 2026-02-17T05:29:36.602 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.602 INFO:tasks.workunit.client.0.trial030.stdout: "osd_epochs": [ 2026-02-17T05:29:36.602 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.602 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-17T05:29:36.602 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 35 2026-02-17T05:29:36.602 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.602 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.602 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-17T05:29:36.602 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 39 2026-02-17T05:29:36.602 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:29:36.602 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:29:36.602 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.602 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap_first_committed": 1, 2026-02-17T05:29:36.602 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap_last_committed": 41, 2026-02-17T05:29:36.602 INFO:tasks.workunit.client.0.trial030.stdout: "crushmap": { 2026-02-17T05:29:36.603 INFO:tasks.workunit.client.0.trial030.stdout: "devices": [ 2026-02-17T05:29:36.603 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.603 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-17T05:29:36.603 INFO:tasks.workunit.client.0.trial030.stdout: "name": "osd.0", 2026-02-17T05:29:36.603 INFO:tasks.workunit.client.0.trial030.stdout: "class": "ssd" 2026-02-17T05:29:36.603 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.603 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.603 INFO:tasks.workunit.client.0.trial030.stdout: "id": 1, 2026-02-17T05:29:36.603 INFO:tasks.workunit.client.0.trial030.stdout: "name": "osd.1", 2026-02-17T05:29:36.603 INFO:tasks.workunit.client.0.trial030.stdout: "class": "ssd" 2026-02-17T05:29:36.603 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.603 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.603 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-17T05:29:36.603 INFO:tasks.workunit.client.0.trial030.stdout: "name": "osd.2", 2026-02-17T05:29:36.603 INFO:tasks.workunit.client.0.trial030.stdout: "class": "ssd" 2026-02-17T05:29:36.603 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:29:36.603 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:29:36.603 INFO:tasks.workunit.client.0.trial030.stdout: "types": [ 2026-02-17T05:29:36.603 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.603 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 0, 2026-02-17T05:29:36.603 INFO:tasks.workunit.client.0.trial030.stdout: "name": "osd" 2026-02-17T05:29:36.603 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.603 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.604 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 1, 2026-02-17T05:29:36.604 INFO:tasks.workunit.client.0.trial030.stdout: "name": "host" 2026-02-17T05:29:36.604 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.604 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.604 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 2, 2026-02-17T05:29:36.604 INFO:tasks.workunit.client.0.trial030.stdout: "name": "chassis" 2026-02-17T05:29:36.604 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.604 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.604 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 3, 2026-02-17T05:29:36.604 INFO:tasks.workunit.client.0.trial030.stdout: "name": "rack" 2026-02-17T05:29:36.604 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.604 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.604 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 4, 2026-02-17T05:29:36.604 INFO:tasks.workunit.client.0.trial030.stdout: "name": "row" 2026-02-17T05:29:36.604 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.604 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.604 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 5, 2026-02-17T05:29:36.604 INFO:tasks.workunit.client.0.trial030.stdout: "name": "pdu" 2026-02-17T05:29:36.604 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.604 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.604 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 6, 2026-02-17T05:29:36.604 INFO:tasks.workunit.client.0.trial030.stdout: "name": "pod" 2026-02-17T05:29:36.604 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.604 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.604 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 7, 2026-02-17T05:29:36.605 INFO:tasks.workunit.client.0.trial030.stdout: "name": "room" 2026-02-17T05:29:36.605 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.605 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.605 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 8, 2026-02-17T05:29:36.605 INFO:tasks.workunit.client.0.trial030.stdout: "name": "datacenter" 2026-02-17T05:29:36.605 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.605 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.605 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 9, 2026-02-17T05:29:36.605 INFO:tasks.workunit.client.0.trial030.stdout: "name": "zone" 2026-02-17T05:29:36.605 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.605 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.605 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 10, 2026-02-17T05:29:36.605 INFO:tasks.workunit.client.0.trial030.stdout: "name": "region" 2026-02-17T05:29:36.605 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.605 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.605 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 11, 2026-02-17T05:29:36.605 INFO:tasks.workunit.client.0.trial030.stdout: "name": "root" 2026-02-17T05:29:36.605 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:29:36.605 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:29:36.605 INFO:tasks.workunit.client.0.trial030.stdout: "buckets": [ 2026-02-17T05:29:36.605 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.605 INFO:tasks.workunit.client.0.trial030.stdout: "id": -1, 2026-02-17T05:29:36.605 INFO:tasks.workunit.client.0.trial030.stdout: "name": "default", 2026-02-17T05:29:36.605 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 11, 2026-02-17T05:29:36.605 INFO:tasks.workunit.client.0.trial030.stdout: "type_name": "root", 2026-02-17T05:29:36.605 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-17T05:29:36.606 INFO:tasks.workunit.client.0.trial030.stdout: "alg": "straw2", 2026-02-17T05:29:36.606 INFO:tasks.workunit.client.0.trial030.stdout: "hash": "rjenkins1", 2026-02-17T05:29:36.606 INFO:tasks.workunit.client.0.trial030.stdout: "items": [ 2026-02-17T05:29:36.606 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.606 INFO:tasks.workunit.client.0.trial030.stdout: "id": -3, 2026-02-17T05:29:36.606 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-17T05:29:36.606 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 0 2026-02-17T05:29:36.606 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:29:36.606 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:29:36.606 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.606 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.606 INFO:tasks.workunit.client.0.trial030.stdout: "id": -2, 2026-02-17T05:29:36.606 INFO:tasks.workunit.client.0.trial030.stdout: "name": "default~ssd", 2026-02-17T05:29:36.606 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 11, 2026-02-17T05:29:36.606 INFO:tasks.workunit.client.0.trial030.stdout: "type_name": "root", 2026-02-17T05:29:36.606 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-17T05:29:36.606 INFO:tasks.workunit.client.0.trial030.stdout: "alg": "straw2", 2026-02-17T05:29:36.606 INFO:tasks.workunit.client.0.trial030.stdout: "hash": "rjenkins1", 2026-02-17T05:29:36.606 INFO:tasks.workunit.client.0.trial030.stdout: "items": [ 2026-02-17T05:29:36.606 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.606 INFO:tasks.workunit.client.0.trial030.stdout: "id": -4, 2026-02-17T05:29:36.606 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-17T05:29:36.606 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 0 2026-02-17T05:29:36.606 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:29:36.606 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:29:36.607 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.607 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.607 INFO:tasks.workunit.client.0.trial030.stdout: "id": -3, 2026-02-17T05:29:36.607 INFO:tasks.workunit.client.0.trial030.stdout: "name": "trial030", 2026-02-17T05:29:36.607 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 1, 2026-02-17T05:29:36.607 INFO:tasks.workunit.client.0.trial030.stdout: "type_name": "host", 2026-02-17T05:29:36.607 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-17T05:29:36.607 INFO:tasks.workunit.client.0.trial030.stdout: "alg": "straw2", 2026-02-17T05:29:36.607 INFO:tasks.workunit.client.0.trial030.stdout: "hash": "rjenkins1", 2026-02-17T05:29:36.607 INFO:tasks.workunit.client.0.trial030.stdout: "items": [ 2026-02-17T05:29:36.607 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.607 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-17T05:29:36.607 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-17T05:29:36.607 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 0 2026-02-17T05:29:36.607 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.607 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.607 INFO:tasks.workunit.client.0.trial030.stdout: "id": 1, 2026-02-17T05:29:36.607 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-17T05:29:36.607 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 1 2026-02-17T05:29:36.607 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.607 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.607 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-17T05:29:36.607 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-17T05:29:36.607 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 2 2026-02-17T05:29:36.607 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:29:36.607 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:29:36.607 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.607 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.608 INFO:tasks.workunit.client.0.trial030.stdout: "id": -4, 2026-02-17T05:29:36.608 INFO:tasks.workunit.client.0.trial030.stdout: "name": "trial030~ssd", 2026-02-17T05:29:36.608 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 1, 2026-02-17T05:29:36.608 INFO:tasks.workunit.client.0.trial030.stdout: "type_name": "host", 2026-02-17T05:29:36.608 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-17T05:29:36.608 INFO:tasks.workunit.client.0.trial030.stdout: "alg": "straw2", 2026-02-17T05:29:36.608 INFO:tasks.workunit.client.0.trial030.stdout: "hash": "rjenkins1", 2026-02-17T05:29:36.608 INFO:tasks.workunit.client.0.trial030.stdout: "items": [ 2026-02-17T05:29:36.608 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.608 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-17T05:29:36.608 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-17T05:29:36.608 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 0 2026-02-17T05:29:36.608 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.608 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.608 INFO:tasks.workunit.client.0.trial030.stdout: "id": 1, 2026-02-17T05:29:36.608 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-17T05:29:36.608 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 1 2026-02-17T05:29:36.608 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.608 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.608 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-17T05:29:36.608 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-17T05:29:36.608 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 2 2026-02-17T05:29:36.608 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:29:36.608 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:29:36.608 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:29:36.608 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:29:36.608 INFO:tasks.workunit.client.0.trial030.stdout: "rules": [ 2026-02-17T05:29:36.608 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.608 INFO:tasks.workunit.client.0.trial030.stdout: "rule_id": 0, 2026-02-17T05:29:36.609 INFO:tasks.workunit.client.0.trial030.stdout: "rule_name": "replicated_rule", 2026-02-17T05:29:36.609 INFO:tasks.workunit.client.0.trial030.stdout: "type": 1, 2026-02-17T05:29:36.609 INFO:tasks.workunit.client.0.trial030.stdout: "steps": [ 2026-02-17T05:29:36.609 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.609 INFO:tasks.workunit.client.0.trial030.stdout: "op": "take", 2026-02-17T05:29:36.609 INFO:tasks.workunit.client.0.trial030.stdout: "item": -1, 2026-02-17T05:29:36.609 INFO:tasks.workunit.client.0.trial030.stdout: "item_name": "default" 2026-02-17T05:29:36.609 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.609 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.609 INFO:tasks.workunit.client.0.trial030.stdout: "op": "choose_firstn", 2026-02-17T05:29:36.609 INFO:tasks.workunit.client.0.trial030.stdout: "num": 0, 2026-02-17T05:29:36.609 INFO:tasks.workunit.client.0.trial030.stdout: "type": "osd" 2026-02-17T05:29:36.609 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.609 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.609 INFO:tasks.workunit.client.0.trial030.stdout: "op": "emit" 2026-02-17T05:29:36.609 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:29:36.609 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:29:36.609 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:29:36.609 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:29:36.609 INFO:tasks.workunit.client.0.trial030.stdout: "tunables": { 2026-02-17T05:29:36.609 INFO:tasks.workunit.client.0.trial030.stdout: "choose_local_tries": 0, 2026-02-17T05:29:36.609 INFO:tasks.workunit.client.0.trial030.stdout: "choose_local_fallback_tries": 0, 2026-02-17T05:29:36.609 INFO:tasks.workunit.client.0.trial030.stdout: "choose_total_tries": 50, 2026-02-17T05:29:36.609 INFO:tasks.workunit.client.0.trial030.stdout: "chooseleaf_descend_once": 1, 2026-02-17T05:29:36.609 INFO:tasks.workunit.client.0.trial030.stdout: "chooseleaf_vary_r": 1, 2026-02-17T05:29:36.609 INFO:tasks.workunit.client.0.trial030.stdout: "chooseleaf_stable": 1, 2026-02-17T05:29:36.609 INFO:tasks.workunit.client.0.trial030.stdout: "msr_descents": 100, 2026-02-17T05:29:36.609 INFO:tasks.workunit.client.0.trial030.stdout: "msr_collision_tries": 100, 2026-02-17T05:29:36.609 INFO:tasks.workunit.client.0.trial030.stdout: "straw_calc_version": 1, 2026-02-17T05:29:36.610 INFO:tasks.workunit.client.0.trial030.stdout: "allowed_bucket_algs": 54, 2026-02-17T05:29:36.610 INFO:tasks.workunit.client.0.trial030.stderr:report 897715356 2026-02-17T05:29:36.610 INFO:tasks.workunit.client.0.trial030.stdout: "profile": "jewel", 2026-02-17T05:29:36.610 INFO:tasks.workunit.client.0.trial030.stdout: "optimal_tunables": 1, 2026-02-17T05:29:36.610 INFO:tasks.workunit.client.0.trial030.stdout: "legacy_tunables": 0, 2026-02-17T05:29:36.610 INFO:tasks.workunit.client.0.trial030.stdout: "minimum_required_version": "jewel", 2026-02-17T05:29:36.610 INFO:tasks.workunit.client.0.trial030.stdout: "require_feature_tunables": 1, 2026-02-17T05:29:36.610 INFO:tasks.workunit.client.0.trial030.stdout: "require_feature_tunables2": 1, 2026-02-17T05:29:36.610 INFO:tasks.workunit.client.0.trial030.stdout: "has_v2_rules": 0, 2026-02-17T05:29:36.610 INFO:tasks.workunit.client.0.trial030.stdout: "require_feature_tunables3": 1, 2026-02-17T05:29:36.610 INFO:tasks.workunit.client.0.trial030.stdout: "has_v3_rules": 0, 2026-02-17T05:29:36.610 INFO:tasks.workunit.client.0.trial030.stdout: "has_v4_buckets": 1, 2026-02-17T05:29:36.610 INFO:tasks.workunit.client.0.trial030.stdout: "require_feature_tunables5": 1, 2026-02-17T05:29:36.610 INFO:tasks.workunit.client.0.trial030.stdout: "has_v5_rules": 0, 2026-02-17T05:29:36.611 INFO:tasks.workunit.client.0.trial030.stdout: "has_msr_rules": 0 2026-02-17T05:29:36.611 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.611 INFO:tasks.workunit.client.0.trial030.stdout: "choose_args": {} 2026-02-17T05:29:36.611 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.611 INFO:tasks.workunit.client.0.trial030.stdout: "fsmap": { 2026-02-17T05:29:36.611 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 1, 2026-02-17T05:29:36.611 INFO:tasks.workunit.client.0.trial030.stdout: "btime": "2026-02-17T05:28:23:487550+0000", 2026-02-17T05:29:36.611 INFO:tasks.workunit.client.0.trial030.stdout: "default_fscid": -1, 2026-02-17T05:29:36.611 INFO:tasks.workunit.client.0.trial030.stdout: "compat": { 2026-02-17T05:29:36.611 INFO:tasks.workunit.client.0.trial030.stdout: "compat": {}, 2026-02-17T05:29:36.611 INFO:tasks.workunit.client.0.trial030.stdout: "ro_compat": {}, 2026-02-17T05:29:36.611 INFO:tasks.workunit.client.0.trial030.stdout: "incompat": { 2026-02-17T05:29:36.611 INFO:tasks.workunit.client.0.trial030.stdout: "feature_1": "base v0.20", 2026-02-17T05:29:36.611 INFO:tasks.workunit.client.0.trial030.stdout: "feature_2": "client writeable ranges", 2026-02-17T05:29:36.611 INFO:tasks.workunit.client.0.trial030.stdout: "feature_3": "default file layouts on dirs", 2026-02-17T05:29:36.611 INFO:tasks.workunit.client.0.trial030.stdout: "feature_4": "dir inode in separate object", 2026-02-17T05:29:36.611 INFO:tasks.workunit.client.0.trial030.stdout: "feature_5": "mds uses versioned encoding", 2026-02-17T05:29:36.611 INFO:tasks.workunit.client.0.trial030.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-17T05:29:36.611 INFO:tasks.workunit.client.0.trial030.stdout: "feature_8": "no anchor table", 2026-02-17T05:29:36.611 INFO:tasks.workunit.client.0.trial030.stdout: "feature_9": "file layout v2", 2026-02-17T05:29:36.611 INFO:tasks.workunit.client.0.trial030.stdout: "feature_10": "snaprealm v2", 2026-02-17T05:29:36.611 INFO:tasks.workunit.client.0.trial030.stdout: "feature_11": "minor log segments", 2026-02-17T05:29:36.611 INFO:tasks.workunit.client.0.trial030.stdout: "feature_12": "quiesce subvolumes" 2026-02-17T05:29:36.611 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:29:36.611 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.611 INFO:tasks.workunit.client.0.trial030.stdout: "feature_flags": { 2026-02-17T05:29:36.611 INFO:tasks.workunit.client.0.trial030.stdout: "enable_multiple": true, 2026-02-17T05:29:36.611 INFO:tasks.workunit.client.0.trial030.stdout: "ever_enabled_multiple": true 2026-02-17T05:29:36.611 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.612 INFO:tasks.workunit.client.0.trial030.stdout: "standbys": [], 2026-02-17T05:29:36.612 INFO:tasks.workunit.client.0.trial030.stdout: "filesystems": [] 2026-02-17T05:29:36.612 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.612 INFO:tasks.workunit.client.0.trial030.stdout: "mdsmap_first_committed": 1, 2026-02-17T05:29:36.612 INFO:tasks.workunit.client.0.trial030.stdout: "mdsmap_last_committed": 1, 2026-02-17T05:29:36.612 INFO:tasks.workunit.client.0.trial030.stdout: "auth": { 2026-02-17T05:29:36.612 INFO:tasks.workunit.client.0.trial030.stdout: "first_committed": 1, 2026-02-17T05:29:36.612 INFO:tasks.workunit.client.0.trial030.stdout: "last_committed": 5, 2026-02-17T05:29:36.612 INFO:tasks.workunit.client.0.trial030.stdout: "num_secrets": 3 2026-02-17T05:29:36.612 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.612 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg": 1, 2026-02-17T05:29:36.612 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg_active": 1, 2026-02-17T05:29:36.612 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg_unknown": 0, 2026-02-17T05:29:36.612 INFO:tasks.workunit.client.0.trial030.stdout: "num_osd": 3, 2026-02-17T05:29:36.612 INFO:tasks.workunit.client.0.trial030.stdout: "pool_sum": { 2026-02-17T05:29:36.612 INFO:tasks.workunit.client.0.trial030.stdout: "stat_sum": { 2026-02-17T05:29:36.612 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes": 51200, 2026-02-17T05:29:36.612 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects": 100, 2026-02-17T05:29:36.612 INFO:tasks.workunit.client.0.trial030.stdout: "num_object_clones": 0, 2026-02-17T05:29:36.612 INFO:tasks.workunit.client.0.trial030.stdout: "num_object_copies": 300, 2026-02-17T05:29:36.612 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T05:29:36.612 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_missing": 0, 2026-02-17T05:29:36.612 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_degraded": 100, 2026-02-17T05:29:36.612 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_misplaced": 0, 2026-02-17T05:29:36.612 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_unfound": 0, 2026-02-17T05:29:36.612 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_dirty": 100, 2026-02-17T05:29:36.612 INFO:tasks.workunit.client.0.trial030.stdout: "num_whiteouts": 0, 2026-02-17T05:29:36.612 INFO:tasks.workunit.client.0.trial030.stdout: "num_read": 0, 2026-02-17T05:29:36.612 INFO:tasks.workunit.client.0.trial030.stdout: "num_read_kb": 0, 2026-02-17T05:29:36.612 INFO:tasks.workunit.client.0.trial030.stdout: "num_write": 100, 2026-02-17T05:29:36.612 INFO:tasks.workunit.client.0.trial030.stdout: "num_write_kb": 100, 2026-02-17T05:29:36.613 INFO:tasks.workunit.client.0.trial030.stdout: "num_scrub_errors": 0, 2026-02-17T05:29:36.613 INFO:tasks.workunit.client.0.trial030.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T05:29:36.613 INFO:tasks.workunit.client.0.trial030.stdout: "num_deep_scrub_errors": 0, 2026-02-17T05:29:36.613 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_recovered": 0, 2026-02-17T05:29:36.613 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes_recovered": 0, 2026-02-17T05:29:36.613 INFO:tasks.workunit.client.0.trial030.stdout: "num_keys_recovered": 0, 2026-02-17T05:29:36.613 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_omap": 0, 2026-02-17T05:29:36.613 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T05:29:36.613 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T05:29:36.613 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush": 0, 2026-02-17T05:29:36.613 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_kb": 0, 2026-02-17T05:29:36.613 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict": 0, 2026-02-17T05:29:36.613 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_kb": 0, 2026-02-17T05:29:36.613 INFO:tasks.workunit.client.0.trial030.stdout: "num_promote": 0, 2026-02-17T05:29:36.613 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_mode_high": 0, 2026-02-17T05:29:36.613 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_mode_low": 0, 2026-02-17T05:29:36.613 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_mode_some": 0, 2026-02-17T05:29:36.613 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_mode_full": 0, 2026-02-17T05:29:36.613 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_pinned": 0, 2026-02-17T05:29:36.613 INFO:tasks.workunit.client.0.trial030.stdout: "num_legacy_snapsets": 0, 2026-02-17T05:29:36.613 INFO:tasks.workunit.client.0.trial030.stdout: "num_large_omap_objects": 0, 2026-02-17T05:29:36.613 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_manifest": 0, 2026-02-17T05:29:36.613 INFO:tasks.workunit.client.0.trial030.stdout: "num_omap_bytes": 0, 2026-02-17T05:29:36.613 INFO:tasks.workunit.client.0.trial030.stdout: "num_omap_keys": 0, 2026-02-17T05:29:36.613 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_repaired": 0 2026-02-17T05:29:36.613 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.613 INFO:tasks.workunit.client.0.trial030.stdout: "store_stats": { 2026-02-17T05:29:36.613 INFO:tasks.workunit.client.0.trial030.stdout: "total": 0, 2026-02-17T05:29:36.613 INFO:tasks.workunit.client.0.trial030.stdout: "available": 0, 2026-02-17T05:29:36.613 INFO:tasks.workunit.client.0.trial030.stdout: "internally_reserved": 0, 2026-02-17T05:29:36.613 INFO:tasks.workunit.client.0.trial030.stdout: "allocated": 0, 2026-02-17T05:29:36.613 INFO:tasks.workunit.client.0.trial030.stdout: "data_stored": 0, 2026-02-17T05:29:36.614 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed": 0, 2026-02-17T05:29:36.614 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_allocated": 0, 2026-02-17T05:29:36.614 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_original": 0, 2026-02-17T05:29:36.614 INFO:tasks.workunit.client.0.trial030.stdout: "omap_allocated": 0, 2026-02-17T05:29:36.614 INFO:tasks.workunit.client.0.trial030.stdout: "internal_metadata": 0 2026-02-17T05:29:36.614 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.614 INFO:tasks.workunit.client.0.trial030.stdout: "log_size": 16, 2026-02-17T05:29:36.614 INFO:tasks.workunit.client.0.trial030.stdout: "ondisk_log_size": 16, 2026-02-17T05:29:36.614 INFO:tasks.workunit.client.0.trial030.stdout: "up": 2, 2026-02-17T05:29:36.614 INFO:tasks.workunit.client.0.trial030.stdout: "acting": 2, 2026-02-17T05:29:36.614 INFO:tasks.workunit.client.0.trial030.stdout: "num_store_stats": 0 2026-02-17T05:29:36.614 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.614 INFO:tasks.workunit.client.0.trial030.stdout: "osd_sum": { 2026-02-17T05:29:36.614 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 0, 2026-02-17T05:29:36.614 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 0, 2026-02-17T05:29:36.614 INFO:tasks.workunit.client.0.trial030.stdout: "num_pgs": 3, 2026-02-17T05:29:36.614 INFO:tasks.workunit.client.0.trial030.stdout: "num_osds": 3, 2026-02-17T05:29:36.614 INFO:tasks.workunit.client.0.trial030.stdout: "num_per_pool_osds": 3, 2026-02-17T05:29:36.614 INFO:tasks.workunit.client.0.trial030.stdout: "num_per_pool_omap_osds": 3, 2026-02-17T05:29:36.614 INFO:tasks.workunit.client.0.trial030.stdout: "kb": 314572800, 2026-02-17T05:29:36.614 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used": 83880, 2026-02-17T05:29:36.614 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_data": 2096, 2026-02-17T05:29:36.614 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_omap": 25, 2026-02-17T05:29:36.614 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_meta": 81702, 2026-02-17T05:29:36.614 INFO:tasks.workunit.client.0.trial030.stdout: "kb_avail": 314488920, 2026-02-17T05:29:36.614 INFO:tasks.workunit.client.0.trial030.stdout: "statfs": { 2026-02-17T05:29:36.614 INFO:tasks.workunit.client.0.trial030.stdout: "total": 322122547200, 2026-02-17T05:29:36.614 INFO:tasks.workunit.client.0.trial030.stdout: "available": 322036654080, 2026-02-17T05:29:36.614 INFO:tasks.workunit.client.0.trial030.stdout: "internally_reserved": 0, 2026-02-17T05:29:36.614 INFO:tasks.workunit.client.0.trial030.stdout: "allocated": 2146304, 2026-02-17T05:29:36.614 INFO:tasks.workunit.client.0.trial030.stdout: "data_stored": 428816, 2026-02-17T05:29:36.614 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed": 0, 2026-02-17T05:29:36.615 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_allocated": 0, 2026-02-17T05:29:36.615 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_original": 0, 2026-02-17T05:29:36.615 INFO:tasks.workunit.client.0.trial030.stdout: "omap_allocated": 26053, 2026-02-17T05:29:36.615 INFO:tasks.workunit.client.0.trial030.stdout: "internal_metadata": 83663419 2026-02-17T05:29:36.615 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.615 INFO:tasks.workunit.client.0.trial030.stdout: "hb_peers": [], 2026-02-17T05:29:36.615 INFO:tasks.workunit.client.0.trial030.stdout: "snap_trim_queue_len": 0, 2026-02-17T05:29:36.615 INFO:tasks.workunit.client.0.trial030.stdout: "num_snap_trimming": 0, 2026-02-17T05:29:36.615 INFO:tasks.workunit.client.0.trial030.stdout: "num_shards_repaired": 0, 2026-02-17T05:29:36.615 INFO:tasks.workunit.client.0.trial030.stdout: "op_queue_age_hist": { 2026-02-17T05:29:36.615 INFO:tasks.workunit.client.0.trial030.stdout: "histogram": [], 2026-02-17T05:29:36.615 INFO:tasks.workunit.client.0.trial030.stdout: "upper_bound": 1 2026-02-17T05:29:36.615 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.615 INFO:tasks.workunit.client.0.trial030.stdout: "perf_stat": { 2026-02-17T05:29:36.615 INFO:tasks.workunit.client.0.trial030.stdout: "commit_latency_ms": 0, 2026-02-17T05:29:36.615 INFO:tasks.workunit.client.0.trial030.stdout: "apply_latency_ms": 0, 2026-02-17T05:29:36.615 INFO:tasks.workunit.client.0.trial030.stdout: "commit_latency_ns": 0, 2026-02-17T05:29:36.615 INFO:tasks.workunit.client.0.trial030.stdout: "apply_latency_ns": 0 2026-02-17T05:29:36.615 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.615 INFO:tasks.workunit.client.0.trial030.stdout: "alerts": [], 2026-02-17T05:29:36.615 INFO:tasks.workunit.client.0.trial030.stdout: "network_ping_times": [] 2026-02-17T05:29:36.615 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.615 INFO:tasks.workunit.client.0.trial030.stdout: "osd_sum_by_class": { 2026-02-17T05:29:36.615 INFO:tasks.workunit.client.0.trial030.stdout: "ssd": { 2026-02-17T05:29:36.615 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 0, 2026-02-17T05:29:36.615 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 0, 2026-02-17T05:29:36.615 INFO:tasks.workunit.client.0.trial030.stdout: "num_pgs": 3, 2026-02-17T05:29:36.615 INFO:tasks.workunit.client.0.trial030.stdout: "num_osds": 3, 2026-02-17T05:29:36.615 INFO:tasks.workunit.client.0.trial030.stdout: "num_per_pool_osds": 3, 2026-02-17T05:29:36.615 INFO:tasks.workunit.client.0.trial030.stdout: "num_per_pool_omap_osds": 3, 2026-02-17T05:29:36.615 INFO:tasks.workunit.client.0.trial030.stdout: "kb": 314572800, 2026-02-17T05:29:36.615 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used": 83880, 2026-02-17T05:29:36.616 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_data": 2096, 2026-02-17T05:29:36.616 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_omap": 25, 2026-02-17T05:29:36.616 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_meta": 81702, 2026-02-17T05:29:36.616 INFO:tasks.workunit.client.0.trial030.stdout: "kb_avail": 314488920, 2026-02-17T05:29:36.616 INFO:tasks.workunit.client.0.trial030.stdout: "statfs": { 2026-02-17T05:29:36.616 INFO:tasks.workunit.client.0.trial030.stdout: "total": 322122547200, 2026-02-17T05:29:36.616 INFO:tasks.workunit.client.0.trial030.stdout: "available": 322036654080, 2026-02-17T05:29:36.616 INFO:tasks.workunit.client.0.trial030.stdout: "internally_reserved": 0, 2026-02-17T05:29:36.616 INFO:tasks.workunit.client.0.trial030.stdout: "allocated": 2146304, 2026-02-17T05:29:36.616 INFO:tasks.workunit.client.0.trial030.stdout: "data_stored": 428816, 2026-02-17T05:29:36.616 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed": 0, 2026-02-17T05:29:36.616 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_allocated": 0, 2026-02-17T05:29:36.616 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_original": 0, 2026-02-17T05:29:36.616 INFO:tasks.workunit.client.0.trial030.stdout: "omap_allocated": 26053, 2026-02-17T05:29:36.616 INFO:tasks.workunit.client.0.trial030.stdout: "internal_metadata": 83663419 2026-02-17T05:29:36.616 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.616 INFO:tasks.workunit.client.0.trial030.stdout: "hb_peers": [], 2026-02-17T05:29:36.616 INFO:tasks.workunit.client.0.trial030.stdout: "snap_trim_queue_len": 0, 2026-02-17T05:29:36.616 INFO:tasks.workunit.client.0.trial030.stdout: "num_snap_trimming": 0, 2026-02-17T05:29:36.616 INFO:tasks.workunit.client.0.trial030.stdout: "num_shards_repaired": 0, 2026-02-17T05:29:36.616 INFO:tasks.workunit.client.0.trial030.stdout: "op_queue_age_hist": { 2026-02-17T05:29:36.616 INFO:tasks.workunit.client.0.trial030.stdout: "histogram": [], 2026-02-17T05:29:36.616 INFO:tasks.workunit.client.0.trial030.stdout: "upper_bound": 1 2026-02-17T05:29:36.616 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.616 INFO:tasks.workunit.client.0.trial030.stdout: "perf_stat": { 2026-02-17T05:29:36.616 INFO:tasks.workunit.client.0.trial030.stdout: "commit_latency_ms": 0, 2026-02-17T05:29:36.616 INFO:tasks.workunit.client.0.trial030.stdout: "apply_latency_ms": 0, 2026-02-17T05:29:36.616 INFO:tasks.workunit.client.0.trial030.stdout: "commit_latency_ns": 0, 2026-02-17T05:29:36.616 INFO:tasks.workunit.client.0.trial030.stdout: "apply_latency_ns": 0 2026-02-17T05:29:36.616 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.616 INFO:tasks.workunit.client.0.trial030.stdout: "alerts": [], 2026-02-17T05:29:36.616 INFO:tasks.workunit.client.0.trial030.stdout: "network_ping_times": [] 2026-02-17T05:29:36.616 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:29:36.616 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.617 INFO:tasks.workunit.client.0.trial030.stdout: "pool_stats": [ 2026-02-17T05:29:36.617 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.617 INFO:tasks.workunit.client.0.trial030.stdout: "poolid": 1, 2026-02-17T05:29:36.617 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg": 1, 2026-02-17T05:29:36.617 INFO:tasks.workunit.client.0.trial030.stdout: "stat_sum": { 2026-02-17T05:29:36.617 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes": 51200, 2026-02-17T05:29:36.617 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects": 100, 2026-02-17T05:29:36.617 INFO:tasks.workunit.client.0.trial030.stdout: "num_object_clones": 0, 2026-02-17T05:29:36.617 INFO:tasks.workunit.client.0.trial030.stdout: "num_object_copies": 300, 2026-02-17T05:29:36.617 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T05:29:36.617 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_missing": 0, 2026-02-17T05:29:36.617 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_degraded": 100, 2026-02-17T05:29:36.617 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_misplaced": 0, 2026-02-17T05:29:36.617 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_unfound": 0, 2026-02-17T05:29:36.617 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_dirty": 100, 2026-02-17T05:29:36.617 INFO:tasks.workunit.client.0.trial030.stdout: "num_whiteouts": 0, 2026-02-17T05:29:36.617 INFO:tasks.workunit.client.0.trial030.stdout: "num_read": 0, 2026-02-17T05:29:36.617 INFO:tasks.workunit.client.0.trial030.stdout: "num_read_kb": 0, 2026-02-17T05:29:36.617 INFO:tasks.workunit.client.0.trial030.stdout: "num_write": 100, 2026-02-17T05:29:36.617 INFO:tasks.workunit.client.0.trial030.stdout: "num_write_kb": 100, 2026-02-17T05:29:36.617 INFO:tasks.workunit.client.0.trial030.stdout: "num_scrub_errors": 0, 2026-02-17T05:29:36.617 INFO:tasks.workunit.client.0.trial030.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T05:29:36.617 INFO:tasks.workunit.client.0.trial030.stdout: "num_deep_scrub_errors": 0, 2026-02-17T05:29:36.617 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_recovered": 0, 2026-02-17T05:29:36.617 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes_recovered": 0, 2026-02-17T05:29:36.617 INFO:tasks.workunit.client.0.trial030.stdout: "num_keys_recovered": 0, 2026-02-17T05:29:36.617 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_omap": 0, 2026-02-17T05:29:36.617 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T05:29:36.617 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T05:29:36.617 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush": 0, 2026-02-17T05:29:36.617 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_kb": 0, 2026-02-17T05:29:36.617 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict": 0, 2026-02-17T05:29:36.617 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_kb": 0, 2026-02-17T05:29:36.618 INFO:tasks.workunit.client.0.trial030.stdout: "num_promote": 0, 2026-02-17T05:29:36.618 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_mode_high": 0, 2026-02-17T05:29:36.618 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_mode_low": 0, 2026-02-17T05:29:36.618 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_mode_some": 0, 2026-02-17T05:29:36.618 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_mode_full": 0, 2026-02-17T05:29:36.618 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_pinned": 0, 2026-02-17T05:29:36.618 INFO:tasks.workunit.client.0.trial030.stdout: "num_legacy_snapsets": 0, 2026-02-17T05:29:36.618 INFO:tasks.workunit.client.0.trial030.stdout: "num_large_omap_objects": 0, 2026-02-17T05:29:36.618 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_manifest": 0, 2026-02-17T05:29:36.618 INFO:tasks.workunit.client.0.trial030.stdout: "num_omap_bytes": 0, 2026-02-17T05:29:36.618 INFO:tasks.workunit.client.0.trial030.stdout: "num_omap_keys": 0, 2026-02-17T05:29:36.618 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_repaired": 0 2026-02-17T05:29:36.618 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.618 INFO:tasks.workunit.client.0.trial030.stdout: "store_stats": { 2026-02-17T05:29:36.618 INFO:tasks.workunit.client.0.trial030.stdout: "total": 0, 2026-02-17T05:29:36.618 INFO:tasks.workunit.client.0.trial030.stdout: "available": 0, 2026-02-17T05:29:36.618 INFO:tasks.workunit.client.0.trial030.stdout: "internally_reserved": 0, 2026-02-17T05:29:36.618 INFO:tasks.workunit.client.0.trial030.stdout: "allocated": 1220608, 2026-02-17T05:29:36.618 INFO:tasks.workunit.client.0.trial030.stdout: "data_stored": 153552, 2026-02-17T05:29:36.618 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed": 0, 2026-02-17T05:29:36.618 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_allocated": 0, 2026-02-17T05:29:36.618 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_original": 0, 2026-02-17T05:29:36.618 INFO:tasks.workunit.client.0.trial030.stdout: "omap_allocated": 0, 2026-02-17T05:29:36.618 INFO:tasks.workunit.client.0.trial030.stdout: "internal_metadata": 0 2026-02-17T05:29:36.618 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.618 INFO:tasks.workunit.client.0.trial030.stdout: "log_size": 16, 2026-02-17T05:29:36.618 INFO:tasks.workunit.client.0.trial030.stdout: "ondisk_log_size": 16, 2026-02-17T05:29:36.618 INFO:tasks.workunit.client.0.trial030.stdout: "up": 2, 2026-02-17T05:29:36.618 INFO:tasks.workunit.client.0.trial030.stdout: "acting": 2, 2026-02-17T05:29:36.618 INFO:tasks.workunit.client.0.trial030.stdout: "num_store_stats": 3 2026-02-17T05:29:36.618 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:29:36.618 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:29:36.618 INFO:tasks.workunit.client.0.trial030.stdout: "osd_stats": [ 2026-02-17T05:29:36.618 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.619 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 0, 2026-02-17T05:29:36.619 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 150323855369 2026-02-17T05:29:36.619 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.619 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.619 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 1, 2026-02-17T05:29:36.619 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 38654705677 2026-02-17T05:29:36.619 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.619 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.619 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2, 2026-02-17T05:29:36.619 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 163208757257 2026-02-17T05:29:36.619 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:29:36.619 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:29:36.619 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg_by_state": [ 2026-02-17T05:29:36.619 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.619 INFO:tasks.workunit.client.0.trial030.stdout: "state": "active+undersized+degraded", 2026-02-17T05:29:36.619 INFO:tasks.workunit.client.0.trial030.stdout: "num": 1 2026-02-17T05:29:36.619 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:29:36.619 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:29:36.619 INFO:tasks.workunit.client.0.trial030.stdout: "pool_pg_unavailable_map": [ 2026-02-17T05:29:36.619 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.619 INFO:tasks.workunit.client.0.trial030.stdout: "poolid": "1", 2026-02-17T05:29:36.619 INFO:tasks.workunit.client.0.trial030.stdout: "pgs": [] 2026-02-17T05:29:36.619 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:29:36.619 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:29:36.619 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg_by_osd": [ 2026-02-17T05:29:36.619 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.619 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2, 2026-02-17T05:29:36.619 INFO:tasks.workunit.client.0.trial030.stdout: "num_primary_pg": 0, 2026-02-17T05:29:36.619 INFO:tasks.workunit.client.0.trial030.stdout: "num_acting_pg": 1, 2026-02-17T05:29:36.619 INFO:tasks.workunit.client.0.trial030.stdout: "num_up_not_acting_pg": 0 2026-02-17T05:29:36.619 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.619 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.619 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 0, 2026-02-17T05:29:36.619 INFO:tasks.workunit.client.0.trial030.stdout: "num_primary_pg": 1, 2026-02-17T05:29:36.619 INFO:tasks.workunit.client.0.trial030.stdout: "num_acting_pg": 1, 2026-02-17T05:29:36.620 INFO:tasks.workunit.client.0.trial030.stdout: "num_up_not_acting_pg": 0 2026-02-17T05:29:36.620 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.620 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.620 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 1, 2026-02-17T05:29:36.620 INFO:tasks.workunit.client.0.trial030.stdout: "num_primary_pg": 0, 2026-02-17T05:29:36.620 INFO:tasks.workunit.client.0.trial030.stdout: "num_acting_pg": 0, 2026-02-17T05:29:36.620 INFO:tasks.workunit.client.0.trial030.stdout: "num_up_not_acting_pg": 0 2026-02-17T05:29:36.620 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:29:36.620 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:29:36.620 INFO:tasks.workunit.client.0.trial030.stdout: "purged_snaps": [ 2026-02-17T05:29:36.620 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:29:36.620 INFO:tasks.workunit.client.0.trial030.stdout: "pool": 1, 2026-02-17T05:29:36.620 INFO:tasks.workunit.client.0.trial030.stdout: "purged_snaps": {} 2026-02-17T05:29:36.620 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:29:36.620 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:29:36.620 INFO:tasks.workunit.client.0.trial030.stdout: "servicemap": { 2026-02-17T05:29:36.620 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 3, 2026-02-17T05:29:36.620 INFO:tasks.workunit.client.0.trial030.stdout: "modified": "2026-02-17T05:29:31.922777+0000", 2026-02-17T05:29:36.620 INFO:tasks.workunit.client.0.trial030.stdout: "services": { 2026-02-17T05:29:36.620 INFO:tasks.workunit.client.0.trial030.stdout: "osd": { 2026-02-17T05:29:36.620 INFO:tasks.workunit.client.0.trial030.stdout: "daemons": { 2026-02-17T05:29:36.620 INFO:tasks.workunit.client.0.trial030.stdout: "summary": "", 2026-02-17T05:29:36.620 INFO:tasks.workunit.client.0.trial030.stdout: "0": { 2026-02-17T05:29:36.620 INFO:tasks.workunit.client.0.trial030.stdout: "start_epoch": 0, 2026-02-17T05:29:36.620 INFO:tasks.workunit.client.0.trial030.stdout: "start_stamp": "0.000000", 2026-02-17T05:29:36.620 INFO:tasks.workunit.client.0.trial030.stdout: "gid": 0, 2026-02-17T05:29:36.620 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-17T05:29:36.620 INFO:tasks.workunit.client.0.trial030.stdout: "metadata": {}, 2026-02-17T05:29:36.620 INFO:tasks.workunit.client.0.trial030.stdout: "task_status": {} 2026-02-17T05:29:36.620 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.620 INFO:tasks.workunit.client.0.trial030.stdout: "2": { 2026-02-17T05:29:36.620 INFO:tasks.workunit.client.0.trial030.stdout: "start_epoch": 0, 2026-02-17T05:29:36.620 INFO:tasks.workunit.client.0.trial030.stdout: "start_stamp": "0.000000", 2026-02-17T05:29:36.620 INFO:tasks.workunit.client.0.trial030.stdout: "gid": 0, 2026-02-17T05:29:36.620 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-17T05:29:36.620 INFO:tasks.workunit.client.0.trial030.stdout: "metadata": {}, 2026-02-17T05:29:36.620 INFO:tasks.workunit.client.0.trial030.stdout: "task_status": {} 2026-02-17T05:29:36.621 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:29:36.621 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:29:36.621 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:29:36.621 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:29:36.621 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:29:36.621 INFO:tasks.workunit.client.0.trial030.stdout: "mgrstat_first_committed": 1, 2026-02-17T05:29:36.621 INFO:tasks.workunit.client.0.trial030.stdout: "mgrstat_last_committed": 37, 2026-02-17T05:29:36.621 INFO:tasks.workunit.client.0.trial030.stdout: "logm_first_committed": 1, 2026-02-17T05:29:36.621 INFO:tasks.workunit.client.0.trial030.stdout: "logm_last_committed": 220, 2026-02-17T05:29:36.621 INFO:tasks.workunit.client.0.trial030.stdout: "paxos": { 2026-02-17T05:29:36.621 INFO:tasks.workunit.client.0.trial030.stdout: "first_committed": 1, 2026-02-17T05:29:36.621 INFO:tasks.workunit.client.0.trial030.stdout: "last_committed": 309, 2026-02-17T05:29:36.621 INFO:tasks.workunit.client.0.trial030.stdout: "last_pn": 0, 2026-02-17T05:29:36.621 INFO:tasks.workunit.client.0.trial030.stdout: "accepted_pn": 0 2026-02-17T05:29:36.621 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:29:36.621 INFO:tasks.workunit.client.0.trial030.stdout:} 2026-02-17T05:29:36.621 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-17T05:29:36.621 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:529: TEST_divergent_2: expr 2 + 2 2026-02-17T05:29:36.621 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:529: TEST_divergent_2: objname=existing_4 2026-02-17T05:29:36.621 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:530: TEST_divergent_2: echo 'writing non-divergent object existing_4' 2026-02-17T05:29:36.621 INFO:tasks.workunit.client.0.trial030.stdout:writing non-divergent object existing_4 2026-02-17T05:29:36.622 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:531: TEST_divergent_2: ceph pg dump pgs 2026-02-17T05:29:36.774 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T05:29:36.774 INFO:tasks.workunit.client.0.trial030.stdout:1.0 100 0 100 0 0 51200 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:29:06.914212+0000 28'100 41:130 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:28:35.475420+0000 0'0 2026-02-17T05:28:35.475420+0000 0 0 periodic scrub scheduled @ 2026-02-18T16:18:44.204529+0000 0 0 2026-02-17T05:29:36.774 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-17T05:29:36.774 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T05:29:36.775 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:29:36.783 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:532: TEST_divergent_2: rados -p test put existing_4 /tmp/tmp.3XecWzKabF 2026-02-17T05:29:36.813 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:533: TEST_divergent_2: rm -f /tmp/tmp.3XecWzKabF 2026-02-17T05:29:36.815 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:535: TEST_divergent_2: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-17T05:29:36.815 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:535: TEST_divergent_2: wait_for_clean 2026-02-17T05:29:36.815 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T05:29:36.815 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T05:29:36.815 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T05:29:36.816 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-17T05:29:36.816 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T05:29:36.816 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T05:29:36.817 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T05:29:36.817 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T05:29:36.817 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T05:29:36.888 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-17T05:29:36.888 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T05:29:36.888 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T05:29:36.888 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T05:29:36.888 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T05:29:36.888 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:29:37.111 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:29:37.111 INFO:tasks.workunit.client.0.trial030.stderr:1 2026-02-17T05:29:37.111 INFO:tasks.workunit.client.0.trial030.stderr:2' 2026-02-17T05:29:37.112 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:29:37.112 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:29:37.112 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T05:29:37.196 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855371 2026-02-17T05:29:37.196 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855371 2026-02-17T05:29:37.196 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855371' 2026-02-17T05:29:37.196 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:29:37.197 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T05:29:37.260 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-17T05:29:37.260 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: true 2026-02-17T05:29:37.260 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-17T05:29:37.260 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: continue 2026-02-17T05:29:37.261 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:29:37.261 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T05:29:37.345 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=163208757259 2026-02-17T05:29:37.345 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 163208757259 2026-02-17T05:29:37.345 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855371 2-163208757259' 2026-02-17T05:29:37.345 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:29:37.345 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-150323855371 2026-02-17T05:29:37.346 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:29:37.346 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:29:37.347 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-150323855371 2026-02-17T05:29:37.347 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:29:37.349 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=150323855371 2026-02-17T05:29:37.349 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.0 seq 150323855371 2026-02-17T05:29:37.349 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 150323855371' 2026-02-17T05:29:37.350 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:29:37.574 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855369 -lt 150323855371 2026-02-17T05:29:37.574 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:29:38.575 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T05:29:38.575 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:29:38.798 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855371 -lt 150323855371 2026-02-17T05:29:38.798 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:29:38.798 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-163208757259 2026-02-17T05:29:38.799 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:29:38.800 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:29:38.801 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-163208757259 2026-02-17T05:29:38.801 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:29:38.802 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=163208757259 2026-02-17T05:29:38.802 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.2 seq 163208757259 2026-02-17T05:29:38.803 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 163208757259' 2026-02-17T05:29:38.803 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:29:39.013 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 163208757259 -lt 163208757259 2026-02-17T05:29:39.014 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T05:29:39.014 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:29:39.015 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:29:39.308 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T05:29:39.309 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:29:39.309 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:29:39.309 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:29:39.309 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:29:39.309 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:29:39.309 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:29:39.309 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:29:39.539 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:29:39.539 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:29:39.539 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:29:39.539 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:29:39.836 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T05:29:39.836 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-17T05:29:39.836 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-17T05:29:39.836 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-17T05:29:39.837 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T05:29:39.837 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-17T05:29:39.937 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T05:29:39.938 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:29:39.938 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:29:39.938 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:29:39.938 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:29:39.938 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:29:39.938 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:29:39.938 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:29:40.157 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:29:40.158 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:29:40.158 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:29:40.158 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:29:40.450 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T05:29:40.450 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T05:29:40.450 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T05:29:40.450 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T05:29:40.450 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T05:29:40.450 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T05:29:40.450 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T05:29:40.450 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T05:29:40.451 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T05:29:40.735 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T05:29:40.735 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T05:29:40.736 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-17T05:29:40.736 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T05:29:40.736 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-17T05:29:40.936 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T05:29:40.936 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:29:40.937 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:29:40.937 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:29:40.937 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:29:40.937 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:29:40.938 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:29:40.938 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:29:41.155 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:29:41.156 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:29:41.156 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:29:41.156 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:29:41.450 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T05:29:41.451 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T05:29:41.451 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T05:29:41.451 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T05:29:41.451 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T05:29:41.451 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T05:29:41.451 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T05:29:41.451 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T05:29:41.451 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T05:29:41.745 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T05:29:41.746 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T05:29:41.746 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-17T05:29:41.746 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T05:29:41.746 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-17T05:29:42.146 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T05:29:42.146 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:29:42.147 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:29:42.147 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:29:42.147 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:29:42.147 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:29:42.147 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:29:42.147 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:29:42.381 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:29:42.382 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:29:42.382 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:29:42.382 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:29:42.681 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T05:29:42.681 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T05:29:42.681 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T05:29:42.682 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T05:29:42.682 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T05:29:42.682 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T05:29:42.682 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T05:29:42.682 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T05:29:42.682 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T05:29:42.972 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T05:29:42.973 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T05:29:42.973 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-17T05:29:42.973 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T05:29:42.973 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-17T05:29:43.773 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T05:29:43.773 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:29:43.774 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:29:43.774 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:29:43.775 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:29:43.775 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:29:43.775 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:29:43.775 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:29:43.994 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:29:43.995 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:29:43.996 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:29:43.996 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:29:44.285 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T05:29:44.285 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T05:29:44.285 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T05:29:44.285 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T05:29:44.286 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T05:29:44.286 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T05:29:44.286 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T05:29:44.286 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T05:29:44.286 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T05:29:44.572 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T05:29:44.572 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T05:29:44.572 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-17T05:29:44.572 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T05:29:44.572 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-17T05:29:46.173 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T05:29:46.173 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:29:46.174 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:29:46.174 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:29:46.174 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:29:46.174 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:29:46.174 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:29:46.174 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:29:46.382 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:29:46.382 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:29:46.383 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:29:46.383 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:29:46.674 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T05:29:46.674 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T05:29:46.674 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T05:29:46.674 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T05:29:46.674 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T05:29:46.674 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T05:29:46.675 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T05:29:46.675 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T05:29:46.675 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T05:29:46.976 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T05:29:46.976 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T05:29:46.977 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-17T05:29:46.977 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T05:29:46.977 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-17T05:29:50.177 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T05:29:50.178 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:29:50.178 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:29:50.178 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:29:50.178 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:29:50.178 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:29:50.178 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:29:50.178 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:29:50.389 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:29:50.389 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:29:50.389 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:29:50.390 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:29:50.671 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T05:29:50.671 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T05:29:50.671 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T05:29:50.671 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T05:29:50.671 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T05:29:50.671 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T05:29:50.671 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T05:29:50.671 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T05:29:50.671 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T05:29:50.974 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T05:29:50.974 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T05:29:50.974 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-17T05:29:50.974 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T05:29:50.975 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-17T05:29:57.374 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T05:29:57.375 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:29:57.376 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:29:57.376 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:29:57.376 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:29:57.376 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:29:57.376 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:29:57.376 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:29:57.591 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:29:57.592 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:29:57.592 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:29:57.592 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:29:57.876 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T05:29:57.876 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T05:29:57.877 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T05:29:57.877 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T05:29:57.877 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T05:29:57.877 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T05:29:57.877 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T05:29:57.878 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T05:29:57.878 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T05:29:58.167 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T05:29:58.167 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T05:29:58.167 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-17T05:29:58.167 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T05:29:58.167 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-17T05:30:05.469 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T05:30:05.469 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:30:05.470 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:30:05.470 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:30:05.470 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:30:05.470 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:30:05.471 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:30:05.471 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:30:05.683 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:30:05.683 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:30:05.684 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:30:05.684 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:30:05.975 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T05:30:05.975 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T05:30:05.975 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T05:30:05.975 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T05:30:05.975 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T05:30:05.975 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T05:30:05.975 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T05:30:05.975 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T05:30:05.975 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T05:30:06.265 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T05:30:06.266 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T05:30:06.266 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-17T05:30:06.266 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-17T05:30:06.540 INFO:tasks.workunit.client.0.trial030.stdout:{ 2026-02-17T05:30:06.540 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_fingerprint": "72fe2734-63a8-4933-a888-0eaa4f77a5dc", 2026-02-17T05:30:06.540 INFO:tasks.workunit.client.0.trial030.stdout: "version": "20.3.0-5271-g32585015", 2026-02-17T05:30:06.541 INFO:tasks.workunit.client.0.trial030.stdout: "commit": "325850157d309f65985eea9ec9bb9f1d56726fee", 2026-02-17T05:30:06.541 INFO:tasks.workunit.client.0.trial030.stdout: "timestamp": "2026-02-17T05:30:06.539298+0000", 2026-02-17T05:30:06.541 INFO:tasks.workunit.client.0.trial030.stdout: "tag": "", 2026-02-17T05:30:06.541 INFO:tasks.workunit.client.0.trial030.stdout: "health": { 2026-02-17T05:30:06.541 INFO:tasks.workunit.client.0.trial030.stdout: "status": "HEALTH_WARN", 2026-02-17T05:30:06.541 INFO:tasks.workunit.client.0.trial030.stdout: "checks": { 2026-02-17T05:30:06.541 INFO:tasks.workunit.client.0.trial030.stdout: "OSDMAP_FLAGS": { 2026-02-17T05:30:06.541 INFO:tasks.workunit.client.0.trial030.stdout: "severity": "HEALTH_WARN", 2026-02-17T05:30:06.541 INFO:tasks.workunit.client.0.trial030.stdout: "summary": { 2026-02-17T05:30:06.541 INFO:tasks.workunit.client.0.trial030.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-17T05:30:06.541 INFO:tasks.workunit.client.0.trial030.stdout: "count": 17 2026-02-17T05:30:06.542 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.542 INFO:tasks.workunit.client.0.trial030.stdout: "detail": [], 2026-02-17T05:30:06.542 INFO:tasks.workunit.client.0.trial030.stdout: "muted": false 2026-02-17T05:30:06.542 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.542 INFO:tasks.workunit.client.0.trial030.stdout: "OSD_DOWN": { 2026-02-17T05:30:06.542 INFO:tasks.workunit.client.0.trial030.stdout: "severity": "HEALTH_WARN", 2026-02-17T05:30:06.542 INFO:tasks.workunit.client.0.trial030.stdout: "summary": { 2026-02-17T05:30:06.542 INFO:tasks.workunit.client.0.trial030.stdout: "message": "1 osds down", 2026-02-17T05:30:06.542 INFO:tasks.workunit.client.0.trial030.stdout: "count": 1 2026-02-17T05:30:06.542 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.542 INFO:tasks.workunit.client.0.trial030.stdout: "detail": [ 2026-02-17T05:30:06.542 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.543 INFO:tasks.workunit.client.0.trial030.stdout: "message": "osd.1 (root=default,host=trial030) is down" 2026-02-17T05:30:06.543 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:30:06.543 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:30:06.543 INFO:tasks.workunit.client.0.trial030.stdout: "muted": false 2026-02-17T05:30:06.543 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.543 INFO:tasks.workunit.client.0.trial030.stdout: "PG_DEGRADED": { 2026-02-17T05:30:06.543 INFO:tasks.workunit.client.0.trial030.stdout: "severity": "HEALTH_WARN", 2026-02-17T05:30:06.543 INFO:tasks.workunit.client.0.trial030.stdout: "summary": { 2026-02-17T05:30:06.543 INFO:tasks.workunit.client.0.trial030.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 1 pg degraded", 2026-02-17T05:30:06.543 INFO:tasks.workunit.client.0.trial030.stdout: "count": 1 2026-02-17T05:30:06.543 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.543 INFO:tasks.workunit.client.0.trial030.stdout: "detail": [ 2026-02-17T05:30:06.544 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.544 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [0,2]" 2026-02-17T05:30:06.544 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:30:06.544 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:30:06.544 INFO:tasks.workunit.client.0.trial030.stdout: "muted": false 2026-02-17T05:30:06.544 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:30:06.544 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.544 INFO:tasks.workunit.client.0.trial030.stdout: "mutes": [] 2026-02-17T05:30:06.544 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.544 INFO:tasks.workunit.client.0.trial030.stdout: "monmap_first_committed": 1, 2026-02-17T05:30:06.544 INFO:tasks.workunit.client.0.trial030.stdout: "monmap_last_committed": 1, 2026-02-17T05:30:06.544 INFO:tasks.workunit.client.0.trial030.stdout: "monmap": { 2026-02-17T05:30:06.545 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 1, 2026-02-17T05:30:06.545 INFO:tasks.workunit.client.0.trial030.stdout: "fsid": "931b36d9-02d4-44f0-bc8b-c9190b7fdb00", 2026-02-17T05:30:06.545 INFO:tasks.workunit.client.0.trial030.stdout: "modified": "2026-02-17T05:28:23.410859Z", 2026-02-17T05:30:06.545 INFO:tasks.workunit.client.0.trial030.stdout: "created": "2026-02-17T05:28:23.410859Z", 2026-02-17T05:30:06.545 INFO:tasks.workunit.client.0.trial030.stdout: "min_mon_release": 20, 2026-02-17T05:30:06.545 INFO:tasks.workunit.client.0.trial030.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:30:06.545 INFO:tasks.workunit.client.0.trial030.stdout: "election_strategy": 1, 2026-02-17T05:30:06.545 INFO:tasks.workunit.client.0.trial030.stdout: "disallowed_leaders": "", 2026-02-17T05:30:06.545 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_mode": false, 2026-02-17T05:30:06.545 INFO:tasks.workunit.client.0.trial030.stdout: "tiebreaker_mon": "", 2026-02-17T05:30:06.546 INFO:tasks.workunit.client.0.trial030.stdout: "removed_ranks": "", 2026-02-17T05:30:06.546 INFO:tasks.workunit.client.0.trial030.stdout: "features": { 2026-02-17T05:30:06.546 INFO:tasks.workunit.client.0.trial030.stdout: "persistent": [ 2026-02-17T05:30:06.546 INFO:tasks.workunit.client.0.trial030.stdout: "kraken", 2026-02-17T05:30:06.546 INFO:tasks.workunit.client.0.trial030.stdout: "luminous", 2026-02-17T05:30:06.546 INFO:tasks.workunit.client.0.trial030.stdout: "mimic", 2026-02-17T05:30:06.546 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap-prune", 2026-02-17T05:30:06.546 INFO:tasks.workunit.client.0.trial030.stdout: "nautilus", 2026-02-17T05:30:06.546 INFO:tasks.workunit.client.0.trial030.stdout: "octopus", 2026-02-17T05:30:06.546 INFO:tasks.workunit.client.0.trial030.stdout: "pacific", 2026-02-17T05:30:06.546 INFO:tasks.workunit.client.0.trial030.stdout: "elector-pinging", 2026-02-17T05:30:06.546 INFO:tasks.workunit.client.0.trial030.stdout: "quincy", 2026-02-17T05:30:06.547 INFO:tasks.workunit.client.0.trial030.stdout: "reef", 2026-02-17T05:30:06.547 INFO:tasks.workunit.client.0.trial030.stdout: "squid", 2026-02-17T05:30:06.547 INFO:tasks.workunit.client.0.trial030.stdout: "tentacle", 2026-02-17T05:30:06.547 INFO:tasks.workunit.client.0.trial030.stdout: "nvmeof_beacon_diff" 2026-02-17T05:30:06.547 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:30:06.547 INFO:tasks.workunit.client.0.trial030.stdout: "optional": [] 2026-02-17T05:30:06.547 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.547 INFO:tasks.workunit.client.0.trial030.stdout: "mons": [ 2026-02-17T05:30:06.547 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.547 INFO:tasks.workunit.client.0.trial030.stdout: "rank": 0, 2026-02-17T05:30:06.547 INFO:tasks.workunit.client.0.trial030.stdout: "name": "a", 2026-02-17T05:30:06.547 INFO:tasks.workunit.client.0.trial030.stdout: "public_addrs": { 2026-02-17T05:30:06.548 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:30:06.548 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.548 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:30:06.548 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:7115", 2026-02-17T05:30:06.548 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 0 2026-02-17T05:30:06.548 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:30:06.548 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:30:06.548 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.548 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:7115/0", 2026-02-17T05:30:06.548 INFO:tasks.workunit.client.0.trial030.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-17T05:30:06.548 INFO:tasks.workunit.client.0.trial030.stdout: "priority": 0, 2026-02-17T05:30:06.548 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 0, 2026-02-17T05:30:06.548 INFO:tasks.workunit.client.0.trial030.stdout: "time_added": "2026-02-17T05:28:23:410856+0000", 2026-02-17T05:30:06.549 INFO:tasks.workunit.client.0.trial030.stdout: "crush_location": [] 2026-02-17T05:30:06.549 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:30:06.549 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:30:06.549 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.549 INFO:tasks.workunit.client.0.trial030.stdout: "quorum": [ 2026-02-17T05:30:06.549 INFO:tasks.workunit.client.0.trial030.stdout: 0 2026-02-17T05:30:06.549 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:30:06.549 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap": { 2026-02-17T05:30:06.549 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 41, 2026-02-17T05:30:06.549 INFO:tasks.workunit.client.0.trial030.stdout: "fsid": "931b36d9-02d4-44f0-bc8b-c9190b7fdb00", 2026-02-17T05:30:06.550 INFO:tasks.workunit.client.0.trial030.stdout: "created": "2026-02-17T05:28:23.487786+0000", 2026-02-17T05:30:06.550 INFO:tasks.workunit.client.0.trial030.stdout: "modified": "2026-02-17T05:29:06.911551+0000", 2026-02-17T05:30:06.550 INFO:tasks.workunit.client.0.trial030.stdout: "last_up_change": "2026-02-17T05:29:05.855901+0000", 2026-02-17T05:30:06.550 INFO:tasks.workunit.client.0.trial030.stdout: "last_in_change": "2026-02-17T05:29:06.809631+0000", 2026-02-17T05:30:06.550 INFO:tasks.workunit.client.0.trial030.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-17T05:30:06.550 INFO:tasks.workunit.client.0.trial030.stdout: "flags_num": 5800384, 2026-02-17T05:30:06.550 INFO:tasks.workunit.client.0.trial030.stdout: "flags_set": [ 2026-02-17T05:30:06.550 INFO:tasks.workunit.client.0.trial030.stdout: "nodown", 2026-02-17T05:30:06.550 INFO:tasks.workunit.client.0.trial030.stdout: "noin", 2026-02-17T05:30:06.550 INFO:tasks.workunit.client.0.trial030.stdout: "noout", 2026-02-17T05:30:06.550 INFO:tasks.workunit.client.0.trial030.stdout: "pglog_hardlimit", 2026-02-17T05:30:06.551 INFO:tasks.workunit.client.0.trial030.stdout: "purged_snapdirs", 2026-02-17T05:30:06.551 INFO:tasks.workunit.client.0.trial030.stdout: "recovery_deletes", 2026-02-17T05:30:06.551 INFO:tasks.workunit.client.0.trial030.stdout: "sortbitwise" 2026-02-17T05:30:06.551 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:30:06.551 INFO:tasks.workunit.client.0.trial030.stdout: "crush_version": 9, 2026-02-17T05:30:06.551 INFO:tasks.workunit.client.0.trial030.stdout: "full_ratio": 0.99000000953674316, 2026-02-17T05:30:06.551 INFO:tasks.workunit.client.0.trial030.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-17T05:30:06.551 INFO:tasks.workunit.client.0.trial030.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-17T05:30:06.551 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_snapshot": "", 2026-02-17T05:30:06.552 INFO:tasks.workunit.client.0.trial030.stdout: "pool_max": 1, 2026-02-17T05:30:06.552 INFO:tasks.workunit.client.0.trial030.stdout: "max_osd": 3, 2026-02-17T05:30:06.552 INFO:tasks.workunit.client.0.trial030.stdout: "require_min_compat_client": "luminous", 2026-02-17T05:30:06.552 INFO:tasks.workunit.client.0.trial030.stdout: "min_compat_client": "jewel", 2026-02-17T05:30:06.552 INFO:tasks.workunit.client.0.trial030.stdout: "require_osd_release": "tentacle", 2026-02-17T05:30:06.552 INFO:tasks.workunit.client.0.trial030.stdout: "allow_crimson": false, 2026-02-17T05:30:06.552 INFO:tasks.workunit.client.0.trial030.stdout: "pools": [ 2026-02-17T05:30:06.552 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.552 INFO:tasks.workunit.client.0.trial030.stdout: "pool": 1, 2026-02-17T05:30:06.552 INFO:tasks.workunit.client.0.trial030.stdout: "pool_name": "test", 2026-02-17T05:30:06.553 INFO:tasks.workunit.client.0.trial030.stdout: "create_time": "2026-02-17T05:28:35.450190+0000", 2026-02-17T05:30:06.553 INFO:tasks.workunit.client.0.trial030.stdout: "flags": 1, 2026-02-17T05:30:06.553 INFO:tasks.workunit.client.0.trial030.stdout: "flags_names": "hashpspool", 2026-02-17T05:30:06.553 INFO:tasks.workunit.client.0.trial030.stdout: "type": 1, 2026-02-17T05:30:06.553 INFO:tasks.workunit.client.0.trial030.stdout: "size": 3, 2026-02-17T05:30:06.553 INFO:tasks.workunit.client.0.trial030.stdout: "min_size": 2, 2026-02-17T05:30:06.553 INFO:tasks.workunit.client.0.trial030.stdout: "crush_rule": 0, 2026-02-17T05:30:06.553 INFO:tasks.workunit.client.0.trial030.stdout: "peering_crush_bucket_count": 0, 2026-02-17T05:30:06.553 INFO:tasks.workunit.client.0.trial030.stdout: "peering_crush_bucket_target": 0, 2026-02-17T05:30:06.553 INFO:tasks.workunit.client.0.trial030.stdout: "peering_crush_bucket_barrier": 0, 2026-02-17T05:30:06.553 INFO:tasks.workunit.client.0.trial030.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-17T05:30:06.553 INFO:tasks.workunit.client.0.trial030.stdout: "is_stretch_pool": false, 2026-02-17T05:30:06.553 INFO:tasks.workunit.client.0.trial030.stdout: "object_hash": 2, 2026-02-17T05:30:06.554 INFO:tasks.workunit.client.0.trial030.stdout: "pg_autoscale_mode": "off", 2026-02-17T05:30:06.554 INFO:tasks.workunit.client.0.trial030.stdout: "pg_num": 1, 2026-02-17T05:30:06.554 INFO:tasks.workunit.client.0.trial030.stdout: "pg_placement_num": 1, 2026-02-17T05:30:06.554 INFO:tasks.workunit.client.0.trial030.stdout: "pg_placement_num_target": 1, 2026-02-17T05:30:06.554 INFO:tasks.workunit.client.0.trial030.stdout: "pg_num_target": 1, 2026-02-17T05:30:06.554 INFO:tasks.workunit.client.0.trial030.stdout: "pg_num_pending": 1, 2026-02-17T05:30:06.554 INFO:tasks.workunit.client.0.trial030.stdout: "last_pg_merge_meta": { 2026-02-17T05:30:06.554 INFO:tasks.workunit.client.0.trial030.stdout: "source_pgid": "0.0", 2026-02-17T05:30:06.554 INFO:tasks.workunit.client.0.trial030.stdout: "ready_epoch": 0, 2026-02-17T05:30:06.554 INFO:tasks.workunit.client.0.trial030.stdout: "last_epoch_started": 0, 2026-02-17T05:30:06.554 INFO:tasks.workunit.client.0.trial030.stdout: "last_epoch_clean": 0, 2026-02-17T05:30:06.554 INFO:tasks.workunit.client.0.trial030.stdout: "source_version": "0'0", 2026-02-17T05:30:06.554 INFO:tasks.workunit.client.0.trial030.stdout: "target_version": "0'0" 2026-02-17T05:30:06.555 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.555 INFO:tasks.workunit.client.0.trial030.stdout: "last_change": "28", 2026-02-17T05:30:06.555 INFO:tasks.workunit.client.0.trial030.stdout: "last_force_op_resend": "0", 2026-02-17T05:30:06.555 INFO:tasks.workunit.client.0.trial030.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-17T05:30:06.555 INFO:tasks.workunit.client.0.trial030.stdout: "last_force_op_resend_preluminous": "0", 2026-02-17T05:30:06.555 INFO:tasks.workunit.client.0.trial030.stdout: "auid": 0, 2026-02-17T05:30:06.555 INFO:tasks.workunit.client.0.trial030.stdout: "snap_mode": "selfmanaged", 2026-02-17T05:30:06.555 INFO:tasks.workunit.client.0.trial030.stdout: "snap_seq": 0, 2026-02-17T05:30:06.555 INFO:tasks.workunit.client.0.trial030.stdout: "snap_epoch": 0, 2026-02-17T05:30:06.555 INFO:tasks.workunit.client.0.trial030.stdout: "pool_snaps": [], 2026-02-17T05:30:06.555 INFO:tasks.workunit.client.0.trial030.stdout: "removed_snaps": "[]", 2026-02-17T05:30:06.555 INFO:tasks.workunit.client.0.trial030.stdout: "quota_max_bytes": 0, 2026-02-17T05:30:06.556 INFO:tasks.workunit.client.0.trial030.stdout: "quota_max_objects": 0, 2026-02-17T05:30:06.556 INFO:tasks.workunit.client.0.trial030.stdout: "tiers": [], 2026-02-17T05:30:06.556 INFO:tasks.workunit.client.0.trial030.stdout: "tier_of": -1, 2026-02-17T05:30:06.556 INFO:tasks.workunit.client.0.trial030.stdout: "read_tier": -1, 2026-02-17T05:30:06.556 INFO:tasks.workunit.client.0.trial030.stdout: "write_tier": -1, 2026-02-17T05:30:06.556 INFO:tasks.workunit.client.0.trial030.stdout: "cache_mode": "none", 2026-02-17T05:30:06.556 INFO:tasks.workunit.client.0.trial030.stdout: "target_max_bytes": 0, 2026-02-17T05:30:06.556 INFO:tasks.workunit.client.0.trial030.stdout: "target_max_objects": 0, 2026-02-17T05:30:06.556 INFO:tasks.workunit.client.0.trial030.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-17T05:30:06.556 INFO:tasks.workunit.client.0.trial030.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-17T05:30:06.556 INFO:tasks.workunit.client.0.trial030.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-17T05:30:06.556 INFO:tasks.workunit.client.0.trial030.stdout: "cache_min_flush_age": 0, 2026-02-17T05:30:06.557 INFO:tasks.workunit.client.0.trial030.stdout: "cache_min_evict_age": 0, 2026-02-17T05:30:06.557 INFO:tasks.workunit.client.0.trial030.stdout: "erasure_code_profile": "", 2026-02-17T05:30:06.557 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_params": { 2026-02-17T05:30:06.557 INFO:tasks.workunit.client.0.trial030.stdout: "type": "none" 2026-02-17T05:30:06.557 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.557 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_period": 0, 2026-02-17T05:30:06.557 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_count": 0, 2026-02-17T05:30:06.557 INFO:tasks.workunit.client.0.trial030.stdout: "use_gmt_hitset": true, 2026-02-17T05:30:06.557 INFO:tasks.workunit.client.0.trial030.stdout: "min_read_recency_for_promote": 0, 2026-02-17T05:30:06.557 INFO:tasks.workunit.client.0.trial030.stdout: "min_write_recency_for_promote": 0, 2026-02-17T05:30:06.557 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_grade_decay_rate": 0, 2026-02-17T05:30:06.557 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_search_last_n": 0, 2026-02-17T05:30:06.558 INFO:tasks.workunit.client.0.trial030.stdout: "grade_table": [], 2026-02-17T05:30:06.558 INFO:tasks.workunit.client.0.trial030.stdout: "stripe_width": 0, 2026-02-17T05:30:06.558 INFO:tasks.workunit.client.0.trial030.stdout: "expected_num_objects": 0, 2026-02-17T05:30:06.558 INFO:tasks.workunit.client.0.trial030.stdout: "fast_read": false, 2026-02-17T05:30:06.558 INFO:tasks.workunit.client.0.trial030.stdout: "nonprimary_shards": "{}", 2026-02-17T05:30:06.558 INFO:tasks.workunit.client.0.trial030.stdout: "options": {}, 2026-02-17T05:30:06.558 INFO:tasks.workunit.client.0.trial030.stdout: "application_metadata": {}, 2026-02-17T05:30:06.558 INFO:tasks.workunit.client.0.trial030.stdout: "read_balance": { 2026-02-17T05:30:06.558 INFO:tasks.workunit.client.0.trial030.stdout: "score_type": "Fair distribution", 2026-02-17T05:30:06.558 INFO:tasks.workunit.client.0.trial030.stdout: "score_acting": 2.9900000095367432, 2026-02-17T05:30:06.558 INFO:tasks.workunit.client.0.trial030.stdout: "score_stable": 2.9900000095367432, 2026-02-17T05:30:06.559 INFO:tasks.workunit.client.0.trial030.stdout: "optimal_score": 0.67000001668930054, 2026-02-17T05:30:06.559 INFO:tasks.workunit.client.0.trial030.stdout: "raw_score_acting": 2, 2026-02-17T05:30:06.559 INFO:tasks.workunit.client.0.trial030.stdout: "raw_score_stable": 2, 2026-02-17T05:30:06.559 INFO:tasks.workunit.client.0.trial030.stdout: "primary_affinity_weighted": 1, 2026-02-17T05:30:06.559 INFO:tasks.workunit.client.0.trial030.stdout: "average_primary_affinity": 1, 2026-02-17T05:30:06.559 INFO:tasks.workunit.client.0.trial030.stdout: "average_primary_affinity_weighted": 1 2026-02-17T05:30:06.559 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:30:06.559 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:30:06.559 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:30:06.559 INFO:tasks.workunit.client.0.trial030.stdout: "osds": [ 2026-02-17T05:30:06.559 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.560 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 0, 2026-02-17T05:30:06.560 INFO:tasks.workunit.client.0.trial030.stdout: "uuid": "65554143-3837-4f4a-8373-1db6c1d20c59", 2026-02-17T05:30:06.560 INFO:tasks.workunit.client.0.trial030.stdout: "up": 1, 2026-02-17T05:30:06.560 INFO:tasks.workunit.client.0.trial030.stdout: "in": 1, 2026-02-17T05:30:06.560 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 1, 2026-02-17T05:30:06.560 INFO:tasks.workunit.client.0.trial030.stdout: "primary_affinity": 1, 2026-02-17T05:30:06.560 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_begin": 5, 2026-02-17T05:30:06.560 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_end": 28, 2026-02-17T05:30:06.560 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 35, 2026-02-17T05:30:06.560 INFO:tasks.workunit.client.0.trial030.stdout: "up_thru": 40, 2026-02-17T05:30:06.560 INFO:tasks.workunit.client.0.trial030.stdout: "down_at": 29, 2026-02-17T05:30:06.561 INFO:tasks.workunit.client.0.trial030.stdout: "lost_at": 0, 2026-02-17T05:30:06.561 INFO:tasks.workunit.client.0.trial030.stdout: "public_addrs": { 2026-02-17T05:30:06.561 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:30:06.561 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.561 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:30:06.561 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6800", 2026-02-17T05:30:06.561 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 4213725056 2026-02-17T05:30:06.561 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.561 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.562 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:30:06.562 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6801", 2026-02-17T05:30:06.562 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 4213725056 2026-02-17T05:30:06.562 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:30:06.562 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:30:06.562 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.562 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addrs": { 2026-02-17T05:30:06.562 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:30:06.562 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.562 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:30:06.562 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6802", 2026-02-17T05:30:06.562 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 4213725056 2026-02-17T05:30:06.562 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.563 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.563 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:30:06.563 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6803", 2026-02-17T05:30:06.563 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 4213725056 2026-02-17T05:30:06.563 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:30:06.563 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:30:06.563 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.563 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addrs": { 2026-02-17T05:30:06.563 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:30:06.563 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.563 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:30:06.563 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6806", 2026-02-17T05:30:06.564 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 4213725056 2026-02-17T05:30:06.564 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.564 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.564 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:30:06.564 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6807", 2026-02-17T05:30:06.564 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 4213725056 2026-02-17T05:30:06.564 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:30:06.564 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:30:06.564 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.564 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addrs": { 2026-02-17T05:30:06.564 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:30:06.564 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.565 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:30:06.565 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6804", 2026-02-17T05:30:06.565 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 4213725056 2026-02-17T05:30:06.565 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.565 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.565 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:30:06.565 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6805", 2026-02-17T05:30:06.565 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 4213725056 2026-02-17T05:30:06.565 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:30:06.565 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:30:06.565 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.565 INFO:tasks.workunit.client.0.trial030.stdout: "public_addr": "127.0.0.1:6801/4213725056", 2026-02-17T05:30:06.565 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addr": "127.0.0.1:6803/4213725056", 2026-02-17T05:30:06.565 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addr": "127.0.0.1:6807/4213725056", 2026-02-17T05:30:06.566 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addr": "127.0.0.1:6805/4213725056", 2026-02-17T05:30:06.566 INFO:tasks.workunit.client.0.trial030.stdout: "state": [ 2026-02-17T05:30:06.566 INFO:tasks.workunit.client.0.trial030.stdout: "exists", 2026-02-17T05:30:06.566 INFO:tasks.workunit.client.0.trial030.stdout: "up" 2026-02-17T05:30:06.566 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:30:06.566 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.566 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.566 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 1, 2026-02-17T05:30:06.566 INFO:tasks.workunit.client.0.trial030.stdout: "uuid": "1895d426-e99b-4201-96c2-911240090080", 2026-02-17T05:30:06.566 INFO:tasks.workunit.client.0.trial030.stdout: "up": 0, 2026-02-17T05:30:06.566 INFO:tasks.workunit.client.0.trial030.stdout: "in": 1, 2026-02-17T05:30:06.567 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 1, 2026-02-17T05:30:06.567 INFO:tasks.workunit.client.0.trial030.stdout: "primary_affinity": 1, 2026-02-17T05:30:06.567 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_begin": 0, 2026-02-17T05:30:06.567 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_end": 0, 2026-02-17T05:30:06.567 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 9, 2026-02-17T05:30:06.567 INFO:tasks.workunit.client.0.trial030.stdout: "up_thru": 22, 2026-02-17T05:30:06.567 INFO:tasks.workunit.client.0.trial030.stdout: "down_at": 30, 2026-02-17T05:30:06.567 INFO:tasks.workunit.client.0.trial030.stdout: "lost_at": 0, 2026-02-17T05:30:06.567 INFO:tasks.workunit.client.0.trial030.stdout: "public_addrs": { 2026-02-17T05:30:06.567 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:30:06.567 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.567 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:30:06.568 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6810", 2026-02-17T05:30:06.568 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 418378196 2026-02-17T05:30:06.568 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.568 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.568 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:30:06.568 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6811", 2026-02-17T05:30:06.568 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 418378196 2026-02-17T05:30:06.568 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:30:06.568 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:30:06.568 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.568 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addrs": { 2026-02-17T05:30:06.569 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:30:06.569 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.569 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:30:06.569 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6812", 2026-02-17T05:30:06.569 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 418378196 2026-02-17T05:30:06.569 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.569 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.569 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:30:06.569 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6813", 2026-02-17T05:30:06.569 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 418378196 2026-02-17T05:30:06.569 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:30:06.569 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:30:06.570 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.570 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addrs": { 2026-02-17T05:30:06.570 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:30:06.570 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.570 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:30:06.570 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6816", 2026-02-17T05:30:06.570 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 418378196 2026-02-17T05:30:06.570 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.570 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.570 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:30:06.570 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6817", 2026-02-17T05:30:06.570 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 418378196 2026-02-17T05:30:06.570 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:30:06.571 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:30:06.571 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.571 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addrs": { 2026-02-17T05:30:06.571 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:30:06.571 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.571 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:30:06.571 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6814", 2026-02-17T05:30:06.571 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 418378196 2026-02-17T05:30:06.571 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.571 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.571 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:30:06.572 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6815", 2026-02-17T05:30:06.572 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 418378196 2026-02-17T05:30:06.572 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:30:06.572 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:30:06.572 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.572 INFO:tasks.workunit.client.0.trial030.stdout: "public_addr": "127.0.0.1:6811/418378196", 2026-02-17T05:30:06.572 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addr": "127.0.0.1:6813/418378196", 2026-02-17T05:30:06.572 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addr": "127.0.0.1:6817/418378196", 2026-02-17T05:30:06.572 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addr": "127.0.0.1:6815/418378196", 2026-02-17T05:30:06.572 INFO:tasks.workunit.client.0.trial030.stdout: "state": [ 2026-02-17T05:30:06.573 INFO:tasks.workunit.client.0.trial030.stdout: "exists" 2026-02-17T05:30:06.573 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:30:06.573 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.573 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.573 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2, 2026-02-17T05:30:06.573 INFO:tasks.workunit.client.0.trial030.stdout: "uuid": "8578ec30-73af-421b-931c-481a868d1bde", 2026-02-17T05:30:06.573 INFO:tasks.workunit.client.0.trial030.stdout: "up": 1, 2026-02-17T05:30:06.573 INFO:tasks.workunit.client.0.trial030.stdout: "in": 1, 2026-02-17T05:30:06.573 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 1, 2026-02-17T05:30:06.573 INFO:tasks.workunit.client.0.trial030.stdout: "primary_affinity": 1, 2026-02-17T05:30:06.573 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_begin": 14, 2026-02-17T05:30:06.573 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_end": 28, 2026-02-17T05:30:06.574 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 38, 2026-02-17T05:30:06.574 INFO:tasks.workunit.client.0.trial030.stdout: "up_thru": 0, 2026-02-17T05:30:06.574 INFO:tasks.workunit.client.0.trial030.stdout: "down_at": 31, 2026-02-17T05:30:06.574 INFO:tasks.workunit.client.0.trial030.stdout: "lost_at": 0, 2026-02-17T05:30:06.574 INFO:tasks.workunit.client.0.trial030.stdout: "public_addrs": { 2026-02-17T05:30:06.574 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:30:06.574 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.574 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:30:06.574 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6810", 2026-02-17T05:30:06.574 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2612200958 2026-02-17T05:30:06.574 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.574 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.574 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:30:06.574 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6811", 2026-02-17T05:30:06.575 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2612200958 2026-02-17T05:30:06.575 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:30:06.575 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:30:06.575 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.575 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addrs": { 2026-02-17T05:30:06.575 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:30:06.575 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.575 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:30:06.575 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6812", 2026-02-17T05:30:06.575 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2612200958 2026-02-17T05:30:06.575 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.575 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.575 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:30:06.575 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6813", 2026-02-17T05:30:06.575 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2612200958 2026-02-17T05:30:06.576 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:30:06.576 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:30:06.576 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.576 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addrs": { 2026-02-17T05:30:06.576 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:30:06.576 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.576 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:30:06.576 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6816", 2026-02-17T05:30:06.576 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2612200958 2026-02-17T05:30:06.576 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.576 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.576 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:30:06.576 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6817", 2026-02-17T05:30:06.576 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2612200958 2026-02-17T05:30:06.576 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:30:06.577 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:30:06.577 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.577 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addrs": { 2026-02-17T05:30:06.577 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:30:06.577 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.577 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:30:06.577 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6814", 2026-02-17T05:30:06.577 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2612200958 2026-02-17T05:30:06.577 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.577 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.577 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:30:06.577 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6815", 2026-02-17T05:30:06.578 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2612200958 2026-02-17T05:30:06.578 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:30:06.578 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:30:06.578 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.578 INFO:tasks.workunit.client.0.trial030.stdout: "public_addr": "127.0.0.1:6811/2612200958", 2026-02-17T05:30:06.578 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addr": "127.0.0.1:6813/2612200958", 2026-02-17T05:30:06.578 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addr": "127.0.0.1:6817/2612200958", 2026-02-17T05:30:06.578 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addr": "127.0.0.1:6815/2612200958", 2026-02-17T05:30:06.578 INFO:tasks.workunit.client.0.trial030.stdout: "state": [ 2026-02-17T05:30:06.578 INFO:tasks.workunit.client.0.trial030.stdout: "exists", 2026-02-17T05:30:06.578 INFO:tasks.workunit.client.0.trial030.stdout: "up" 2026-02-17T05:30:06.578 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:30:06.578 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:30:06.578 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:30:06.579 INFO:tasks.workunit.client.0.trial030.stdout: "osd_xinfo": [ 2026-02-17T05:30:06.579 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.579 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 0, 2026-02-17T05:30:06.579 INFO:tasks.workunit.client.0.trial030.stdout: "down_stamp": "2026-02-17T05:29:01.527220+0000", 2026-02-17T05:30:06.579 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_probability": 0, 2026-02-17T05:30:06.579 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_interval": 0, 2026-02-17T05:30:06.579 INFO:tasks.workunit.client.0.trial030.stdout: "features": 4544132024016699391, 2026-02-17T05:30:06.579 INFO:tasks.workunit.client.0.trial030.stdout: "old_weight": 0, 2026-02-17T05:30:06.579 INFO:tasks.workunit.client.0.trial030.stdout: "last_purged_snaps_scrub": "2026-02-17T05:28:27.184949+0000", 2026-02-17T05:30:06.579 INFO:tasks.workunit.client.0.trial030.stdout: "dead_epoch": 0 2026-02-17T05:30:06.579 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.579 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.579 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 1, 2026-02-17T05:30:06.579 INFO:tasks.workunit.client.0.trial030.stdout: "down_stamp": "2026-02-17T05:29:01.832135+0000", 2026-02-17T05:30:06.580 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_probability": 0, 2026-02-17T05:30:06.580 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_interval": 0, 2026-02-17T05:30:06.580 INFO:tasks.workunit.client.0.trial030.stdout: "features": 4544132024016699391, 2026-02-17T05:30:06.580 INFO:tasks.workunit.client.0.trial030.stdout: "old_weight": 0, 2026-02-17T05:30:06.580 INFO:tasks.workunit.client.0.trial030.stdout: "last_purged_snaps_scrub": "2026-02-17T05:28:30.768834+0000", 2026-02-17T05:30:06.580 INFO:tasks.workunit.client.0.trial030.stdout: "dead_epoch": 0 2026-02-17T05:30:06.580 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.580 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.580 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2, 2026-02-17T05:30:06.580 INFO:tasks.workunit.client.0.trial030.stdout: "down_stamp": "2026-02-17T05:29:02.125677+0000", 2026-02-17T05:30:06.580 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_probability": 0, 2026-02-17T05:30:06.580 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_interval": 0, 2026-02-17T05:30:06.580 INFO:tasks.workunit.client.0.trial030.stdout: "features": 4544132024016699391, 2026-02-17T05:30:06.580 INFO:tasks.workunit.client.0.trial030.stdout: "old_weight": 0, 2026-02-17T05:30:06.580 INFO:tasks.workunit.client.0.trial030.stdout: "last_purged_snaps_scrub": "2026-02-17T05:28:34.681315+0000", 2026-02-17T05:30:06.581 INFO:tasks.workunit.client.0.trial030.stdout: "dead_epoch": 0 2026-02-17T05:30:06.581 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:30:06.581 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:30:06.581 INFO:tasks.workunit.client.0.trial030.stdout: "pg_upmap": [], 2026-02-17T05:30:06.581 INFO:tasks.workunit.client.0.trial030.stdout: "pg_upmap_items": [], 2026-02-17T05:30:06.581 INFO:tasks.workunit.client.0.trial030.stdout: "pg_upmap_primaries": [], 2026-02-17T05:30:06.581 INFO:tasks.workunit.client.0.trial030.stdout: "pg_temp": [], 2026-02-17T05:30:06.581 INFO:tasks.workunit.client.0.trial030.stdout: "primary_temp": [], 2026-02-17T05:30:06.581 INFO:tasks.workunit.client.0.trial030.stdout: "blocklist": {}, 2026-02-17T05:30:06.581 INFO:tasks.workunit.client.0.trial030.stdout: "range_blocklist": {}, 2026-02-17T05:30:06.581 INFO:tasks.workunit.client.0.trial030.stdout: "erasure_code_profiles": { 2026-02-17T05:30:06.581 INFO:tasks.workunit.client.0.trial030.stdout: "default": { 2026-02-17T05:30:06.581 INFO:tasks.workunit.client.0.trial030.stdout: "k": "2", 2026-02-17T05:30:06.581 INFO:tasks.workunit.client.0.trial030.stdout: "m": "2", 2026-02-17T05:30:06.581 INFO:tasks.workunit.client.0.trial030.stdout: "plugin": "isa", 2026-02-17T05:30:06.582 INFO:tasks.workunit.client.0.trial030.stdout: "technique": "reed_sol_van" 2026-02-17T05:30:06.582 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:30:06.582 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.582 INFO:tasks.workunit.client.0.trial030.stdout: "removed_snaps_queue": [], 2026-02-17T05:30:06.582 INFO:tasks.workunit.client.0.trial030.stdout: "new_removed_snaps": [], 2026-02-17T05:30:06.582 INFO:tasks.workunit.client.0.trial030.stdout: "new_purged_snaps": [], 2026-02-17T05:30:06.582 INFO:tasks.workunit.client.0.trial030.stdout: "crush_node_flags": {}, 2026-02-17T05:30:06.582 INFO:tasks.workunit.client.0.trial030.stdout: "device_class_flags": {}, 2026-02-17T05:30:06.582 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_mode": { 2026-02-17T05:30:06.582 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_mode_enabled": false, 2026-02-17T05:30:06.582 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_bucket_count": 0, 2026-02-17T05:30:06.582 INFO:tasks.workunit.client.0.trial030.stdout: "degraded_stretch_mode": 0, 2026-02-17T05:30:06.582 INFO:tasks.workunit.client.0.trial030.stdout: "recovering_stretch_mode": 0, 2026-02-17T05:30:06.582 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_mode_bucket": 0 2026-02-17T05:30:06.583 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:30:06.583 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.583 INFO:tasks.workunit.client.0.trial030.stdout: "osd_metadata": [ 2026-02-17T05:30:06.583 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.583 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-17T05:30:06.583 INFO:tasks.workunit.client.0.trial030.stdout: "arch": "x86_64", 2026-02-17T05:30:06.583 INFO:tasks.workunit.client.0.trial030.stdout: "back_addr": "[v2:127.0.0.1:6802/4213725056,v1:127.0.0.1:6803/4213725056]", 2026-02-17T05:30:06.583 INFO:tasks.workunit.client.0.trial030.stdout: "back_iface": "", 2026-02-17T05:30:06.583 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs": "1", 2026-02-17T05:30:06.583 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_db": "0", 2026-02-17T05:30:06.583 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T05:30:06.583 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_single_shared_device": "1", 2026-02-17T05:30:06.583 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T05:30:06.583 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocator": "hybrid", 2026-02-17T05:30:06.584 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T05:30:06.584 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T05:30:06.584 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T05:30:06.584 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T05:30:06.584 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T05:30:06.584 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-17T05:30:06.584 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T05:30:06.584 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T05:30:06.584 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T05:30:06.584 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T05:30:06.584 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-17T05:30:06.584 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T05:30:06.584 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T05:30:06.584 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_write_mode": "classic", 2026-02-17T05:30:06.584 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_release": "tentacle", 2026-02-17T05:30:06.584 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version": "ceph version 20.3.0-5271-g32585015 (325850157d309f65985eea9ec9bb9f1d56726fee) tentacle (dev - None)", 2026-02-17T05:30:06.584 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_short": "20.3.0-5271-g32585015", 2026-02-17T05:30:06.584 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_when_created": "ceph version 20.3.0-5271-g32585015 (325850157d309f65985eea9ec9bb9f1d56726fee) tentacle (dev - None)", 2026-02-17T05:30:06.584 INFO:tasks.workunit.client.0.trial030.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T05:30:06.585 INFO:tasks.workunit.client.0.trial030.stdout: "created_at": "2026-02-17T05:28:24.472114Z", 2026-02-17T05:30:06.585 INFO:tasks.workunit.client.0.trial030.stdout: "default_device_class": "ssd", 2026-02-17T05:30:06.585 INFO:tasks.workunit.client.0.trial030.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6B65", 2026-02-17T05:30:06.585 INFO:tasks.workunit.client.0.trial030.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T05:30:06.585 INFO:tasks.workunit.client.0.trial030.stdout: "devices": "nvme0n1", 2026-02-17T05:30:06.585 INFO:tasks.workunit.client.0.trial030.stdout: "distro": "ubuntu", 2026-02-17T05:30:06.585 INFO:tasks.workunit.client.0.trial030.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T05:30:06.585 INFO:tasks.workunit.client.0.trial030.stdout: "distro_version": "22.04", 2026-02-17T05:30:06.585 INFO:tasks.workunit.client.0.trial030.stdout: "front_addr": "[v2:127.0.0.1:6800/4213725056,v1:127.0.0.1:6801/4213725056]", 2026-02-17T05:30:06.585 INFO:tasks.workunit.client.0.trial030.stdout: "front_iface": "", 2026-02-17T05:30:06.585 INFO:tasks.workunit.client.0.trial030.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/4213725056,v1:127.0.0.1:6807/4213725056]", 2026-02-17T05:30:06.585 INFO:tasks.workunit.client.0.trial030.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/4213725056,v1:127.0.0.1:6805/4213725056]", 2026-02-17T05:30:06.585 INFO:tasks.workunit.client.0.trial030.stdout: "hostname": "trial030", 2026-02-17T05:30:06.585 INFO:tasks.workunit.client.0.trial030.stdout: "journal_rotational": "0", 2026-02-17T05:30:06.585 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T05:30:06.585 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T05:30:06.585 INFO:tasks.workunit.client.0.trial030.stdout: "mem_swap_kb": "8388604", 2026-02-17T05:30:06.586 INFO:tasks.workunit.client.0.trial030.stdout: "mem_total_kb": "130961692", 2026-02-17T05:30:06.586 INFO:tasks.workunit.client.0.trial030.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T05:30:06.586 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_node": "0", 2026-02-17T05:30:06.586 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_nodes": "0", 2026-02-17T05:30:06.586 INFO:tasks.workunit.client.0.trial030.stdout: "os": "Linux", 2026-02-17T05:30:06.586 INFO:tasks.workunit.client.0.trial030.stdout: "osd_data": "td/divergent-priors/0", 2026-02-17T05:30:06.586 INFO:tasks.workunit.client.0.trial030.stdout: "osd_objectstore": "bluestore", 2026-02-17T05:30:06.586 INFO:tasks.workunit.client.0.trial030.stdout: "osdspec_affinity": "", 2026-02-17T05:30:06.586 INFO:tasks.workunit.client.0.trial030.stdout: "rotational": "0" 2026-02-17T05:30:06.586 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.586 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.586 INFO:tasks.workunit.client.0.trial030.stdout: "id": 1, 2026-02-17T05:30:06.586 INFO:tasks.workunit.client.0.trial030.stdout: "arch": "x86_64", 2026-02-17T05:30:06.586 INFO:tasks.workunit.client.0.trial030.stdout: "back_addr": "[v2:127.0.0.1:6812/418378196,v1:127.0.0.1:6813/418378196]", 2026-02-17T05:30:06.586 INFO:tasks.workunit.client.0.trial030.stdout: "back_iface": "", 2026-02-17T05:30:06.586 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs": "1", 2026-02-17T05:30:06.586 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_db": "0", 2026-02-17T05:30:06.586 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T05:30:06.587 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_single_shared_device": "1", 2026-02-17T05:30:06.587 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T05:30:06.587 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocator": "hybrid", 2026-02-17T05:30:06.587 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T05:30:06.587 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T05:30:06.587 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T05:30:06.587 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T05:30:06.587 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T05:30:06.587 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-17T05:30:06.587 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T05:30:06.587 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T05:30:06.587 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T05:30:06.587 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T05:30:06.587 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-17T05:30:06.587 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T05:30:06.587 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T05:30:06.587 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_write_mode": "classic", 2026-02-17T05:30:06.587 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_release": "tentacle", 2026-02-17T05:30:06.588 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version": "ceph version 20.3.0-5271-g32585015 (325850157d309f65985eea9ec9bb9f1d56726fee) tentacle (dev - None)", 2026-02-17T05:30:06.588 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_short": "20.3.0-5271-g32585015", 2026-02-17T05:30:06.588 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_when_created": "ceph version 20.3.0-5271-g32585015 (325850157d309f65985eea9ec9bb9f1d56726fee) tentacle (dev - None)", 2026-02-17T05:30:06.588 INFO:tasks.workunit.client.0.trial030.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T05:30:06.588 INFO:tasks.workunit.client.0.trial030.stdout: "created_at": "2026-02-17T05:28:28.225769Z", 2026-02-17T05:30:06.588 INFO:tasks.workunit.client.0.trial030.stdout: "default_device_class": "ssd", 2026-02-17T05:30:06.588 INFO:tasks.workunit.client.0.trial030.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6B65", 2026-02-17T05:30:06.588 INFO:tasks.workunit.client.0.trial030.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T05:30:06.588 INFO:tasks.workunit.client.0.trial030.stdout: "devices": "nvme0n1", 2026-02-17T05:30:06.588 INFO:tasks.workunit.client.0.trial030.stdout: "distro": "ubuntu", 2026-02-17T05:30:06.588 INFO:tasks.workunit.client.0.trial030.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T05:30:06.588 INFO:tasks.workunit.client.0.trial030.stdout: "distro_version": "22.04", 2026-02-17T05:30:06.588 INFO:tasks.workunit.client.0.trial030.stdout: "front_addr": "[v2:127.0.0.1:6810/418378196,v1:127.0.0.1:6811/418378196]", 2026-02-17T05:30:06.588 INFO:tasks.workunit.client.0.trial030.stdout: "front_iface": "", 2026-02-17T05:30:06.588 INFO:tasks.workunit.client.0.trial030.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/418378196,v1:127.0.0.1:6817/418378196]", 2026-02-17T05:30:06.588 INFO:tasks.workunit.client.0.trial030.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/418378196,v1:127.0.0.1:6815/418378196]", 2026-02-17T05:30:06.588 INFO:tasks.workunit.client.0.trial030.stdout: "hostname": "trial030", 2026-02-17T05:30:06.588 INFO:tasks.workunit.client.0.trial030.stdout: "journal_rotational": "0", 2026-02-17T05:30:06.588 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T05:30:06.589 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T05:30:06.589 INFO:tasks.workunit.client.0.trial030.stdout: "mem_swap_kb": "8388604", 2026-02-17T05:30:06.589 INFO:tasks.workunit.client.0.trial030.stdout: "mem_total_kb": "130961692", 2026-02-17T05:30:06.589 INFO:tasks.workunit.client.0.trial030.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T05:30:06.589 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_node": "0", 2026-02-17T05:30:06.589 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_nodes": "0", 2026-02-17T05:30:06.589 INFO:tasks.workunit.client.0.trial030.stdout: "os": "Linux", 2026-02-17T05:30:06.589 INFO:tasks.workunit.client.0.trial030.stdout: "osd_data": "td/divergent-priors/1", 2026-02-17T05:30:06.589 INFO:tasks.workunit.client.0.trial030.stdout: "osd_objectstore": "bluestore", 2026-02-17T05:30:06.589 INFO:tasks.workunit.client.0.trial030.stdout: "osdspec_affinity": "", 2026-02-17T05:30:06.589 INFO:tasks.workunit.client.0.trial030.stdout: "rotational": "0" 2026-02-17T05:30:06.589 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.589 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.589 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-17T05:30:06.589 INFO:tasks.workunit.client.0.trial030.stdout: "arch": "x86_64", 2026-02-17T05:30:06.589 INFO:tasks.workunit.client.0.trial030.stdout: "back_addr": "[v2:127.0.0.1:6812/2612200958,v1:127.0.0.1:6813/2612200958]", 2026-02-17T05:30:06.589 INFO:tasks.workunit.client.0.trial030.stdout: "back_iface": "", 2026-02-17T05:30:06.589 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs": "1", 2026-02-17T05:30:06.589 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_db": "0", 2026-02-17T05:30:06.590 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T05:30:06.590 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_single_shared_device": "1", 2026-02-17T05:30:06.590 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T05:30:06.590 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocator": "hybrid", 2026-02-17T05:30:06.590 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T05:30:06.590 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T05:30:06.590 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T05:30:06.590 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T05:30:06.590 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T05:30:06.590 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-17T05:30:06.590 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T05:30:06.590 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T05:30:06.590 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T05:30:06.590 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T05:30:06.590 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-17T05:30:06.590 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T05:30:06.590 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T05:30:06.590 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_write_mode": "classic", 2026-02-17T05:30:06.591 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_release": "tentacle", 2026-02-17T05:30:06.591 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version": "ceph version 20.3.0-5271-g32585015 (325850157d309f65985eea9ec9bb9f1d56726fee) tentacle (dev - None)", 2026-02-17T05:30:06.591 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_short": "20.3.0-5271-g32585015", 2026-02-17T05:30:06.591 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_when_created": "ceph version 20.3.0-5271-g32585015 (325850157d309f65985eea9ec9bb9f1d56726fee) tentacle (dev - None)", 2026-02-17T05:30:06.591 INFO:tasks.workunit.client.0.trial030.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T05:30:06.591 INFO:tasks.workunit.client.0.trial030.stdout: "created_at": "2026-02-17T05:28:32.297604Z", 2026-02-17T05:30:06.591 INFO:tasks.workunit.client.0.trial030.stdout: "default_device_class": "ssd", 2026-02-17T05:30:06.591 INFO:tasks.workunit.client.0.trial030.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6B65", 2026-02-17T05:30:06.591 INFO:tasks.workunit.client.0.trial030.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T05:30:06.591 INFO:tasks.workunit.client.0.trial030.stdout: "devices": "nvme0n1", 2026-02-17T05:30:06.591 INFO:tasks.workunit.client.0.trial030.stdout: "distro": "ubuntu", 2026-02-17T05:30:06.591 INFO:tasks.workunit.client.0.trial030.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T05:30:06.591 INFO:tasks.workunit.client.0.trial030.stdout: "distro_version": "22.04", 2026-02-17T05:30:06.591 INFO:tasks.workunit.client.0.trial030.stdout: "front_addr": "[v2:127.0.0.1:6810/2612200958,v1:127.0.0.1:6811/2612200958]", 2026-02-17T05:30:06.591 INFO:tasks.workunit.client.0.trial030.stdout: "front_iface": "", 2026-02-17T05:30:06.591 INFO:tasks.workunit.client.0.trial030.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/2612200958,v1:127.0.0.1:6817/2612200958]", 2026-02-17T05:30:06.591 INFO:tasks.workunit.client.0.trial030.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/2612200958,v1:127.0.0.1:6815/2612200958]", 2026-02-17T05:30:06.591 INFO:tasks.workunit.client.0.trial030.stdout: "hostname": "trial030", 2026-02-17T05:30:06.591 INFO:tasks.workunit.client.0.trial030.stdout: "journal_rotational": "0", 2026-02-17T05:30:06.591 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T05:30:06.591 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T05:30:06.592 INFO:tasks.workunit.client.0.trial030.stdout: "mem_swap_kb": "8388604", 2026-02-17T05:30:06.592 INFO:tasks.workunit.client.0.trial030.stdout: "mem_total_kb": "130961692", 2026-02-17T05:30:06.592 INFO:tasks.workunit.client.0.trial030.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T05:30:06.592 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_node": "0", 2026-02-17T05:30:06.592 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_nodes": "0", 2026-02-17T05:30:06.592 INFO:tasks.workunit.client.0.trial030.stdout: "os": "Linux", 2026-02-17T05:30:06.592 INFO:tasks.workunit.client.0.trial030.stdout: "osd_data": "td/divergent-priors/2", 2026-02-17T05:30:06.592 INFO:tasks.workunit.client.0.trial030.stdout: "osd_objectstore": "bluestore", 2026-02-17T05:30:06.592 INFO:tasks.workunit.client.0.trial030.stdout: "osdspec_affinity": "", 2026-02-17T05:30:06.592 INFO:tasks.workunit.client.0.trial030.stdout: "rotational": "0" 2026-02-17T05:30:06.592 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:30:06.592 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:30:06.592 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap_clean_epochs": { 2026-02-17T05:30:06.592 INFO:tasks.workunit.client.0.trial030.stdout: "min_last_epoch_clean": 0, 2026-02-17T05:30:06.592 INFO:tasks.workunit.client.0.trial030.stdout: "last_epoch_clean": { 2026-02-17T05:30:06.592 INFO:tasks.workunit.client.0.trial030.stdout: "per_pool": [] 2026-02-17T05:30:06.592 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.592 INFO:tasks.workunit.client.0.trial030.stdout: "osd_epochs": [ 2026-02-17T05:30:06.592 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.592 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-17T05:30:06.592 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 35 2026-02-17T05:30:06.593 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.593 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.593 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-17T05:30:06.593 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 39 2026-02-17T05:30:06.593 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:30:06.593 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:30:06.593 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.593 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap_first_committed": 1, 2026-02-17T05:30:06.593 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap_last_committed": 41, 2026-02-17T05:30:06.593 INFO:tasks.workunit.client.0.trial030.stdout: "crushmap": { 2026-02-17T05:30:06.593 INFO:tasks.workunit.client.0.trial030.stdout: "devices": [ 2026-02-17T05:30:06.593 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.593 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-17T05:30:06.593 INFO:tasks.workunit.client.0.trial030.stdout: "name": "osd.0", 2026-02-17T05:30:06.593 INFO:tasks.workunit.client.0.trial030.stdout: "class": "ssd" 2026-02-17T05:30:06.593 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.593 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.594 INFO:tasks.workunit.client.0.trial030.stdout: "id": 1, 2026-02-17T05:30:06.594 INFO:tasks.workunit.client.0.trial030.stdout: "name": "osd.1", 2026-02-17T05:30:06.594 INFO:tasks.workunit.client.0.trial030.stdout: "class": "ssd" 2026-02-17T05:30:06.594 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.594 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.594 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-17T05:30:06.594 INFO:tasks.workunit.client.0.trial030.stdout: "name": "osd.2", 2026-02-17T05:30:06.594 INFO:tasks.workunit.client.0.trial030.stdout: "class": "ssd" 2026-02-17T05:30:06.594 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:30:06.594 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:30:06.594 INFO:tasks.workunit.client.0.trial030.stdout: "types": [ 2026-02-17T05:30:06.594 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.594 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 0, 2026-02-17T05:30:06.594 INFO:tasks.workunit.client.0.trial030.stdout: "name": "osd" 2026-02-17T05:30:06.594 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.594 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.594 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 1, 2026-02-17T05:30:06.594 INFO:tasks.workunit.client.0.trial030.stdout: "name": "host" 2026-02-17T05:30:06.594 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.594 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.595 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 2, 2026-02-17T05:30:06.595 INFO:tasks.workunit.client.0.trial030.stdout: "name": "chassis" 2026-02-17T05:30:06.595 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.595 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.595 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 3, 2026-02-17T05:30:06.595 INFO:tasks.workunit.client.0.trial030.stdout: "name": "rack" 2026-02-17T05:30:06.595 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.595 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.595 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 4, 2026-02-17T05:30:06.595 INFO:tasks.workunit.client.0.trial030.stdout: "name": "row" 2026-02-17T05:30:06.595 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.595 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.595 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 5, 2026-02-17T05:30:06.595 INFO:tasks.workunit.client.0.trial030.stdout: "name": "pdu" 2026-02-17T05:30:06.595 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.595 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.595 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 6, 2026-02-17T05:30:06.595 INFO:tasks.workunit.client.0.trial030.stdout: "name": "pod" 2026-02-17T05:30:06.595 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.595 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.595 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 7, 2026-02-17T05:30:06.595 INFO:tasks.workunit.client.0.trial030.stdout: "name": "room" 2026-02-17T05:30:06.596 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.596 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.596 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 8, 2026-02-17T05:30:06.596 INFO:tasks.workunit.client.0.trial030.stdout: "name": "datacenter" 2026-02-17T05:30:06.596 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.596 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.596 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 9, 2026-02-17T05:30:06.596 INFO:tasks.workunit.client.0.trial030.stdout: "name": "zone" 2026-02-17T05:30:06.596 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.596 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.596 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 10, 2026-02-17T05:30:06.596 INFO:tasks.workunit.client.0.trial030.stdout: "name": "region" 2026-02-17T05:30:06.596 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.596 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.596 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 11, 2026-02-17T05:30:06.596 INFO:tasks.workunit.client.0.trial030.stdout: "name": "root" 2026-02-17T05:30:06.596 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:30:06.596 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:30:06.596 INFO:tasks.workunit.client.0.trial030.stdout: "buckets": [ 2026-02-17T05:30:06.596 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.596 INFO:tasks.workunit.client.0.trial030.stdout: "id": -1, 2026-02-17T05:30:06.597 INFO:tasks.workunit.client.0.trial030.stdout: "name": "default", 2026-02-17T05:30:06.597 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 11, 2026-02-17T05:30:06.597 INFO:tasks.workunit.client.0.trial030.stdout: "type_name": "root", 2026-02-17T05:30:06.597 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-17T05:30:06.597 INFO:tasks.workunit.client.0.trial030.stdout: "alg": "straw2", 2026-02-17T05:30:06.597 INFO:tasks.workunit.client.0.trial030.stdout: "hash": "rjenkins1", 2026-02-17T05:30:06.597 INFO:tasks.workunit.client.0.trial030.stdout: "items": [ 2026-02-17T05:30:06.597 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.597 INFO:tasks.workunit.client.0.trial030.stdout: "id": -3, 2026-02-17T05:30:06.597 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-17T05:30:06.597 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 0 2026-02-17T05:30:06.597 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:30:06.597 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:30:06.597 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.597 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.597 INFO:tasks.workunit.client.0.trial030.stdout: "id": -2, 2026-02-17T05:30:06.597 INFO:tasks.workunit.client.0.trial030.stdout: "name": "default~ssd", 2026-02-17T05:30:06.597 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 11, 2026-02-17T05:30:06.597 INFO:tasks.workunit.client.0.trial030.stdout: "type_name": "root", 2026-02-17T05:30:06.597 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-17T05:30:06.597 INFO:tasks.workunit.client.0.trial030.stdout: "alg": "straw2", 2026-02-17T05:30:06.597 INFO:tasks.workunit.client.0.trial030.stdout: "hash": "rjenkins1", 2026-02-17T05:30:06.597 INFO:tasks.workunit.client.0.trial030.stdout: "items": [ 2026-02-17T05:30:06.598 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.598 INFO:tasks.workunit.client.0.trial030.stdout: "id": -4, 2026-02-17T05:30:06.598 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-17T05:30:06.598 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 0 2026-02-17T05:30:06.598 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:30:06.598 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:30:06.598 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.598 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.598 INFO:tasks.workunit.client.0.trial030.stdout: "id": -3, 2026-02-17T05:30:06.598 INFO:tasks.workunit.client.0.trial030.stdout: "name": "trial030", 2026-02-17T05:30:06.598 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 1, 2026-02-17T05:30:06.598 INFO:tasks.workunit.client.0.trial030.stdout: "type_name": "host", 2026-02-17T05:30:06.598 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-17T05:30:06.598 INFO:tasks.workunit.client.0.trial030.stdout: "alg": "straw2", 2026-02-17T05:30:06.598 INFO:tasks.workunit.client.0.trial030.stdout: "hash": "rjenkins1", 2026-02-17T05:30:06.598 INFO:tasks.workunit.client.0.trial030.stdout: "items": [ 2026-02-17T05:30:06.598 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.598 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-17T05:30:06.598 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-17T05:30:06.598 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 0 2026-02-17T05:30:06.598 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.598 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.598 INFO:tasks.workunit.client.0.trial030.stdout: "id": 1, 2026-02-17T05:30:06.599 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-17T05:30:06.599 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 1 2026-02-17T05:30:06.599 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.599 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.599 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-17T05:30:06.599 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-17T05:30:06.599 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 2 2026-02-17T05:30:06.599 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:30:06.599 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:30:06.599 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.599 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.599 INFO:tasks.workunit.client.0.trial030.stdout: "id": -4, 2026-02-17T05:30:06.599 INFO:tasks.workunit.client.0.trial030.stdout: "name": "trial030~ssd", 2026-02-17T05:30:06.599 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 1, 2026-02-17T05:30:06.599 INFO:tasks.workunit.client.0.trial030.stdout: "type_name": "host", 2026-02-17T05:30:06.599 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-17T05:30:06.599 INFO:tasks.workunit.client.0.trial030.stdout: "alg": "straw2", 2026-02-17T05:30:06.599 INFO:tasks.workunit.client.0.trial030.stdout: "hash": "rjenkins1", 2026-02-17T05:30:06.599 INFO:tasks.workunit.client.0.trial030.stdout: "items": [ 2026-02-17T05:30:06.599 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.599 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-17T05:30:06.599 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-17T05:30:06.600 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 0 2026-02-17T05:30:06.600 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.600 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.600 INFO:tasks.workunit.client.0.trial030.stdout: "id": 1, 2026-02-17T05:30:06.600 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-17T05:30:06.600 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 1 2026-02-17T05:30:06.600 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.600 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.600 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-17T05:30:06.600 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-17T05:30:06.600 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 2 2026-02-17T05:30:06.600 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:30:06.600 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:30:06.600 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:30:06.600 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:30:06.600 INFO:tasks.workunit.client.0.trial030.stdout: "rules": [ 2026-02-17T05:30:06.600 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.600 INFO:tasks.workunit.client.0.trial030.stdout: "rule_id": 0, 2026-02-17T05:30:06.600 INFO:tasks.workunit.client.0.trial030.stdout: "rule_name": "replicated_rule", 2026-02-17T05:30:06.600 INFO:tasks.workunit.client.0.trial030.stdout: "type": 1, 2026-02-17T05:30:06.600 INFO:tasks.workunit.client.0.trial030.stdout: "steps": [ 2026-02-17T05:30:06.600 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.600 INFO:tasks.workunit.client.0.trial030.stdout: "op": "take", 2026-02-17T05:30:06.601 INFO:tasks.workunit.client.0.trial030.stdout: "item": -1, 2026-02-17T05:30:06.601 INFO:tasks.workunit.client.0.trial030.stdout: "item_name": "default" 2026-02-17T05:30:06.601 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.601 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.601 INFO:tasks.workunit.client.0.trial030.stdout: "op": "choose_firstn", 2026-02-17T05:30:06.601 INFO:tasks.workunit.client.0.trial030.stdout: "num": 0, 2026-02-17T05:30:06.601 INFO:tasks.workunit.client.0.trial030.stdout: "type": "osd" 2026-02-17T05:30:06.601 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.601 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.601 INFO:tasks.workunit.client.0.trial030.stdout: "op": "emit" 2026-02-17T05:30:06.601 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:30:06.601 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:30:06.601 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:30:06.601 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:30:06.601 INFO:tasks.workunit.client.0.trial030.stdout: "tunables": { 2026-02-17T05:30:06.601 INFO:tasks.workunit.client.0.trial030.stdout: "choose_local_tries": 0, 2026-02-17T05:30:06.601 INFO:tasks.workunit.client.0.trial030.stdout: "choose_local_fallback_tries": 0, 2026-02-17T05:30:06.601 INFO:tasks.workunit.client.0.trial030.stdout: "choose_total_tries": 50, 2026-02-17T05:30:06.601 INFO:tasks.workunit.client.0.trial030.stdout: "chooseleaf_descend_once": 1, 2026-02-17T05:30:06.601 INFO:tasks.workunit.client.0.trial030.stdout: "chooseleaf_vary_r": 1, 2026-02-17T05:30:06.601 INFO:tasks.workunit.client.0.trial030.stdout: "chooseleaf_stable": 1, 2026-02-17T05:30:06.601 INFO:tasks.workunit.client.0.trial030.stdout: "msr_descents": 100, 2026-02-17T05:30:06.601 INFO:tasks.workunit.client.0.trial030.stdout: "msr_collision_tries": 100, 2026-02-17T05:30:06.602 INFO:tasks.workunit.client.0.trial030.stdout: "straw_calc_version": 1, 2026-02-17T05:30:06.602 INFO:tasks.workunit.client.0.trial030.stdout: "allowed_bucket_algs": 54, 2026-02-17T05:30:06.602 INFO:tasks.workunit.client.0.trial030.stderr:report 3750945020 2026-02-17T05:30:06.602 INFO:tasks.workunit.client.0.trial030.stdout: "profile": "jewel", 2026-02-17T05:30:06.602 INFO:tasks.workunit.client.0.trial030.stdout: "optimal_tunables": 1, 2026-02-17T05:30:06.602 INFO:tasks.workunit.client.0.trial030.stdout: "legacy_tunables": 0, 2026-02-17T05:30:06.602 INFO:tasks.workunit.client.0.trial030.stdout: "minimum_required_version": "jewel", 2026-02-17T05:30:06.602 INFO:tasks.workunit.client.0.trial030.stdout: "require_feature_tunables": 1, 2026-02-17T05:30:06.602 INFO:tasks.workunit.client.0.trial030.stdout: "require_feature_tunables2": 1, 2026-02-17T05:30:06.603 INFO:tasks.workunit.client.0.trial030.stdout: "has_v2_rules": 0, 2026-02-17T05:30:06.603 INFO:tasks.workunit.client.0.trial030.stdout: "require_feature_tunables3": 1, 2026-02-17T05:30:06.603 INFO:tasks.workunit.client.0.trial030.stdout: "has_v3_rules": 0, 2026-02-17T05:30:06.603 INFO:tasks.workunit.client.0.trial030.stdout: "has_v4_buckets": 1, 2026-02-17T05:30:06.603 INFO:tasks.workunit.client.0.trial030.stdout: "require_feature_tunables5": 1, 2026-02-17T05:30:06.603 INFO:tasks.workunit.client.0.trial030.stdout: "has_v5_rules": 0, 2026-02-17T05:30:06.603 INFO:tasks.workunit.client.0.trial030.stdout: "has_msr_rules": 0 2026-02-17T05:30:06.603 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.603 INFO:tasks.workunit.client.0.trial030.stdout: "choose_args": {} 2026-02-17T05:30:06.603 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.603 INFO:tasks.workunit.client.0.trial030.stdout: "fsmap": { 2026-02-17T05:30:06.603 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 1, 2026-02-17T05:30:06.603 INFO:tasks.workunit.client.0.trial030.stdout: "btime": "2026-02-17T05:28:23:487550+0000", 2026-02-17T05:30:06.603 INFO:tasks.workunit.client.0.trial030.stdout: "default_fscid": -1, 2026-02-17T05:30:06.603 INFO:tasks.workunit.client.0.trial030.stdout: "compat": { 2026-02-17T05:30:06.603 INFO:tasks.workunit.client.0.trial030.stdout: "compat": {}, 2026-02-17T05:30:06.603 INFO:tasks.workunit.client.0.trial030.stdout: "ro_compat": {}, 2026-02-17T05:30:06.603 INFO:tasks.workunit.client.0.trial030.stdout: "incompat": { 2026-02-17T05:30:06.603 INFO:tasks.workunit.client.0.trial030.stdout: "feature_1": "base v0.20", 2026-02-17T05:30:06.603 INFO:tasks.workunit.client.0.trial030.stdout: "feature_2": "client writeable ranges", 2026-02-17T05:30:06.603 INFO:tasks.workunit.client.0.trial030.stdout: "feature_3": "default file layouts on dirs", 2026-02-17T05:30:06.603 INFO:tasks.workunit.client.0.trial030.stdout: "feature_4": "dir inode in separate object", 2026-02-17T05:30:06.604 INFO:tasks.workunit.client.0.trial030.stdout: "feature_5": "mds uses versioned encoding", 2026-02-17T05:30:06.604 INFO:tasks.workunit.client.0.trial030.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-17T05:30:06.604 INFO:tasks.workunit.client.0.trial030.stdout: "feature_8": "no anchor table", 2026-02-17T05:30:06.604 INFO:tasks.workunit.client.0.trial030.stdout: "feature_9": "file layout v2", 2026-02-17T05:30:06.604 INFO:tasks.workunit.client.0.trial030.stdout: "feature_10": "snaprealm v2", 2026-02-17T05:30:06.604 INFO:tasks.workunit.client.0.trial030.stdout: "feature_11": "minor log segments", 2026-02-17T05:30:06.604 INFO:tasks.workunit.client.0.trial030.stdout: "feature_12": "quiesce subvolumes" 2026-02-17T05:30:06.604 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:30:06.604 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.604 INFO:tasks.workunit.client.0.trial030.stdout: "feature_flags": { 2026-02-17T05:30:06.604 INFO:tasks.workunit.client.0.trial030.stdout: "enable_multiple": true, 2026-02-17T05:30:06.604 INFO:tasks.workunit.client.0.trial030.stdout: "ever_enabled_multiple": true 2026-02-17T05:30:06.604 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.604 INFO:tasks.workunit.client.0.trial030.stdout: "standbys": [], 2026-02-17T05:30:06.604 INFO:tasks.workunit.client.0.trial030.stdout: "filesystems": [] 2026-02-17T05:30:06.604 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.604 INFO:tasks.workunit.client.0.trial030.stdout: "mdsmap_first_committed": 1, 2026-02-17T05:30:06.604 INFO:tasks.workunit.client.0.trial030.stdout: "mdsmap_last_committed": 1, 2026-02-17T05:30:06.604 INFO:tasks.workunit.client.0.trial030.stdout: "auth": { 2026-02-17T05:30:06.604 INFO:tasks.workunit.client.0.trial030.stdout: "first_committed": 1, 2026-02-17T05:30:06.604 INFO:tasks.workunit.client.0.trial030.stdout: "last_committed": 5, 2026-02-17T05:30:06.604 INFO:tasks.workunit.client.0.trial030.stdout: "num_secrets": 3 2026-02-17T05:30:06.604 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.604 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg": 1, 2026-02-17T05:30:06.604 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg_active": 1, 2026-02-17T05:30:06.605 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg_unknown": 0, 2026-02-17T05:30:06.605 INFO:tasks.workunit.client.0.trial030.stdout: "num_osd": 3, 2026-02-17T05:30:06.605 INFO:tasks.workunit.client.0.trial030.stdout: "pool_sum": { 2026-02-17T05:30:06.605 INFO:tasks.workunit.client.0.trial030.stdout: "stat_sum": { 2026-02-17T05:30:06.605 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes": 51688, 2026-02-17T05:30:06.605 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects": 100, 2026-02-17T05:30:06.605 INFO:tasks.workunit.client.0.trial030.stdout: "num_object_clones": 0, 2026-02-17T05:30:06.605 INFO:tasks.workunit.client.0.trial030.stdout: "num_object_copies": 300, 2026-02-17T05:30:06.605 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T05:30:06.605 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_missing": 0, 2026-02-17T05:30:06.605 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_degraded": 100, 2026-02-17T05:30:06.605 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_misplaced": 0, 2026-02-17T05:30:06.605 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_unfound": 0, 2026-02-17T05:30:06.605 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_dirty": 100, 2026-02-17T05:30:06.605 INFO:tasks.workunit.client.0.trial030.stdout: "num_whiteouts": 0, 2026-02-17T05:30:06.605 INFO:tasks.workunit.client.0.trial030.stdout: "num_read": 0, 2026-02-17T05:30:06.605 INFO:tasks.workunit.client.0.trial030.stdout: "num_read_kb": 0, 2026-02-17T05:30:06.605 INFO:tasks.workunit.client.0.trial030.stdout: "num_write": 101, 2026-02-17T05:30:06.605 INFO:tasks.workunit.client.0.trial030.stdout: "num_write_kb": 101, 2026-02-17T05:30:06.605 INFO:tasks.workunit.client.0.trial030.stdout: "num_scrub_errors": 0, 2026-02-17T05:30:06.605 INFO:tasks.workunit.client.0.trial030.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T05:30:06.605 INFO:tasks.workunit.client.0.trial030.stdout: "num_deep_scrub_errors": 0, 2026-02-17T05:30:06.605 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_recovered": 0, 2026-02-17T05:30:06.605 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes_recovered": 0, 2026-02-17T05:30:06.605 INFO:tasks.workunit.client.0.trial030.stdout: "num_keys_recovered": 0, 2026-02-17T05:30:06.605 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_omap": 0, 2026-02-17T05:30:06.606 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T05:30:06.606 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T05:30:06.606 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush": 0, 2026-02-17T05:30:06.606 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_kb": 0, 2026-02-17T05:30:06.606 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict": 0, 2026-02-17T05:30:06.606 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_kb": 0, 2026-02-17T05:30:06.606 INFO:tasks.workunit.client.0.trial030.stdout: "num_promote": 0, 2026-02-17T05:30:06.606 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_mode_high": 0, 2026-02-17T05:30:06.606 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_mode_low": 0, 2026-02-17T05:30:06.606 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_mode_some": 0, 2026-02-17T05:30:06.606 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_mode_full": 0, 2026-02-17T05:30:06.606 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_pinned": 0, 2026-02-17T05:30:06.606 INFO:tasks.workunit.client.0.trial030.stdout: "num_legacy_snapsets": 0, 2026-02-17T05:30:06.606 INFO:tasks.workunit.client.0.trial030.stdout: "num_large_omap_objects": 0, 2026-02-17T05:30:06.606 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_manifest": 0, 2026-02-17T05:30:06.606 INFO:tasks.workunit.client.0.trial030.stdout: "num_omap_bytes": 0, 2026-02-17T05:30:06.606 INFO:tasks.workunit.client.0.trial030.stdout: "num_omap_keys": 0, 2026-02-17T05:30:06.606 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_repaired": 0 2026-02-17T05:30:06.606 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.606 INFO:tasks.workunit.client.0.trial030.stdout: "store_stats": { 2026-02-17T05:30:06.606 INFO:tasks.workunit.client.0.trial030.stdout: "total": 0, 2026-02-17T05:30:06.606 INFO:tasks.workunit.client.0.trial030.stdout: "available": 0, 2026-02-17T05:30:06.606 INFO:tasks.workunit.client.0.trial030.stdout: "internally_reserved": 0, 2026-02-17T05:30:06.606 INFO:tasks.workunit.client.0.trial030.stdout: "allocated": 0, 2026-02-17T05:30:06.606 INFO:tasks.workunit.client.0.trial030.stdout: "data_stored": 0, 2026-02-17T05:30:06.606 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed": 0, 2026-02-17T05:30:06.606 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_allocated": 0, 2026-02-17T05:30:06.607 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_original": 0, 2026-02-17T05:30:06.607 INFO:tasks.workunit.client.0.trial030.stdout: "omap_allocated": 0, 2026-02-17T05:30:06.607 INFO:tasks.workunit.client.0.trial030.stdout: "internal_metadata": 0 2026-02-17T05:30:06.607 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.607 INFO:tasks.workunit.client.0.trial030.stdout: "log_size": 17, 2026-02-17T05:30:06.607 INFO:tasks.workunit.client.0.trial030.stdout: "ondisk_log_size": 17, 2026-02-17T05:30:06.607 INFO:tasks.workunit.client.0.trial030.stdout: "up": 2, 2026-02-17T05:30:06.607 INFO:tasks.workunit.client.0.trial030.stdout: "acting": 2, 2026-02-17T05:30:06.607 INFO:tasks.workunit.client.0.trial030.stdout: "num_store_stats": 0 2026-02-17T05:30:06.607 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.607 INFO:tasks.workunit.client.0.trial030.stdout: "osd_sum": { 2026-02-17T05:30:06.607 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 0, 2026-02-17T05:30:06.607 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 0, 2026-02-17T05:30:06.607 INFO:tasks.workunit.client.0.trial030.stdout: "num_pgs": 3, 2026-02-17T05:30:06.607 INFO:tasks.workunit.client.0.trial030.stdout: "num_osds": 3, 2026-02-17T05:30:06.607 INFO:tasks.workunit.client.0.trial030.stdout: "num_per_pool_osds": 3, 2026-02-17T05:30:06.607 INFO:tasks.workunit.client.0.trial030.stdout: "num_per_pool_omap_osds": 3, 2026-02-17T05:30:06.607 INFO:tasks.workunit.client.0.trial030.stdout: "kb": 314572800, 2026-02-17T05:30:06.607 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used": 83880, 2026-02-17T05:30:06.607 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_data": 2096, 2026-02-17T05:30:06.607 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_omap": 25, 2026-02-17T05:30:06.607 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_meta": 81702, 2026-02-17T05:30:06.607 INFO:tasks.workunit.client.0.trial030.stdout: "kb_avail": 314488920, 2026-02-17T05:30:06.607 INFO:tasks.workunit.client.0.trial030.stdout: "statfs": { 2026-02-17T05:30:06.607 INFO:tasks.workunit.client.0.trial030.stdout: "total": 322122547200, 2026-02-17T05:30:06.607 INFO:tasks.workunit.client.0.trial030.stdout: "available": 322036654080, 2026-02-17T05:30:06.607 INFO:tasks.workunit.client.0.trial030.stdout: "internally_reserved": 0, 2026-02-17T05:30:06.607 INFO:tasks.workunit.client.0.trial030.stdout: "allocated": 2146304, 2026-02-17T05:30:06.608 INFO:tasks.workunit.client.0.trial030.stdout: "data_stored": 429792, 2026-02-17T05:30:06.608 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed": 0, 2026-02-17T05:30:06.608 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_allocated": 0, 2026-02-17T05:30:06.608 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_original": 0, 2026-02-17T05:30:06.608 INFO:tasks.workunit.client.0.trial030.stdout: "omap_allocated": 26053, 2026-02-17T05:30:06.608 INFO:tasks.workunit.client.0.trial030.stdout: "internal_metadata": 83663419 2026-02-17T05:30:06.608 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.608 INFO:tasks.workunit.client.0.trial030.stdout: "hb_peers": [], 2026-02-17T05:30:06.608 INFO:tasks.workunit.client.0.trial030.stdout: "snap_trim_queue_len": 0, 2026-02-17T05:30:06.608 INFO:tasks.workunit.client.0.trial030.stdout: "num_snap_trimming": 0, 2026-02-17T05:30:06.608 INFO:tasks.workunit.client.0.trial030.stdout: "num_shards_repaired": 0, 2026-02-17T05:30:06.608 INFO:tasks.workunit.client.0.trial030.stdout: "op_queue_age_hist": { 2026-02-17T05:30:06.608 INFO:tasks.workunit.client.0.trial030.stdout: "histogram": [], 2026-02-17T05:30:06.608 INFO:tasks.workunit.client.0.trial030.stdout: "upper_bound": 1 2026-02-17T05:30:06.608 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.608 INFO:tasks.workunit.client.0.trial030.stdout: "perf_stat": { 2026-02-17T05:30:06.608 INFO:tasks.workunit.client.0.trial030.stdout: "commit_latency_ms": 0, 2026-02-17T05:30:06.608 INFO:tasks.workunit.client.0.trial030.stdout: "apply_latency_ms": 0, 2026-02-17T05:30:06.608 INFO:tasks.workunit.client.0.trial030.stdout: "commit_latency_ns": 0, 2026-02-17T05:30:06.608 INFO:tasks.workunit.client.0.trial030.stdout: "apply_latency_ns": 0 2026-02-17T05:30:06.608 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.608 INFO:tasks.workunit.client.0.trial030.stdout: "alerts": [], 2026-02-17T05:30:06.608 INFO:tasks.workunit.client.0.trial030.stdout: "network_ping_times": [] 2026-02-17T05:30:06.608 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.608 INFO:tasks.workunit.client.0.trial030.stdout: "osd_sum_by_class": { 2026-02-17T05:30:06.608 INFO:tasks.workunit.client.0.trial030.stdout: "ssd": { 2026-02-17T05:30:06.608 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 0, 2026-02-17T05:30:06.608 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 0, 2026-02-17T05:30:06.609 INFO:tasks.workunit.client.0.trial030.stdout: "num_pgs": 3, 2026-02-17T05:30:06.609 INFO:tasks.workunit.client.0.trial030.stdout: "num_osds": 3, 2026-02-17T05:30:06.609 INFO:tasks.workunit.client.0.trial030.stdout: "num_per_pool_osds": 3, 2026-02-17T05:30:06.609 INFO:tasks.workunit.client.0.trial030.stdout: "num_per_pool_omap_osds": 3, 2026-02-17T05:30:06.609 INFO:tasks.workunit.client.0.trial030.stdout: "kb": 314572800, 2026-02-17T05:30:06.609 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used": 83880, 2026-02-17T05:30:06.609 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_data": 2096, 2026-02-17T05:30:06.609 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_omap": 25, 2026-02-17T05:30:06.609 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_meta": 81702, 2026-02-17T05:30:06.609 INFO:tasks.workunit.client.0.trial030.stdout: "kb_avail": 314488920, 2026-02-17T05:30:06.609 INFO:tasks.workunit.client.0.trial030.stdout: "statfs": { 2026-02-17T05:30:06.609 INFO:tasks.workunit.client.0.trial030.stdout: "total": 322122547200, 2026-02-17T05:30:06.609 INFO:tasks.workunit.client.0.trial030.stdout: "available": 322036654080, 2026-02-17T05:30:06.609 INFO:tasks.workunit.client.0.trial030.stdout: "internally_reserved": 0, 2026-02-17T05:30:06.609 INFO:tasks.workunit.client.0.trial030.stdout: "allocated": 2146304, 2026-02-17T05:30:06.609 INFO:tasks.workunit.client.0.trial030.stdout: "data_stored": 429792, 2026-02-17T05:30:06.609 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed": 0, 2026-02-17T05:30:06.609 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_allocated": 0, 2026-02-17T05:30:06.609 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_original": 0, 2026-02-17T05:30:06.609 INFO:tasks.workunit.client.0.trial030.stdout: "omap_allocated": 26053, 2026-02-17T05:30:06.609 INFO:tasks.workunit.client.0.trial030.stdout: "internal_metadata": 83663419 2026-02-17T05:30:06.609 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.609 INFO:tasks.workunit.client.0.trial030.stdout: "hb_peers": [], 2026-02-17T05:30:06.609 INFO:tasks.workunit.client.0.trial030.stdout: "snap_trim_queue_len": 0, 2026-02-17T05:30:06.609 INFO:tasks.workunit.client.0.trial030.stdout: "num_snap_trimming": 0, 2026-02-17T05:30:06.609 INFO:tasks.workunit.client.0.trial030.stdout: "num_shards_repaired": 0, 2026-02-17T05:30:06.609 INFO:tasks.workunit.client.0.trial030.stdout: "op_queue_age_hist": { 2026-02-17T05:30:06.609 INFO:tasks.workunit.client.0.trial030.stdout: "histogram": [], 2026-02-17T05:30:06.609 INFO:tasks.workunit.client.0.trial030.stdout: "upper_bound": 1 2026-02-17T05:30:06.609 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.610 INFO:tasks.workunit.client.0.trial030.stdout: "perf_stat": { 2026-02-17T05:30:06.610 INFO:tasks.workunit.client.0.trial030.stdout: "commit_latency_ms": 0, 2026-02-17T05:30:06.610 INFO:tasks.workunit.client.0.trial030.stdout: "apply_latency_ms": 0, 2026-02-17T05:30:06.610 INFO:tasks.workunit.client.0.trial030.stdout: "commit_latency_ns": 0, 2026-02-17T05:30:06.610 INFO:tasks.workunit.client.0.trial030.stdout: "apply_latency_ns": 0 2026-02-17T05:30:06.610 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.610 INFO:tasks.workunit.client.0.trial030.stdout: "alerts": [], 2026-02-17T05:30:06.610 INFO:tasks.workunit.client.0.trial030.stdout: "network_ping_times": [] 2026-02-17T05:30:06.610 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:30:06.610 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.610 INFO:tasks.workunit.client.0.trial030.stdout: "pool_stats": [ 2026-02-17T05:30:06.610 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.610 INFO:tasks.workunit.client.0.trial030.stdout: "poolid": 1, 2026-02-17T05:30:06.610 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg": 1, 2026-02-17T05:30:06.610 INFO:tasks.workunit.client.0.trial030.stdout: "stat_sum": { 2026-02-17T05:30:06.610 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes": 51688, 2026-02-17T05:30:06.610 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects": 100, 2026-02-17T05:30:06.610 INFO:tasks.workunit.client.0.trial030.stdout: "num_object_clones": 0, 2026-02-17T05:30:06.610 INFO:tasks.workunit.client.0.trial030.stdout: "num_object_copies": 300, 2026-02-17T05:30:06.610 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T05:30:06.610 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_missing": 0, 2026-02-17T05:30:06.610 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_degraded": 100, 2026-02-17T05:30:06.610 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_misplaced": 0, 2026-02-17T05:30:06.610 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_unfound": 0, 2026-02-17T05:30:06.610 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_dirty": 100, 2026-02-17T05:30:06.610 INFO:tasks.workunit.client.0.trial030.stdout: "num_whiteouts": 0, 2026-02-17T05:30:06.610 INFO:tasks.workunit.client.0.trial030.stdout: "num_read": 0, 2026-02-17T05:30:06.610 INFO:tasks.workunit.client.0.trial030.stdout: "num_read_kb": 0, 2026-02-17T05:30:06.610 INFO:tasks.workunit.client.0.trial030.stdout: "num_write": 101, 2026-02-17T05:30:06.611 INFO:tasks.workunit.client.0.trial030.stdout: "num_write_kb": 101, 2026-02-17T05:30:06.611 INFO:tasks.workunit.client.0.trial030.stdout: "num_scrub_errors": 0, 2026-02-17T05:30:06.611 INFO:tasks.workunit.client.0.trial030.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T05:30:06.611 INFO:tasks.workunit.client.0.trial030.stdout: "num_deep_scrub_errors": 0, 2026-02-17T05:30:06.611 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_recovered": 0, 2026-02-17T05:30:06.611 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes_recovered": 0, 2026-02-17T05:30:06.611 INFO:tasks.workunit.client.0.trial030.stdout: "num_keys_recovered": 0, 2026-02-17T05:30:06.611 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_omap": 0, 2026-02-17T05:30:06.611 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T05:30:06.611 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T05:30:06.611 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush": 0, 2026-02-17T05:30:06.611 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_kb": 0, 2026-02-17T05:30:06.611 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict": 0, 2026-02-17T05:30:06.611 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_kb": 0, 2026-02-17T05:30:06.611 INFO:tasks.workunit.client.0.trial030.stdout: "num_promote": 0, 2026-02-17T05:30:06.611 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_mode_high": 0, 2026-02-17T05:30:06.611 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_mode_low": 0, 2026-02-17T05:30:06.611 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_mode_some": 0, 2026-02-17T05:30:06.611 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_mode_full": 0, 2026-02-17T05:30:06.611 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_pinned": 0, 2026-02-17T05:30:06.611 INFO:tasks.workunit.client.0.trial030.stdout: "num_legacy_snapsets": 0, 2026-02-17T05:30:06.611 INFO:tasks.workunit.client.0.trial030.stdout: "num_large_omap_objects": 0, 2026-02-17T05:30:06.611 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_manifest": 0, 2026-02-17T05:30:06.611 INFO:tasks.workunit.client.0.trial030.stdout: "num_omap_bytes": 0, 2026-02-17T05:30:06.611 INFO:tasks.workunit.client.0.trial030.stdout: "num_omap_keys": 0, 2026-02-17T05:30:06.611 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_repaired": 0 2026-02-17T05:30:06.611 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.611 INFO:tasks.workunit.client.0.trial030.stdout: "store_stats": { 2026-02-17T05:30:06.611 INFO:tasks.workunit.client.0.trial030.stdout: "total": 0, 2026-02-17T05:30:06.611 INFO:tasks.workunit.client.0.trial030.stdout: "available": 0, 2026-02-17T05:30:06.612 INFO:tasks.workunit.client.0.trial030.stdout: "internally_reserved": 0, 2026-02-17T05:30:06.612 INFO:tasks.workunit.client.0.trial030.stdout: "allocated": 1220608, 2026-02-17T05:30:06.612 INFO:tasks.workunit.client.0.trial030.stdout: "data_stored": 154528, 2026-02-17T05:30:06.612 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed": 0, 2026-02-17T05:30:06.612 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_allocated": 0, 2026-02-17T05:30:06.612 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_original": 0, 2026-02-17T05:30:06.612 INFO:tasks.workunit.client.0.trial030.stdout: "omap_allocated": 0, 2026-02-17T05:30:06.612 INFO:tasks.workunit.client.0.trial030.stdout: "internal_metadata": 0 2026-02-17T05:30:06.612 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.612 INFO:tasks.workunit.client.0.trial030.stdout: "log_size": 17, 2026-02-17T05:30:06.612 INFO:tasks.workunit.client.0.trial030.stdout: "ondisk_log_size": 17, 2026-02-17T05:30:06.612 INFO:tasks.workunit.client.0.trial030.stdout: "up": 2, 2026-02-17T05:30:06.612 INFO:tasks.workunit.client.0.trial030.stdout: "acting": 2, 2026-02-17T05:30:06.612 INFO:tasks.workunit.client.0.trial030.stdout: "num_store_stats": 3 2026-02-17T05:30:06.612 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:30:06.612 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:30:06.612 INFO:tasks.workunit.client.0.trial030.stdout: "osd_stats": [ 2026-02-17T05:30:06.612 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.612 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 0, 2026-02-17T05:30:06.612 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 150323855377 2026-02-17T05:30:06.612 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.612 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.612 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 1, 2026-02-17T05:30:06.612 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 38654705677 2026-02-17T05:30:06.612 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.612 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.612 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2, 2026-02-17T05:30:06.612 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 163208757265 2026-02-17T05:30:06.613 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:30:06.613 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:30:06.613 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg_by_state": [ 2026-02-17T05:30:06.613 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.613 INFO:tasks.workunit.client.0.trial030.stdout: "state": "active+undersized+degraded", 2026-02-17T05:30:06.613 INFO:tasks.workunit.client.0.trial030.stdout: "num": 1 2026-02-17T05:30:06.613 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:30:06.613 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:30:06.613 INFO:tasks.workunit.client.0.trial030.stdout: "pool_pg_unavailable_map": [ 2026-02-17T05:30:06.613 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.613 INFO:tasks.workunit.client.0.trial030.stdout: "poolid": "1", 2026-02-17T05:30:06.613 INFO:tasks.workunit.client.0.trial030.stdout: "pgs": [] 2026-02-17T05:30:06.613 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:30:06.613 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:30:06.613 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg_by_osd": [ 2026-02-17T05:30:06.613 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.613 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2, 2026-02-17T05:30:06.613 INFO:tasks.workunit.client.0.trial030.stdout: "num_primary_pg": 0, 2026-02-17T05:30:06.613 INFO:tasks.workunit.client.0.trial030.stdout: "num_acting_pg": 1, 2026-02-17T05:30:06.613 INFO:tasks.workunit.client.0.trial030.stdout: "num_up_not_acting_pg": 0 2026-02-17T05:30:06.613 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.613 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.613 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 0, 2026-02-17T05:30:06.613 INFO:tasks.workunit.client.0.trial030.stdout: "num_primary_pg": 1, 2026-02-17T05:30:06.613 INFO:tasks.workunit.client.0.trial030.stdout: "num_acting_pg": 1, 2026-02-17T05:30:06.613 INFO:tasks.workunit.client.0.trial030.stdout: "num_up_not_acting_pg": 0 2026-02-17T05:30:06.613 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.613 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.613 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 1, 2026-02-17T05:30:06.613 INFO:tasks.workunit.client.0.trial030.stdout: "num_primary_pg": 0, 2026-02-17T05:30:06.613 INFO:tasks.workunit.client.0.trial030.stdout: "num_acting_pg": 0, 2026-02-17T05:30:06.614 INFO:tasks.workunit.client.0.trial030.stdout: "num_up_not_acting_pg": 0 2026-02-17T05:30:06.614 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:30:06.614 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:30:06.614 INFO:tasks.workunit.client.0.trial030.stdout: "purged_snaps": [ 2026-02-17T05:30:06.614 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:30:06.614 INFO:tasks.workunit.client.0.trial030.stdout: "pool": 1, 2026-02-17T05:30:06.614 INFO:tasks.workunit.client.0.trial030.stdout: "purged_snaps": {} 2026-02-17T05:30:06.614 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:30:06.614 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:30:06.614 INFO:tasks.workunit.client.0.trial030.stdout: "servicemap": { 2026-02-17T05:30:06.614 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 4, 2026-02-17T05:30:06.614 INFO:tasks.workunit.client.0.trial030.stdout: "modified": "2026-02-17T05:30:05.926813+0000", 2026-02-17T05:30:06.614 INFO:tasks.workunit.client.0.trial030.stdout: "services": {} 2026-02-17T05:30:06.614 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:30:06.614 INFO:tasks.workunit.client.0.trial030.stdout: "mgrstat_first_committed": 1, 2026-02-17T05:30:06.614 INFO:tasks.workunit.client.0.trial030.stdout: "mgrstat_last_committed": 52, 2026-02-17T05:30:06.614 INFO:tasks.workunit.client.0.trial030.stdout: "logm_first_committed": 1, 2026-02-17T05:30:06.614 INFO:tasks.workunit.client.0.trial030.stdout: "logm_last_committed": 279, 2026-02-17T05:30:06.614 INFO:tasks.workunit.client.0.trial030.stdout: "paxos": { 2026-02-17T05:30:06.614 INFO:tasks.workunit.client.0.trial030.stdout: "first_committed": 1, 2026-02-17T05:30:06.614 INFO:tasks.workunit.client.0.trial030.stdout: "last_committed": 383, 2026-02-17T05:30:06.614 INFO:tasks.workunit.client.0.trial030.stdout: "last_pn": 0, 2026-02-17T05:30:06.614 INFO:tasks.workunit.client.0.trial030.stdout: "accepted_pn": 0 2026-02-17T05:30:06.614 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:30:06.614 INFO:tasks.workunit.client.0.trial030.stdout:} 2026-02-17T05:30:06.614 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-17T05:30:06.615 INFO:tasks.workunit.client.0.trial030.stdout:delay recovery 2026-02-17T05:30:06.615 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:538: TEST_divergent_2: echo 'delay recovery' 2026-02-17T05:30:06.615 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:539: TEST_divergent_2: ceph pg dump pgs 2026-02-17T05:30:06.761 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T05:30:06.761 INFO:tasks.workunit.client.0.trial030.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-17T05:29:06.914212+0000 41'101 41:131 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:28:35.475420+0000 0'0 2026-02-17T05:28:35.475420+0000 0 0 periodic scrub scheduled @ 2026-02-18T16:18:44.204529+0000 0 0 2026-02-17T05:30:06.761 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-17T05:30:06.761 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T05:30:06.761 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:30:06.770 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:540: TEST_divergent_2: for i in $non_divergent 2026-02-17T05:30:06.770 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: get_asok_path osd.0 2026-02-17T05:30:06.770 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-17T05:30:06.770 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-17T05:30:06.771 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T05:30:06.771 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:30:06.771 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:30:06.771 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19532/ceph-osd.0.asok 2026-02-17T05:30:06.771 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: CEPH_ARGS= 2026-02-17T05:30:06.771 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.19532/ceph-osd.0.asok set_recovery_delay 100000 2026-02-17T05:30:06.837 INFO:tasks.workunit.client.0.trial030.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-17T05:30:06.843 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:540: TEST_divergent_2: for i in $non_divergent 2026-02-17T05:30:06.843 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: get_asok_path osd.2 2026-02-17T05:30:06.843 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-17T05:30:06.843 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-17T05:30:06.844 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T05:30:06.844 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:30:06.844 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:30:06.844 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19532/ceph-osd.2.asok 2026-02-17T05:30:06.844 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: CEPH_ARGS= 2026-02-17T05:30:06.844 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.19532/ceph-osd.2.asok set_recovery_delay 100000 2026-02-17T05:30:06.898 INFO:tasks.workunit.client.0.trial030.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-17T05:30:06.903 INFO:tasks.workunit.client.0.trial030.stdout:revive divergent 1 2026-02-17T05:30:06.903 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:546: TEST_divergent_2: echo 'revive divergent 1' 2026-02-17T05:30:06.903 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:547: TEST_divergent_2: ceph pg dump pgs 2026-02-17T05:30:07.118 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T05:30:07.118 INFO:tasks.workunit.client.0.trial030.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-17T05:29:06.914212+0000 41'101 41:131 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:28:35.475420+0000 0'0 2026-02-17T05:28:35.475420+0000 0 0 periodic scrub scheduled @ 2026-02-18T16:18:44.204529+0000 0 0 2026-02-17T05:30:07.118 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-17T05:30:07.118 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T05:30:07.119 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:30:07.129 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:548: TEST_divergent_2: ceph osd set noup 2026-02-17T05:30:07.441 INFO:tasks.workunit.client.0.trial030.stderr:noup is set 2026-02-17T05:30:07.458 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:549: TEST_divergent_2: activate_osd td/divergent-priors 1 2026-02-17T05:30:07.458 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-17T05:30:07.458 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T05:30:07.458 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T05:30:07.458 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T05:30:07.458 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-17T05:30:07.458 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T05:30:07.459 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:30:07.459 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:30:07.459 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:30:07.459 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-17T05:30:07.459 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-17T05:30:07.459 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T05:30:07.459 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T05:30:07.459 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T05:30:07.459 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T05:30:07.459 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:30:07.459 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:30:07.459 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:30:07.460 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:30:07.460 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:30:07.460 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:30:07.460 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:30:07.460 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:30:07.460 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T05:30:07.460 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T05:30:07.460 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:30:07.460 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:30:07.461 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:30:07.461 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:30:07.461 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T05:30:07.461 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T05:30:07.461 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-17T05:30:07.461 INFO:tasks.workunit.client.0.trial030.stdout:start osd.1 2026-02-17T05:30:07.462 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T05:30:07.462 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T05:30:07.463 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-17T05:30:07.463 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T05:30:07.463 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T05:30:07.463 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T05:30:07.463 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T05:30:07.482 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:30:07.482+0000 7f9258047a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:30:07.484 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:30:07.482+0000 7f9258047a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:30:07.485 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:30:07.482+0000 7f9258047a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:30:07.682 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: return 0 2026-02-17T05:30:07.682 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:550: TEST_divergent_2: sleep 5 2026-02-17T05:30:07.872 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:30:07.870+0000 7f9258047a40 -1 Falling back to public interface 2026-02-17T05:30:08.506 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:30:08.506+0000 7f9258047a40 -1 osd.1 28 log_to_monitors true 2026-02-17T05:30:12.684 INFO:tasks.workunit.client.0.trial030.stdout:delay recovery divergent 2026-02-17T05:30:12.685 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:552: TEST_divergent_2: echo 'delay recovery divergent' 2026-02-17T05:30:12.685 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:553: TEST_divergent_2: ceph pg dump pgs 2026-02-17T05:30:12.893 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T05:30:12.893 INFO:tasks.workunit.client.0.trial030.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-17T05:29:06.914212+0000 41'101 44:137 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:28:35.475420+0000 0'0 2026-02-17T05:28:35.475420+0000 0 0 periodic scrub scheduled @ 2026-02-18T16:18:44.204529+0000 0 0 2026-02-17T05:30:12.893 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-17T05:30:12.894 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T05:30:12.894 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:30:12.905 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:554: TEST_divergent_2: get_asok_path osd.1 2026-02-17T05:30:12.905 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-17T05:30:12.905 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-17T05:30:12.905 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T05:30:12.905 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:30:12.905 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:30:12.906 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19532/ceph-osd.1.asok 2026-02-17T05:30:12.906 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:554: TEST_divergent_2: CEPH_ARGS= 2026-02-17T05:30:12.906 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:554: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.19532/ceph-osd.1.asok set_recovery_delay 100000 2026-02-17T05:30:12.972 INFO:tasks.workunit.client.0.trial030.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-17T05:30:12.978 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:556: TEST_divergent_2: ceph osd unset noup 2026-02-17T05:30:13.302 INFO:tasks.workunit.client.0.trial030.stderr:noup is unset 2026-02-17T05:30:13.315 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:558: TEST_divergent_2: wait_for_osd up 0 2026-02-17T05:30:13.316 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:30:13.316 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T05:30:13.316 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:30:13.316 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:30:13.316 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:30:13.317 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:30:13.317 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:30:13.317 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:30:13.317 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T05:30:13.534 INFO:tasks.workunit.client.0.trial030.stdout:osd.0 up in weight 1 up_from 35 up_thru 40 down_at 29 last_clean_interval [5,28) [v2:127.0.0.1:6800/4213725056,v1:127.0.0.1:6801/4213725056] [v2:127.0.0.1:6802/4213725056,v1:127.0.0.1:6803/4213725056] exists,up 65554143-3837-4f4a-8373-1db6c1d20c59 2026-02-17T05:30:13.535 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:30:13.535 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:30:13.535 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:30:13.535 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:559: TEST_divergent_2: wait_for_osd up 1 2026-02-17T05:30:13.535 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:30:13.535 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T05:30:13.535 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:30:13.535 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:30:13.535 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:30:13.535 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:30:13.536 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:30:13.536 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:30:13.536 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T05:30:13.744 INFO:tasks.workunit.client.0.trial030.stdout:osd.1 up in weight 1 up_from 46 up_thru 46 down_at 30 last_clean_interval [9,28) [v2:127.0.0.1:6818/1444195524,v1:127.0.0.1:6819/1444195524] [v2:127.0.0.1:6820/1444195524,v1:127.0.0.1:6821/1444195524] exists,up 1895d426-e99b-4201-96c2-911240090080 2026-02-17T05:30:13.745 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:30:13.745 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:30:13.745 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:30:13.745 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:560: TEST_divergent_2: wait_for_osd up 2 2026-02-17T05:30:13.745 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:30:13.745 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T05:30:13.745 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:30:13.745 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:30:13.745 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:30:13.745 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:30:13.746 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:30:13.746 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:30:13.746 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T05:30:13.954 INFO:tasks.workunit.client.0.trial030.stdout:osd.2 up in weight 1 up_from 38 up_thru 0 down_at 31 last_clean_interval [14,28) [v2:127.0.0.1:6810/2612200958,v1:127.0.0.1:6811/2612200958] [v2:127.0.0.1:6812/2612200958,v1:127.0.0.1:6813/2612200958] exists,up 8578ec30-73af-421b-931c-481a868d1bde 2026-02-17T05:30:13.955 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:30:13.955 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:30:13.955 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:30:13.955 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:562: TEST_divergent_2: ceph pg dump pgs 2026-02-17T05:30:14.158 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T05:30:14.159 INFO:tasks.workunit.client.0.trial030.stdout:1.0 100 0 0 0 0 51152 0 0 16 90 16 peering 2026-02-17T05:30:13.304107+0000 28'106 46:131 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:28:35.475420+0000 0'0 2026-02-17T05:28:35.475420+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:30:14.159 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-17T05:30:14.159 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T05:30:14.159 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:30:14.169 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:563: TEST_divergent_2: echo 'wait for peering' 2026-02-17T05:30:14.169 INFO:tasks.workunit.client.0.trial030.stdout:wait for peering 2026-02-17T05:30:14.170 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:564: TEST_divergent_2: ceph pg dump pgs 2026-02-17T05:30:14.371 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T05:30:14.372 INFO:tasks.workunit.client.0.trial030.stdout:1.0 100 0 0 0 0 51152 0 0 16 90 16 peering 2026-02-17T05:30:13.304107+0000 28'106 46:131 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:28:35.475420+0000 0'0 2026-02-17T05:28:35.475420+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:30:14.372 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-17T05:30:14.372 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T05:30:14.372 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:30:14.381 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:565: TEST_divergent_2: rados -p test put foo /tmp/tmp.EN2bIN7jPO 2026-02-17T05:30:14.410 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:566: TEST_divergent_2: rm -f /tmp/tmp.EN2bIN7jPO 2026-02-17T05:30:14.412 INFO:tasks.workunit.client.0.trial030.stdout:killing divergent 1 2026-02-17T05:30:14.412 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:570: TEST_divergent_2: echo 'killing divergent 1' 2026-02-17T05:30:14.412 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:571: TEST_divergent_2: ceph pg dump pgs 2026-02-17T05:30:14.624 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T05:30:14.624 INFO:tasks.workunit.client.0.trial030.stdout:1.0 100 0 0 0 0 51152 0 0 16 90 16 peering 2026-02-17T05:30:13.304107+0000 28'106 46:131 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:28:35.475420+0000 0'0 2026-02-17T05:28:35.475420+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:30:14.624 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-17T05:30:14.624 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T05:30:14.624 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:30:14.634 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:572: TEST_divergent_2: kill_daemons td/divergent-priors KILL osd.1 2026-02-17T05:30:14.635 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:30:14.635 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:30:14.636 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:30:14.636 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:30:14.636 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:30:14.744 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:30:14.744 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:575: TEST_divergent_2: expfile=td/divergent-priors/exp.19532.out 2026-02-17T05:30:14.744 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:576: TEST_divergent_2: _objectstore_tool_nodown td/divergent-priors 1 --op export-remove --pgid 1.0 --file td/divergent-priors/exp.19532.out 2026-02-17T05:30:14.744 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-17T05:30:14.744 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T05:30:14.745 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T05:30:14.745 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T05:30:14.745 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2026-02-17T05:30:14.745 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op export-remove --pgid 1.0 --file td/divergent-priors/exp.19532.out 2026-02-17T05:30:14.943 INFO:tasks.workunit.client.0.trial030.stderr:Exporting 1.0 info 1.0( v 47'102 lc 0'0 (28'90,47'102] local-lis/les=46/47 n=101 ec=22/22 lis/c=46/22 les/c/f=47/23/0 sis=46) 2026-02-17T05:30:14.943 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:023dd3d2:::existing_12:head# 2026-02-17T05:30:14.943 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:04c40a0c:::existing_93:head# 2026-02-17T05:30:14.943 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:064ff5fb:::existing_36:head# 2026-02-17T05:30:14.943 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:091f9f1d:::existing_94:head# 2026-02-17T05:30:14.943 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:0a865a93:::existing_54:head# 2026-02-17T05:30:14.943 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:0fed513c:::existing_41:head# 2026-02-17T05:30:14.943 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:13b9e0b8:::existing_92:head# 2026-02-17T05:30:14.944 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:169157fa:::existing_81:head# 2026-02-17T05:30:14.944 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:17731382:::existing_58:head# 2026-02-17T05:30:14.944 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:18a45a39:::existing_43:head# 2026-02-17T05:30:14.944 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:1c160f01:::existing_66:head# 2026-02-17T05:30:14.944 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:1dd6c249:::existing_97:head# 2026-02-17T05:30:14.944 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:227e0c77:::existing_7:head# 2026-02-17T05:30:14.944 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:23e1b063:::existing_59:head# 2026-02-17T05:30:14.944 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:28566edb:::existing_78:head# 2026-02-17T05:30:14.944 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:2a101182:::existing_20:head# 2026-02-17T05:30:14.944 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:2d1519da:::existing_96:head# 2026-02-17T05:30:14.944 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:3078b87a:::existing_86:head# 2026-02-17T05:30:14.944 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:30bde01b:::existing_15:head# 2026-02-17T05:30:14.944 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:317a7e19:::existing_56:head# 2026-02-17T05:30:14.945 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:38b9c7fa:::existing_33:head# 2026-02-17T05:30:14.945 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:3e16d84b:::existing_48:head# 2026-02-17T05:30:14.945 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:45fe8203:::existing_75:head# 2026-02-17T05:30:14.945 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:4e82c9ba:::existing_50:head# 2026-02-17T05:30:14.945 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:5298dcdb:::existing_57:head# 2026-02-17T05:30:14.945 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:52ebaa44:::existing_32:head# 2026-02-17T05:30:14.945 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:53588912:::existing_9:head# 2026-02-17T05:30:14.945 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:5b7e2de6:::existing_84:head# 2026-02-17T05:30:14.945 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:5da0255c:::existing_13:head# 2026-02-17T05:30:14.945 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:5da2dab8:::existing_53:head# 2026-02-17T05:30:14.945 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:5ee3514b:::existing_30:head# 2026-02-17T05:30:14.945 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:602f83fe:::foo:head# 2026-02-17T05:30:14.945 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:60426cc7:::existing_62:head# 2026-02-17T05:30:14.946 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:628918ca:::existing_79:head# 2026-02-17T05:30:14.946 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:63f8ab2d:::existing_77:head# 2026-02-17T05:30:14.946 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:67e1780f:::existing_27:head# 2026-02-17T05:30:14.946 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:68143ca1:::existing_71:head# 2026-02-17T05:30:14.946 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:6bac9509:::existing_29:head# 2026-02-17T05:30:14.946 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:6bbec798:::existing_45:head# 2026-02-17T05:30:14.946 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:6cb23a40:::existing_65:head# 2026-02-17T05:30:14.946 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:7055ec5e:::existing_83:head# 2026-02-17T05:30:14.946 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:70a54e2b:::existing_87:head# 2026-02-17T05:30:14.946 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:750ace21:::existing_19:head# 2026-02-17T05:30:14.946 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:78623b1d:::existing_6:head# 2026-02-17T05:30:14.946 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:79881152:::existing_63:head# 2026-02-17T05:30:14.946 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:7a80c0d5:::existing_99:head# 2026-02-17T05:30:14.947 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:81490677:::existing_76:head# 2026-02-17T05:30:14.947 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:85ec8e5d:::existing_85:head# 2026-02-17T05:30:14.947 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:8e2abbf0:::existing_49:head# 2026-02-17T05:30:14.947 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:8ee0fe0f:::existing_52:head# 2026-02-17T05:30:14.947 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:923c5d4d:::existing_5:head# 2026-02-17T05:30:14.947 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:92731e71:::existing_89:head# 2026-02-17T05:30:14.947 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:928205cf:::existing_82:head# 2026-02-17T05:30:14.947 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:93be2267:::existing_24:head# 2026-02-17T05:30:14.947 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:99ceda2c:::existing_44:head# 2026-02-17T05:30:14.947 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:9dd917ee:::existing_26:head# 2026-02-17T05:30:14.947 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:a28805a6:::existing_72:head# 2026-02-17T05:30:14.948 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:a294a8f6:::existing_16:head# 2026-02-17T05:30:14.948 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:a2f5473a:::existing_42:head# 2026-02-17T05:30:14.948 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:a504a533:::existing_90:head# 2026-02-17T05:30:14.948 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:a691337e:::existing_61:head# 2026-02-17T05:30:14.948 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:a6e8d7ac:::existing_28:head# 2026-02-17T05:30:14.948 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:a9fde86e:::existing_18:head# 2026-02-17T05:30:14.948 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:aa309faa:::existing_68:head# 2026-02-17T05:30:14.948 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:ae40b0ed:::existing_31:head# 2026-02-17T05:30:14.948 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:b279b1fe:::existing_10:head# 2026-02-17T05:30:14.948 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:b343e277:::existing_88:head# 2026-02-17T05:30:14.948 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:b7130e90:::existing_80:head# 2026-02-17T05:30:14.948 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:bc6f7309:::existing_70:head# 2026-02-17T05:30:14.948 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:be8489b7:::existing_38:head# 2026-02-17T05:30:14.949 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:beb4e5e3:::existing_47:head# 2026-02-17T05:30:14.949 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:bebec877:::existing_74:head# 2026-02-17T05:30:14.949 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:c04347d8:::existing_60:head# 2026-02-17T05:30:14.949 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:c156033e:::existing_100:head# 2026-02-17T05:30:14.949 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:c19f5a8e:::existing_8:head# 2026-02-17T05:30:14.949 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:c3e6ebe4:::existing_17:head# 2026-02-17T05:30:14.949 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:c6c5a7c2:::existing_39:head# 2026-02-17T05:30:14.949 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:cc1d0abf:::existing_95:head# 2026-02-17T05:30:14.949 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:ccb3865b:::existing_73:head# 2026-02-17T05:30:14.949 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:cd84e19e:::existing_40:head# 2026-02-17T05:30:14.949 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:d2cd64ce:::existing_37:head# 2026-02-17T05:30:14.949 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:d41a25c9:::existing_22:head# 2026-02-17T05:30:14.949 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:d7f088da:::existing_91:head# 2026-02-17T05:30:14.949 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:d9cbd1d6:::existing_64:head# 2026-02-17T05:30:14.950 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:dcc4ff82:::existing_98:head# 2026-02-17T05:30:14.950 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:dd677bd3:::existing_35:head# 2026-02-17T05:30:14.950 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:dd6d90e7:::existing_46:head# 2026-02-17T05:30:14.950 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:e0e22077:::existing_21:head# 2026-02-17T05:30:14.950 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:e255b710:::existing_55:head# 2026-02-17T05:30:14.950 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:eff1d5db:::existing_14:head# 2026-02-17T05:30:14.950 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:f1b156bf:::existing_23:head# 2026-02-17T05:30:14.950 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:f5ce4199:::existing_34:head# 2026-02-17T05:30:14.950 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:f6809456:::existing_11:head# 2026-02-17T05:30:14.950 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:f699a2a9:::existing_67:head# 2026-02-17T05:30:14.950 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:f9baac43:::existing_25:head# 2026-02-17T05:30:14.950 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:fb76688e:::existing_51:head# 2026-02-17T05:30:14.950 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:fbb92eec:::existing_69:head# 2026-02-17T05:30:14.951 INFO:tasks.workunit.client.0.trial030.stderr:Export successful 2026-02-17T05:30:14.951 INFO:tasks.workunit.client.0.trial030.stdout: marking collection for removal 2026-02-17T05:30:14.951 INFO:tasks.workunit.client.0.trial030.stdout:setting '_remove' omap key 2026-02-17T05:30:14.951 INFO:tasks.workunit.client.0.trial030.stdout:finish_remove_pgs 1.0_head removing 1.0 2026-02-17T05:30:14.952 INFO:tasks.workunit.client.0.trial030.stderr:Remove successful 2026-02-17T05:30:15.031 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:577: TEST_divergent_2: _objectstore_tool_nodown td/divergent-priors 1 --op import --file td/divergent-priors/exp.19532.out 2026-02-17T05:30:15.031 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-17T05:30:15.031 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T05:30:15.031 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T05:30:15.032 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T05:30:15.032 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2026-02-17T05:30:15.032 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op import --file td/divergent-priors/exp.19532.out 2026-02-17T05:30:15.210 INFO:tasks.workunit.client.0.trial030.stdout:get_pg_num_history pg_num_history pg_num_history(e47 pg_nums {1={22=1}} deleted_pools ) 2026-02-17T05:30:15.211 INFO:tasks.workunit.client.0.trial030.stdout:Importing pgid 1.0 2026-02-17T05:30:15.211 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:023dd3d2:::existing_12:head# 2026-02-17T05:30:15.211 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.211 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:04c40a0c:::existing_93:head# 2026-02-17T05:30:15.211 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.211 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:064ff5fb:::existing_36:head# 2026-02-17T05:30:15.211 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.211 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:091f9f1d:::existing_94:head# 2026-02-17T05:30:15.211 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.211 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:0a865a93:::existing_54:head# 2026-02-17T05:30:15.211 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.212 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:0fed513c:::existing_41:head# 2026-02-17T05:30:15.212 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.212 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:13b9e0b8:::existing_92:head# 2026-02-17T05:30:15.212 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.212 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:169157fa:::existing_81:head# 2026-02-17T05:30:15.212 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.212 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:17731382:::existing_58:head# 2026-02-17T05:30:15.212 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.212 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:18a45a39:::existing_43:head# 2026-02-17T05:30:15.212 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.212 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:1c160f01:::existing_66:head# 2026-02-17T05:30:15.212 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.213 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:1dd6c249:::existing_97:head# 2026-02-17T05:30:15.213 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.213 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:227e0c77:::existing_7:head# 2026-02-17T05:30:15.213 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.213 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:23e1b063:::existing_59:head# 2026-02-17T05:30:15.213 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.213 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:28566edb:::existing_78:head# 2026-02-17T05:30:15.213 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.213 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:2a101182:::existing_20:head# 2026-02-17T05:30:15.213 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.213 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:2d1519da:::existing_96:head# 2026-02-17T05:30:15.213 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.213 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:3078b87a:::existing_86:head# 2026-02-17T05:30:15.214 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.214 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:30bde01b:::existing_15:head# 2026-02-17T05:30:15.214 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.214 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:317a7e19:::existing_56:head# 2026-02-17T05:30:15.214 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.214 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:38b9c7fa:::existing_33:head# 2026-02-17T05:30:15.214 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.214 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:3e16d84b:::existing_48:head# 2026-02-17T05:30:15.214 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.214 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:45fe8203:::existing_75:head# 2026-02-17T05:30:15.214 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.214 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:4e82c9ba:::existing_50:head# 2026-02-17T05:30:15.215 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.215 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:5298dcdb:::existing_57:head# 2026-02-17T05:30:15.215 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.215 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:52ebaa44:::existing_32:head# 2026-02-17T05:30:15.215 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.215 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:53588912:::existing_9:head# 2026-02-17T05:30:15.215 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.215 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:5b7e2de6:::existing_84:head# 2026-02-17T05:30:15.215 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.215 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:5da0255c:::existing_13:head# 2026-02-17T05:30:15.215 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.215 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:5da2dab8:::existing_53:head# 2026-02-17T05:30:15.216 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.216 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:5ee3514b:::existing_30:head# 2026-02-17T05:30:15.216 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.216 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:602f83fe:::foo:head# 2026-02-17T05:30:15.216 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.216 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:60426cc7:::existing_62:head# 2026-02-17T05:30:15.216 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.216 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:628918ca:::existing_79:head# 2026-02-17T05:30:15.216 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.216 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:63f8ab2d:::existing_77:head# 2026-02-17T05:30:15.216 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.216 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:67e1780f:::existing_27:head# 2026-02-17T05:30:15.216 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.217 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:68143ca1:::existing_71:head# 2026-02-17T05:30:15.217 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.217 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:6bac9509:::existing_29:head# 2026-02-17T05:30:15.217 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.217 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:6bbec798:::existing_45:head# 2026-02-17T05:30:15.217 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.217 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:6cb23a40:::existing_65:head# 2026-02-17T05:30:15.217 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.217 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:7055ec5e:::existing_83:head# 2026-02-17T05:30:15.217 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.217 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:70a54e2b:::existing_87:head# 2026-02-17T05:30:15.217 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.217 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:750ace21:::existing_19:head# 2026-02-17T05:30:15.218 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.218 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:78623b1d:::existing_6:head# 2026-02-17T05:30:15.218 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.218 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:79881152:::existing_63:head# 2026-02-17T05:30:15.218 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.218 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:7a80c0d5:::existing_99:head# 2026-02-17T05:30:15.218 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.218 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:81490677:::existing_76:head# 2026-02-17T05:30:15.218 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.218 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:85ec8e5d:::existing_85:head# 2026-02-17T05:30:15.218 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.218 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:8e2abbf0:::existing_49:head# 2026-02-17T05:30:15.218 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.219 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:8ee0fe0f:::existing_52:head# 2026-02-17T05:30:15.219 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.219 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:923c5d4d:::existing_5:head# 2026-02-17T05:30:15.219 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.219 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:92731e71:::existing_89:head# 2026-02-17T05:30:15.219 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.219 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:928205cf:::existing_82:head# 2026-02-17T05:30:15.219 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.219 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:93be2267:::existing_24:head# 2026-02-17T05:30:15.219 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.219 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:99ceda2c:::existing_44:head# 2026-02-17T05:30:15.219 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.219 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:9dd917ee:::existing_26:head# 2026-02-17T05:30:15.220 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.220 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:a28805a6:::existing_72:head# 2026-02-17T05:30:15.220 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.220 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:a294a8f6:::existing_16:head# 2026-02-17T05:30:15.220 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.220 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:a2f5473a:::existing_42:head# 2026-02-17T05:30:15.220 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.220 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:a504a533:::existing_90:head# 2026-02-17T05:30:15.220 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.220 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:a691337e:::existing_61:head# 2026-02-17T05:30:15.220 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.220 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:a6e8d7ac:::existing_28:head# 2026-02-17T05:30:15.220 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.221 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:a9fde86e:::existing_18:head# 2026-02-17T05:30:15.221 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.221 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:aa309faa:::existing_68:head# 2026-02-17T05:30:15.221 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.221 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:ae40b0ed:::existing_31:head# 2026-02-17T05:30:15.221 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.221 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:b279b1fe:::existing_10:head# 2026-02-17T05:30:15.221 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.221 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:b343e277:::existing_88:head# 2026-02-17T05:30:15.221 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.221 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:b7130e90:::existing_80:head# 2026-02-17T05:30:15.221 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.221 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:bc6f7309:::existing_70:head# 2026-02-17T05:30:15.222 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.222 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:be8489b7:::existing_38:head# 2026-02-17T05:30:15.222 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.222 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:beb4e5e3:::existing_47:head# 2026-02-17T05:30:15.222 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.222 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:bebec877:::existing_74:head# 2026-02-17T05:30:15.222 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.222 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:c04347d8:::existing_60:head# 2026-02-17T05:30:15.222 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.222 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:c156033e:::existing_100:head# 2026-02-17T05:30:15.222 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.222 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:c19f5a8e:::existing_8:head# 2026-02-17T05:30:15.222 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.223 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:c3e6ebe4:::existing_17:head# 2026-02-17T05:30:15.223 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.223 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:c6c5a7c2:::existing_39:head# 2026-02-17T05:30:15.223 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.223 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:cc1d0abf:::existing_95:head# 2026-02-17T05:30:15.223 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.223 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:ccb3865b:::existing_73:head# 2026-02-17T05:30:15.223 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.223 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:cd84e19e:::existing_40:head# 2026-02-17T05:30:15.223 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.223 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:d2cd64ce:::existing_37:head# 2026-02-17T05:30:15.223 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.223 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:d41a25c9:::existing_22:head# 2026-02-17T05:30:15.223 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.224 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:d7f088da:::existing_91:head# 2026-02-17T05:30:15.224 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.224 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:d9cbd1d6:::existing_64:head# 2026-02-17T05:30:15.224 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.224 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:dcc4ff82:::existing_98:head# 2026-02-17T05:30:15.224 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.224 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:dd677bd3:::existing_35:head# 2026-02-17T05:30:15.224 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.224 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:dd6d90e7:::existing_46:head# 2026-02-17T05:30:15.224 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.224 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:e0e22077:::existing_21:head# 2026-02-17T05:30:15.224 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.224 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:e255b710:::existing_55:head# 2026-02-17T05:30:15.225 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.225 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:eff1d5db:::existing_14:head# 2026-02-17T05:30:15.225 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.225 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:f1b156bf:::existing_23:head# 2026-02-17T05:30:15.225 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.225 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:f5ce4199:::existing_34:head# 2026-02-17T05:30:15.225 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.225 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:f6809456:::existing_11:head# 2026-02-17T05:30:15.225 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.225 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:f699a2a9:::existing_67:head# 2026-02-17T05:30:15.225 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.225 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:f9baac43:::existing_25:head# 2026-02-17T05:30:15.225 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.226 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:fb76688e:::existing_51:head# 2026-02-17T05:30:15.226 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.226 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:fbb92eec:::existing_69:head# 2026-02-17T05:30:15.226 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:30:15.226 INFO:tasks.workunit.client.0.trial030.stdout:write_pg epoch 47 info 1.0( v 47'102 lc 0'0 (28'90,47'102] local-lis/les=46/47 n=101 ec=22/22 lis/c=46/22 les/c/f=47/23/0 sis=46) 2026-02-17T05:30:15.226 INFO:tasks.workunit.client.0.trial030.stdout:Import successful 2026-02-17T05:30:15.307 INFO:tasks.workunit.client.0.trial030.stdout:reviving divergent 1 2026-02-17T05:30:15.308 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:579: TEST_divergent_2: echo 'reviving divergent 1' 2026-02-17T05:30:15.308 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:580: TEST_divergent_2: ceph pg dump pgs 2026-02-17T05:30:15.509 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T05:30:15.509 INFO:tasks.workunit.client.0.trial030.stdout:1.0 100 0 0 0 0 51152 0 0 16 90 16 peering 2026-02-17T05:30:13.304107+0000 28'106 46:131 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:28:35.475420+0000 0'0 2026-02-17T05:28:35.475420+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:30:15.509 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-17T05:30:15.509 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T05:30:15.510 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:30:15.522 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:581: TEST_divergent_2: activate_osd td/divergent-priors 1 2026-02-17T05:30:15.522 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-17T05:30:15.522 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T05:30:15.522 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T05:30:15.523 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T05:30:15.523 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-17T05:30:15.523 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T05:30:15.523 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:30:15.523 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:30:15.523 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:30:15.523 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-17T05:30:15.523 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-17T05:30:15.523 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T05:30:15.524 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T05:30:15.524 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T05:30:15.524 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T05:30:15.524 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:30:15.524 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:30:15.524 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:30:15.524 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:30:15.524 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:30:15.524 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:30:15.524 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:30:15.524 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:30:15.524 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T05:30:15.525 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T05:30:15.525 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:30:15.525 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:30:15.525 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:30:15.525 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:30:15.525 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T05:30:15.525 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T05:30:15.525 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-17T05:30:15.526 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T05:30:15.526 INFO:tasks.workunit.client.0.trial030.stdout:start osd.1 2026-02-17T05:30:15.527 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T05:30:15.527 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-17T05:30:15.527 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T05:30:15.527 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T05:30:15.527 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T05:30:15.527 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T05:30:15.546 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:30:15.541+0000 7fb7ffeb3a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:30:15.547 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:30:15.545+0000 7fb7ffeb3a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:30:15.548 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:30:15.545+0000 7fb7ffeb3a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:30:15.739 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T05:30:15.739 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:30:15.739 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T05:30:15.739 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:30:15.739 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:30:15.740 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:30:15.740 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:30:15.740 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:30:15.741 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:30:15.741 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T05:30:15.957 INFO:tasks.workunit.client.0.trial030.stdout:osd.1 up in weight 1 up_from 46 up_thru 46 down_at 30 last_clean_interval [9,28) [v2:127.0.0.1:6818/1444195524,v1:127.0.0.1:6819/1444195524] [v2:127.0.0.1:6820/1444195524,v1:127.0.0.1:6821/1444195524] exists,up 1895d426-e99b-4201-96c2-911240090080 2026-02-17T05:30:15.959 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:30:15.959 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:30:15.959 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:30:15.959 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:582: TEST_divergent_2: wait_for_osd up 1 2026-02-17T05:30:15.959 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:30:15.959 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T05:30:15.959 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:30:15.959 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:30:15.959 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:30:15.959 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:30:15.960 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:30:15.960 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:30:15.960 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T05:30:16.015 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:30:16.013+0000 7fb7ffeb3a40 -1 Falling back to public interface 2026-02-17T05:30:16.176 INFO:tasks.workunit.client.0.trial030.stdout:osd.1 up in weight 1 up_from 46 up_thru 46 down_at 30 last_clean_interval [9,28) [v2:127.0.0.1:6818/1444195524,v1:127.0.0.1:6819/1444195524] [v2:127.0.0.1:6820/1444195524,v1:127.0.0.1:6821/1444195524] exists,up 1895d426-e99b-4201-96c2-911240090080 2026-02-17T05:30:16.176 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:30:16.176 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:30:16.177 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:30:16.177 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:584: TEST_divergent_2: sleep 20 2026-02-17T05:30:16.734 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:30:16.733+0000 7fb7ffeb3a40 -1 osd.1 47 log_to_monitors true 2026-02-17T05:30:36.178 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:585: TEST_divergent_2: get_asok_path osd.1 2026-02-17T05:30:36.178 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-17T05:30:36.178 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-17T05:30:36.178 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T05:30:36.178 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:30:36.179 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:30:36.179 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19532/ceph-osd.1.asok 2026-02-17T05:30:36.180 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:585: TEST_divergent_2: CEPH_ARGS= 2026-02-17T05:30:36.180 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:585: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.19532/ceph-osd.1.asok dump_ops_in_flight 2026-02-17T05:30:36.243 INFO:tasks.workunit.client.0.trial030.stdout:{ 2026-02-17T05:30:36.243 INFO:tasks.workunit.client.0.trial030.stdout: "ops": [], 2026-02-17T05:30:36.243 INFO:tasks.workunit.client.0.trial030.stdout: "num_ops": 0 2026-02-17T05:30:36.243 INFO:tasks.workunit.client.0.trial030.stdout:} 2026-02-17T05:30:36.249 INFO:tasks.workunit.client.0.trial030.stdout:allowing recovery 2026-02-17T05:30:36.249 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:587: TEST_divergent_2: echo 'allowing recovery' 2026-02-17T05:30:36.249 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:588: TEST_divergent_2: ceph pg dump pgs 2026-02-17T05:30:36.463 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T05:30:36.463 INFO:tasks.workunit.client.0.trial030.stdout:1.0 101 0 0 0 0 52200 0 0 12 90 12 active+clean 2026-02-17T05:30:17.200158+0000 47'102 51:162 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:28:35.475420+0000 0'0 2026-02-17T05:28:35.475420+0000 0 0 periodic scrub scheduled @ 2026-02-18T12:06:10.310354+0000 0 0 2026-02-17T05:30:36.463 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-17T05:30:36.463 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T05:30:36.463 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:30:36.471 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:590: TEST_divergent_2: for i in $osds 2026-02-17T05:30:36.471 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:592: TEST_divergent_2: ceph tell osd.0 debug kick_recovery_wq 0 2026-02-17T05:30:36.559 INFO:tasks.workunit.client.0.trial030.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-17T05:30:36.568 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:590: TEST_divergent_2: for i in $osds 2026-02-17T05:30:36.569 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:592: TEST_divergent_2: ceph tell osd.1 debug kick_recovery_wq 0 2026-02-17T05:30:36.644 INFO:tasks.workunit.client.0.trial030.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-17T05:30:36.651 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:590: TEST_divergent_2: for i in $osds 2026-02-17T05:30:36.651 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:592: TEST_divergent_2: ceph tell osd.2 debug kick_recovery_wq 0 2026-02-17T05:30:36.737 INFO:tasks.workunit.client.0.trial030.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-17T05:30:36.748 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:595: TEST_divergent_2: echo 'reading divergent objects' 2026-02-17T05:30:36.748 INFO:tasks.workunit.client.0.trial030.stdout:reading divergent objects 2026-02-17T05:30:36.748 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:596: TEST_divergent_2: ceph pg dump pgs 2026-02-17T05:30:36.951 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T05:30:36.952 INFO:tasks.workunit.client.0.trial030.stdout:1.0 101 0 0 0 0 52200 0 0 12 90 12 active+clean 2026-02-17T05:30:17.200158+0000 47'102 51:162 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:28:35.475420+0000 0'0 2026-02-17T05:28:35.475420+0000 0 0 periodic scrub scheduled @ 2026-02-18T12:06:10.310354+0000 0 0 2026-02-17T05:30:36.952 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-17T05:30:36.952 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T05:30:36.952 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:30:36.963 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: expr 2 + 2 2026-02-17T05:30:36.964 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: seq 1 4 2026-02-17T05:30:36.965 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T05:30:36.965 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:599: TEST_divergent_2: rados -p test get existing_1 td/divergent-priors/existing 2026-02-17T05:30:36.995 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T05:30:36.995 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:599: TEST_divergent_2: rados -p test get existing_2 td/divergent-priors/existing 2026-02-17T05:30:37.024 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T05:30:37.024 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:599: TEST_divergent_2: rados -p test get existing_3 td/divergent-priors/existing 2026-02-17T05:30:37.052 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T05:30:37.052 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:599: TEST_divergent_2: rados -p test get existing_4 td/divergent-priors/existing 2026-02-17T05:30:37.080 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:601: TEST_divergent_2: seq 1 2 2026-02-17T05:30:37.081 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:601: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-17T05:30:37.082 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:603: TEST_divergent_2: rados -p test get newobject_1 td/divergent-priors/existing 2026-02-17T05:30:37.100 INFO:tasks.workunit.client.0.trial030.stderr:error getting test/newobject_1: (2) No such file or directory 2026-02-17T05:30:37.102 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:601: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-17T05:30:37.102 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:603: TEST_divergent_2: rados -p test get newobject_2 td/divergent-priors/existing 2026-02-17T05:30:37.120 INFO:tasks.workunit.client.0.trial030.stderr:error getting test/newobject_2: (2) No such file or directory 2026-02-17T05:30:37.121 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:605: TEST_divergent_2: rm -f td/divergent-priors/existing 2026-02-17T05:30:37.123 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:607: TEST_divergent_2: find td/divergent-priors -name '*osd*log' 2026-02-17T05:30:37.124 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:607: TEST_divergent_2: grep _merge_object_divergent_entries td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-17T05:30:37.127 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:30:14.246+0000 7f9239fcd640 20 _merge_object_divergent_entries: merging hoid 1:70b3bf12:::existing_4:head entries: 28'106 (28'4) delete 1:70b3bf12:::existing_4:head by client.4549.0:1 2026-02-17T05:28:50.941636+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-17T05:30:37.127 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:30:14.246+0000 7f9239fcd640 20 _merge_object_divergent_entries: keeping 28'106 (28'4) delete 1:70b3bf12:::existing_4:head by client.4549.0:1 2026-02-17T05:28:50.941636+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-17T05:30:37.127 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:30:14.246+0000 7f9239fcd640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-17T05:30:37.127 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:30:14.246+0000 7f9239fcd640 10 _merge_object_divergent_entries: hoid 1:70b3bf12:::existing_4:head prior_version: 28'4 first_divergent_update: 28'106 last_divergent_update: 28'106 2026-02-17T05:30:37.127 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:30:14.246+0000 7f9239fcd640 10 _merge_object_divergent_entries: more recent entry found: 41'101 (28'4) modify 1:70b3bf12:::existing_4:head by client.4658.0:1 2026-02-17T05:29:36.810737+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false, already merged 2026-02-17T05:30:37.127 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:30:14.246+0000 7f9239fcd640 20 _merge_object_divergent_entries: merging hoid 1:75ac5091:::newobject_2:head entries: 28'101 (0'0) modify 1:75ac5091:::newobject_2:head by client.4540.0:1 2026-02-17T05:28:50.936199+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-17T05:30:37.127 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:30:14.246+0000 7f9239fcd640 20 _merge_object_divergent_entries: keeping 28'101 (0'0) modify 1:75ac5091:::newobject_2:head by client.4540.0:1 2026-02-17T05:28:50.936199+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-17T05:30:37.127 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:30:14.246+0000 7f9239fcd640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-17T05:30:37.127 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:30:14.246+0000 7f9239fcd640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head prior_version: 0'0 first_divergent_update: 28'101 last_divergent_update: 28'101 2026-02-17T05:30:37.127 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:30:14.246+0000 7f9239fcd640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head has no more recent entries in log 2026-02-17T05:30:37.127 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:30:14.246+0000 7f9239fcd640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head prior_version or op type indicates creation, deleting 2026-02-17T05:30:37.127 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:30:14.246+0000 7f9239fcd640 20 _merge_object_divergent_entries: merging hoid 1:8881e6d8:::existing_3:head entries: 28'105 (28'3) delete 1:8881e6d8:::existing_3:head by client.4547.0:1 2026-02-17T05:28:50.940269+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-17T05:30:37.127 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:30:14.246+0000 7f9239fcd640 20 _merge_object_divergent_entries: keeping 28'105 (28'3) delete 1:8881e6d8:::existing_3:head by client.4547.0:1 2026-02-17T05:28:50.940269+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-17T05:30:37.127 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:30:14.246+0000 7f9239fcd640 10 _merge_object_divergent_entries: hoid object_not_in_store: 1 2026-02-17T05:30:37.127 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:30:14.246+0000 7f9239fcd640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head prior_version: 28'3 first_divergent_update: 28'105 last_divergent_update: 28'105 2026-02-17T05:30:37.127 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:30:14.246+0000 7f9239fcd640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head has no more recent entries in log 2026-02-17T05:30:37.127 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:30:14.246+0000 7f9239fcd640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head must be rolled back or recovered, attempting to rollback 2026-02-17T05:30:37.127 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:30:14.246+0000 7f9239fcd640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head olog_can_rollback_to: 28'106 2026-02-17T05:30:37.127 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:30:14.246+0000 7f9239fcd640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head cannot rollback 28'105 (28'3) delete 1:8881e6d8:::existing_3:head by client.4547.0:1 2026-02-17T05:28:50.940269+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-17T05:30:37.127 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:30:14.246+0000 7f9239fcd640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head cannot roll back, removing and adding to missing 2026-02-17T05:30:37.127 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:30:14.246+0000 7f9239fcd640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head prior_version 28'3 <= info.log_tail 28'90 2026-02-17T05:30:37.127 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:30:14.246+0000 7f9239fcd640 20 _merge_object_divergent_entries: merging hoid 1:97db2a0f:::existing_2:head entries: 28'104 (28'2) modify 1:97db2a0f:::existing_2:head by client.4543.0:1 2026-02-17T05:28:50.938192+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-17T05:30:37.127 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:30:14.246+0000 7f9239fcd640 20 _merge_object_divergent_entries: keeping 28'104 (28'2) modify 1:97db2a0f:::existing_2:head by client.4543.0:1 2026-02-17T05:28:50.938192+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-17T05:30:37.127 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:30:14.246+0000 7f9239fcd640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-17T05:30:37.127 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:30:14.246+0000 7f9239fcd640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head prior_version: 28'2 first_divergent_update: 28'104 last_divergent_update: 28'104 2026-02-17T05:30:37.128 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:30:14.246+0000 7f9239fcd640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head has no more recent entries in log 2026-02-17T05:30:37.128 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:30:14.246+0000 7f9239fcd640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head must be rolled back or recovered, attempting to rollback 2026-02-17T05:30:37.128 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:30:14.246+0000 7f9239fcd640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head olog_can_rollback_to: 28'106 2026-02-17T05:30:37.128 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:30:14.246+0000 7f9239fcd640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head cannot rollback 28'104 (28'2) modify 1:97db2a0f:::existing_2:head by client.4543.0:1 2026-02-17T05:28:50.938192+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-17T05:30:37.128 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:30:14.246+0000 7f9239fcd640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head cannot roll back, removing and adding to missing 2026-02-17T05:30:37.128 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:30:14.246+0000 7f9239fcd640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head prior_version 28'2 <= info.log_tail 28'90 2026-02-17T05:30:37.128 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:30:14.246+0000 7f9239fcd640 20 _merge_object_divergent_entries: merging hoid 1:d858c035:::existing_1:head entries: 28'103 (28'1) modify 1:d858c035:::existing_1:head by client.4541.0:1 2026-02-17T05:28:50.936691+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-17T05:30:37.128 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:30:14.246+0000 7f9239fcd640 20 _merge_object_divergent_entries: keeping 28'103 (28'1) modify 1:d858c035:::existing_1:head by client.4541.0:1 2026-02-17T05:28:50.936691+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-17T05:30:37.128 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:30:14.246+0000 7f9239fcd640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-17T05:30:37.128 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:30:14.246+0000 7f9239fcd640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head prior_version: 28'1 first_divergent_update: 28'103 last_divergent_update: 28'103 2026-02-17T05:30:37.128 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:30:14.246+0000 7f9239fcd640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head has no more recent entries in log 2026-02-17T05:30:37.128 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:30:14.246+0000 7f9239fcd640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head must be rolled back or recovered, attempting to rollback 2026-02-17T05:30:37.128 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:30:14.246+0000 7f9239fcd640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head olog_can_rollback_to: 28'106 2026-02-17T05:30:37.128 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:30:14.246+0000 7f9239fcd640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head cannot rollback 28'103 (28'1) modify 1:d858c035:::existing_1:head by client.4541.0:1 2026-02-17T05:28:50.936691+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-17T05:30:37.128 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:30:14.246+0000 7f9239fcd640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head cannot roll back, removing and adding to missing 2026-02-17T05:30:37.128 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:30:14.246+0000 7f9239fcd640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head prior_version 28'1 <= info.log_tail 28'90 2026-02-17T05:30:37.129 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:30:14.246+0000 7f9239fcd640 20 _merge_object_divergent_entries: merging hoid 1:da59f6e7:::newobject_1:head entries: 28'102 (0'0) modify 1:da59f6e7:::newobject_1:head by client.4539.0:1 2026-02-17T05:28:50.936208+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-17T05:30:37.129 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:30:14.246+0000 7f9239fcd640 20 _merge_object_divergent_entries: keeping 28'102 (0'0) modify 1:da59f6e7:::newobject_1:head by client.4539.0:1 2026-02-17T05:28:50.936208+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-17T05:30:37.129 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:30:14.246+0000 7f9239fcd640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-17T05:30:37.129 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:30:14.246+0000 7f9239fcd640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head prior_version: 0'0 first_divergent_update: 28'102 last_divergent_update: 28'102 2026-02-17T05:30:37.129 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:30:14.246+0000 7f9239fcd640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head has no more recent entries in log 2026-02-17T05:30:37.129 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:30:14.246+0000 7f9239fcd640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head prior_version or op type indicates creation, deleting 2026-02-17T05:30:37.129 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:609: TEST_divergent_2: find td/divergent-priors -name '*osd*log' 2026-02-17T05:30:37.130 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:609: TEST_divergent_2: grep -q '_merge_object_divergent_entries: more recent entry found:' td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-17T05:30:37.134 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:615: TEST_divergent_2: find td/divergent-priors -name '*osd*log' 2026-02-17T05:30:37.135 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:615: TEST_divergent_2: grep -q '_merge_object_divergent_entries.*prior_version or op type indicates creation' td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-17T05:30:37.138 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:620: TEST_divergent_2: echo success 2026-02-17T05:30:37.138 INFO:tasks.workunit.client.0.trial030.stdout:success 2026-02-17T05:30:37.138 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:622: TEST_divergent_2: rm td/divergent-priors/td/divergent-priors/exp.19532.out 2026-02-17T05:30:37.139 INFO:tasks.workunit.client.0.trial030.stderr:rm: cannot remove 'td/divergent-priors/td/divergent-priors/exp.19532.out': No such file or directory 2026-02-17T05:30:37.139 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:623: TEST_divergent_2: delete_pool test 2026-02-17T05:30:37.139 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test 2026-02-17T05:30:37.139 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2026-02-17T05:30:37.400 INFO:tasks.workunit.client.0.trial030.stderr:pool 'test' does not exist 2026-02-17T05:30:37.409 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:624: TEST_divergent_2: kill_daemons td/divergent-priors 2026-02-17T05:30:37.410 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:30:37.410 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:30:37.410 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:30:37.410 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:30:37.410 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:30:42.727 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:30:42.727 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:47: run: teardown td/divergent-priors 2026-02-17T05:30:42.727 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-17T05:30:42.727 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T05:30:42.727 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-17T05:30:42.728 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:30:42.728 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:30:42.728 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:30:42.729 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:30:42.729 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:30:42.735 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:30:42.735 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T05:30:42.736 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T05:30:42.737 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T05:30:42.738 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T05:30:42.738 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T05:30:42.739 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T05:30:42.739 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:30:42.739 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T05:30:42.740 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T05:30:42.740 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:30:42.741 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T05:30:42.742 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T05:30:42.742 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-17T05:30:42.762 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T05:30:42.762 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:30:42.762 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:30:42.762 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.19532 2026-02-17T05:30:42.763 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T05:30:42.763 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T05:30:42.763 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:44: run: for func in $funcs 2026-02-17T05:30:42.763 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:45: run: setup td/divergent-priors 2026-02-17T05:30:42.763 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/divergent-priors 2026-02-17T05:30:42.763 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/divergent-priors 2026-02-17T05:30:42.763 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-17T05:30:42.763 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T05:30:42.763 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-17T05:30:42.764 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:30:42.764 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:30:42.764 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:30:42.764 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:30:42.764 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:30:42.767 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:30:42.767 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T05:30:42.768 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T05:30:42.768 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T05:30:42.769 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T05:30:42.769 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T05:30:42.769 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T05:30:42.771 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:30:42.771 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T05:30:42.771 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T05:30:42.771 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:30:42.772 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T05:30:42.773 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T05:30:42.774 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-17T05:30:42.775 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T05:30:42.775 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:30:42.775 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:30:42.775 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.19532 2026-02-17T05:30:42.776 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T05:30:42.776 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T05:30:42.776 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/divergent-priors 2026-02-17T05:30:42.778 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T05:30:42.778 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:30:42.778 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:30:42.778 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.19532 2026-02-17T05:30:42.779 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T05:30:42.780 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-17T05:30:42.781 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T05:30:42.781 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/divergent-priors 1' TERM HUP INT 2026-02-17T05:30:42.781 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:46: run: TEST_divergent_3 td/divergent-priors 2026-02-17T05:30:42.781 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:630: TEST_divergent_3: local dir=td/divergent-priors 2026-02-17T05:30:42.781 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:632: TEST_divergent_3: file_with_random_data 2026-02-17T05:30:42.781 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=512 2026-02-17T05:30:42.781 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-17T05:30:42.782 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.XGHM5brWzT 2026-02-17T05:30:42.782 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.XGHM5brWzT bs=512 count=1 2026-02-17T05:30:42.783 INFO:tasks.workunit.client.0.trial030.stderr:1+0 records in 2026-02-17T05:30:42.783 INFO:tasks.workunit.client.0.trial030.stderr:1+0 records out 2026-02-17T05:30:42.783 INFO:tasks.workunit.client.0.trial030.stderr:512 bytes copied, 7.7373e-05 s, 6.6 MB/s 2026-02-17T05:30:42.783 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.XGHM5brWzT 2026-02-17T05:30:42.783 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:632: TEST_divergent_3: local dummyfile=/tmp/tmp.XGHM5brWzT 2026-02-17T05:30:42.784 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:634: TEST_divergent_3: file_with_random_data 1000 2026-02-17T05:30:42.784 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=1000 2026-02-17T05:30:42.784 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-17T05:30:42.785 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.vcKO1qtdwa 2026-02-17T05:30:42.785 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.vcKO1qtdwa bs=1000 count=1 2026-02-17T05:30:42.786 INFO:tasks.workunit.client.0.trial030.stderr:1+0 records in 2026-02-17T05:30:42.786 INFO:tasks.workunit.client.0.trial030.stderr:1+0 records out 2026-02-17T05:30:42.786 INFO:tasks.workunit.client.0.trial030.stderr:1000 bytes (1.0 kB) copied, 8.2062e-05 s, 12.2 MB/s 2026-02-17T05:30:42.786 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.vcKO1qtdwa 2026-02-17T05:30:42.787 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:634: TEST_divergent_3: local dummyfile2=/tmp/tmp.vcKO1qtdwa 2026-02-17T05:30:42.787 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:636: TEST_divergent_3: local num_osds=3 2026-02-17T05:30:42.787 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:637: TEST_divergent_3: expr 3 - 1 2026-02-17T05:30:42.788 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:637: TEST_divergent_3: seq 0 2 2026-02-17T05:30:42.790 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:637: TEST_divergent_3: local 'osds=0 2026-02-17T05:30:42.790 INFO:tasks.workunit.client.0.trial030.stderr:1 2026-02-17T05:30:42.790 INFO:tasks.workunit.client.0.trial030.stderr:2' 2026-02-17T05:30:42.790 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:638: TEST_divergent_3: run_mon td/divergent-priors a 2026-02-17T05:30:42.790 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/divergent-priors 2026-02-17T05:30:42.790 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T05:30:42.790 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T05:30:42.790 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T05:30:42.790 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/divergent-priors/a 2026-02-17T05:30:42.790 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/divergent-priors/a --run-dir=td/divergent-priors 2026-02-17T05:30:42.813 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T05:30:42.813 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:30:42.814 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:30:42.814 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:30:42.814 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:30:42.814 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:30:42.814 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:30:42.814 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/divergent-priors/a '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' --mon-cluster-log-file=td/divergent-priors/log --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T05:30:42.841 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T05:30:42.842 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T05:30:42.842 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T05:30:42.843 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T05:30:42.843 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T05:30:42.843 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T05:30:42.844 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T05:30:42.844 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T05:30:42.845 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T05:30:42.845 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T05:30:42.845 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:30:42.845 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:30:42.845 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19532/ceph-mon.a.asok 2026-02-17T05:30:42.845 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T05:30:42.845 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.19532/ceph-mon.a.asok config get fsid 2026-02-17T05:30:42.901 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T05:30:42.901 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T05:30:42.901 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T05:30:42.901 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T05:30:42.901 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T05:30:42.901 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T05:30:42.901 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T05:30:42.901 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T05:30:42.902 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T05:30:42.902 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:30:42.903 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:30:42.903 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19532/ceph-mon.a.asok 2026-02-17T05:30:42.903 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T05:30:42.903 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.19532/ceph-mon.a.asok config get mon_host 2026-02-17T05:30:42.958 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:639: TEST_divergent_3: run_mgr td/divergent-priors x 2026-02-17T05:30:42.958 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/divergent-priors 2026-02-17T05:30:42.958 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T05:30:42.958 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T05:30:42.958 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T05:30:42.958 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/divergent-priors/x 2026-02-17T05:30:42.958 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T05:30:43.074 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T05:30:43.074 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:30:43.074 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:30:43.074 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:30:43.074 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:30:43.075 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:30:43.075 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:30:43.075 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T05:30:43.075 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/divergent-priors/x '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T05:30:43.094 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:640: TEST_divergent_3: for i in $osds 2026-02-17T05:30:43.094 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:642: TEST_divergent_3: run_osd td/divergent-priors 0 2026-02-17T05:30:43.094 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-17T05:30:43.094 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T05:30:43.094 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T05:30:43.094 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T05:30:43.095 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/0 2026-02-17T05:30:43.095 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T05:30:43.095 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:30:43.095 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:30:43.095 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:30:43.095 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-17T05:30:43.095 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-17T05:30:43.095 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T05:30:43.095 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T05:30:43.095 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T05:30:43.095 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T05:30:43.095 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:30:43.095 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:30:43.095 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:30:43.095 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:30:43.095 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:30:43.095 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:30:43.096 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:30:43.096 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:30:43.096 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T05:30:43.096 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T05:30:43.096 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T05:30:43.096 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T05:30:43.096 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:30:43.096 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:30:43.096 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:30:43.096 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:30:43.096 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T05:30:43.096 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T05:30:43.096 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/0 2026-02-17T05:30:43.097 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T05:30:43.097 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=16e58abc-e2b0-4883-ba0a-c391c8cc9f6d 2026-02-17T05:30:43.097 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 16e58abc-e2b0-4883-ba0a-c391c8cc9f6d' 2026-02-17T05:30:43.098 INFO:tasks.workunit.client.0.trial030.stdout:add osd0 16e58abc-e2b0-4883-ba0a-c391c8cc9f6d 2026-02-17T05:30:43.098 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T05:30:43.110 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAD/ZNpCq2OBhAAFxZHMlh87/pdsT/+MWJPyA== 2026-02-17T05:30:43.110 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAD/ZNpCq2OBhAAFxZHMlh87/pdsT/+MWJPyA=="}' 2026-02-17T05:30:43.110 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 16e58abc-e2b0-4883-ba0a-c391c8cc9f6d -i td/divergent-priors/0/new.json 2026-02-17T05:30:43.223 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:30:43.230 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/0/new.json 2026-02-17T05:30:43.231 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAD/ZNpCq2OBhAAFxZHMlh87/pdsT/+MWJPyA== --osd-uuid 16e58abc-e2b0-4883-ba0a-c391c8cc9f6d 2026-02-17T05:30:43.250 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:30:43.245+0000 7f881b56ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:30:43.251 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:30:43.249+0000 7f881b56ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:30:43.252 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:30:43.249+0000 7f881b56ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:30:43.253 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:30:43.249+0000 7f881b56ea40 -1 bdev(0x55ccd82c0400 td/divergent-priors/0/block) open stat got: (1) Operation not permitted 2026-02-17T05:30:43.253 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:30:43.249+0000 7f881b56ea40 -1 bluestore(td/divergent-priors/0) _read_fsid unparsable uuid 2026-02-17T05:30:44.028 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/0/keyring 2026-02-17T05:30:44.029 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T05:30:44.030 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T05:30:44.030 INFO:tasks.workunit.client.0.trial030.stdout:adding osd0 key to auth repository 2026-02-17T05:30:44.030 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T05:30:44.154 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T05:30:44.154 INFO:tasks.workunit.client.0.trial030.stdout:start osd.0 2026-02-17T05:30:44.155 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T05:30:44.155 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T05:30:44.155 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T05:30:44.155 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T05:30:44.186 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:30:44.181+0000 7fee01b31a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:30:44.188 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:30:44.185+0000 7fee01b31a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:30:44.189 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:30:44.185+0000 7fee01b31a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:30:44.266 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T05:30:44.266 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:30:44.266 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T05:30:44.266 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:30:44.266 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:30:44.266 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:30:44.266 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:30:44.266 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:30:44.266 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:30:44.266 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T05:30:44.379 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:30:44.652 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:30:44.649+0000 7fee01b31a40 -1 Falling back to public interface 2026-02-17T05:30:45.380 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:30:45.381 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:30:45.381 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-17T05:30:45.382 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T05:30:45.382 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:30:45.382 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T05:30:45.597 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:30:45.612 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:30:45.609+0000 7fee01b31a40 -1 osd.0 0 log_to_monitors true 2026-02-17T05:30:46.599 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:30:46.599 INFO:tasks.workunit.client.0.trial030.stdout:2 2026-02-17T05:30:46.600 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:30:46.600 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T05:30:46.600 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:30:46.600 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T05:30:46.816 INFO:tasks.workunit.client.0.trial030.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/3914236386,v1:127.0.0.1:6801/3914236386] [v2:127.0.0.1:6802/3914236386,v1:127.0.0.1:6803/3914236386] exists,up 16e58abc-e2b0-4883-ba0a-c391c8cc9f6d 2026-02-17T05:30:46.817 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:30:46.817 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:30:46.817 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:30:46.817 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:640: TEST_divergent_3: for i in $osds 2026-02-17T05:30:46.817 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:642: TEST_divergent_3: run_osd td/divergent-priors 1 2026-02-17T05:30:46.817 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-17T05:30:46.817 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T05:30:46.818 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-17T05:30:46.818 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T05:30:46.818 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/1 2026-02-17T05:30:46.818 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T05:30:46.818 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:30:46.818 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:30:46.818 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:30:46.818 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-17T05:30:46.818 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-17T05:30:46.818 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T05:30:46.818 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T05:30:46.818 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T05:30:46.818 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T05:30:46.818 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:30:46.818 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:30:46.819 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:30:46.819 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:30:46.819 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:30:46.819 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:30:46.819 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:30:46.819 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:30:46.819 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T05:30:46.819 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T05:30:46.819 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T05:30:46.819 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T05:30:46.819 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:30:46.819 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:30:46.819 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:30:46.819 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:30:46.819 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T05:30:46.819 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T05:30:46.819 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/1 2026-02-17T05:30:46.820 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T05:30:46.821 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=ba7ef7d8-8279-40c2-9fe4-6d18fe327556 2026-02-17T05:30:46.821 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 ba7ef7d8-8279-40c2-9fe4-6d18fe327556' 2026-02-17T05:30:46.821 INFO:tasks.workunit.client.0.trial030.stdout:add osd1 ba7ef7d8-8279-40c2-9fe4-6d18fe327556 2026-02-17T05:30:46.822 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T05:30:46.835 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAG/ZNpku29MRAA0i5ePHczibTX1UW782I2TA== 2026-02-17T05:30:46.835 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAG/ZNpku29MRAA0i5ePHczibTX1UW782I2TA=="}' 2026-02-17T05:30:46.835 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new ba7ef7d8-8279-40c2-9fe4-6d18fe327556 -i td/divergent-priors/1/new.json 2026-02-17T05:30:47.067 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-17T05:30:47.075 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/1/new.json 2026-02-17T05:30:47.076 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAG/ZNpku29MRAA0i5ePHczibTX1UW782I2TA== --osd-uuid ba7ef7d8-8279-40c2-9fe4-6d18fe327556 2026-02-17T05:30:47.096 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:30:47.093+0000 7f342fa9aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:30:47.097 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:30:47.093+0000 7f342fa9aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:30:47.098 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:30:47.097+0000 7f342fa9aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:30:47.099 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:30:47.097+0000 7f342fa9aa40 -1 bdev(0x563f72596400 td/divergent-priors/1/block) open stat got: (1) Operation not permitted 2026-02-17T05:30:47.099 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:30:47.097+0000 7f342fa9aa40 -1 bluestore(td/divergent-priors/1) _read_fsid unparsable uuid 2026-02-17T05:30:47.777 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/1/keyring 2026-02-17T05:30:47.777 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T05:30:47.778 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-17T05:30:47.779 INFO:tasks.workunit.client.0.trial030.stdout:adding osd1 key to auth repository 2026-02-17T05:30:47.779 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T05:30:48.071 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-17T05:30:48.072 INFO:tasks.workunit.client.0.trial030.stdout:start osd.1 2026-02-17T05:30:48.073 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T05:30:48.073 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T05:30:48.073 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T05:30:48.073 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T05:30:48.100 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:30:48.096+0000 7f59ba4bea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:30:48.102 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:30:48.096+0000 7f59ba4bea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:30:48.103 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:30:48.100+0000 7f59ba4bea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:30:48.285 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-17T05:30:48.285 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:30:48.285 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T05:30:48.285 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:30:48.286 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:30:48.286 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:30:48.286 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:30:48.287 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:30:48.287 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:30:48.287 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T05:30:48.506 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:30:48.508 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:30:48.504+0000 7f59ba4bea40 -1 Falling back to public interface 2026-02-17T05:30:49.079 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:30:49.076+0000 7f59ba4bea40 -1 osd.1 0 log_to_monitors true 2026-02-17T05:30:49.507 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:30:49.507 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:30:49.508 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-17T05:30:49.508 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T05:30:49.508 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T05:30:49.508 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:30:49.732 INFO:tasks.workunit.client.0.trial030.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3197791047,v1:127.0.0.1:6811/3197791047] [v2:127.0.0.1:6812/3197791047,v1:127.0.0.1:6813/3197791047] exists,up ba7ef7d8-8279-40c2-9fe4-6d18fe327556 2026-02-17T05:30:49.736 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:30:49.736 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:30:49.736 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:30:49.736 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:640: TEST_divergent_3: for i in $osds 2026-02-17T05:30:49.736 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:642: TEST_divergent_3: run_osd td/divergent-priors 2 2026-02-17T05:30:49.737 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-17T05:30:49.737 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T05:30:49.737 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-17T05:30:49.737 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T05:30:49.737 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/2 2026-02-17T05:30:49.737 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T05:30:49.737 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:30:49.737 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:30:49.737 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:30:49.738 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-17T05:30:49.738 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-17T05:30:49.738 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T05:30:49.738 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T05:30:49.738 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T05:30:49.738 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T05:30:49.738 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:30:49.738 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:30:49.738 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:30:49.738 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:30:49.738 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:30:49.739 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:30:49.739 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:30:49.739 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:30:49.739 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T05:30:49.739 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T05:30:49.739 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T05:30:49.739 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T05:30:49.739 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:30:49.739 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:30:49.739 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:30:49.740 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:30:49.740 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T05:30:49.740 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T05:30:49.740 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/2 2026-02-17T05:30:49.740 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T05:30:49.740 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=d26fa46f-e265-43ba-83d2-985666052fe3 2026-02-17T05:30:49.740 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 d26fa46f-e265-43ba-83d2-985666052fe3' 2026-02-17T05:30:49.741 INFO:tasks.workunit.client.0.trial030.stdout:add osd2 d26fa46f-e265-43ba-83d2-985666052fe3 2026-02-17T05:30:49.741 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T05:30:49.751 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAJ/ZNpAXCxLBAAYhyBAmhnI14yWeRseaNZqg== 2026-02-17T05:30:49.751 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAJ/ZNpAXCxLBAAYhyBAmhnI14yWeRseaNZqg=="}' 2026-02-17T05:30:49.751 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new d26fa46f-e265-43ba-83d2-985666052fe3 -i td/divergent-priors/2/new.json 2026-02-17T05:30:49.967 INFO:tasks.workunit.client.0.trial030.stdout:2 2026-02-17T05:30:49.977 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/2/new.json 2026-02-17T05:30:49.977 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAJ/ZNpAXCxLBAAYhyBAmhnI14yWeRseaNZqg== --osd-uuid d26fa46f-e265-43ba-83d2-985666052fe3 2026-02-17T05:30:49.998 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:30:49.992+0000 7f654dae0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:30:49.999 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:30:49.996+0000 7f654dae0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:30:50.000 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:30:49.996+0000 7f654dae0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:30:50.001 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:30:49.996+0000 7f654dae0a40 -1 bdev(0x555a656a8400 td/divergent-priors/2/block) open stat got: (1) Operation not permitted 2026-02-17T05:30:50.001 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:30:49.996+0000 7f654dae0a40 -1 bluestore(td/divergent-priors/2) _read_fsid unparsable uuid 2026-02-17T05:30:50.829 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/2/keyring 2026-02-17T05:30:50.829 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T05:30:50.830 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-17T05:30:50.830 INFO:tasks.workunit.client.0.trial030.stdout:adding osd2 key to auth repository 2026-02-17T05:30:50.831 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T05:30:51.128 INFO:tasks.workunit.client.0.trial030.stdout:start osd.2 2026-02-17T05:30:51.129 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-17T05:30:51.129 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T05:30:51.129 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T05:30:51.129 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T05:30:51.129 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T05:30:51.158 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:30:51.152+0000 7f84bed53a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:30:51.159 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:30:51.156+0000 7f84bed53a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:30:51.161 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:30:51.156+0000 7f84bed53a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:30:51.348 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-17T05:30:51.348 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:30:51.348 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T05:30:51.348 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:30:51.348 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:30:51.349 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:30:51.349 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:30:51.349 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:30:51.349 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:30:51.349 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T05:30:51.540 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:30:51.536+0000 7f84bed53a40 -1 Falling back to public interface 2026-02-17T05:30:51.568 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:30:52.155 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:30:52.152+0000 7f84bed53a40 -1 osd.2 0 log_to_monitors true 2026-02-17T05:30:52.569 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:30:52.569 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:30:52.569 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-17T05:30:52.570 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T05:30:52.570 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:30:52.570 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T05:30:52.787 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:30:53.789 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:30:53.789 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:30:53.790 INFO:tasks.workunit.client.0.trial030.stdout:2 2026-02-17T05:30:53.790 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T05:30:53.790 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:30:53.791 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T05:30:54.004 INFO:tasks.workunit.client.0.trial030.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2593407807,v1:127.0.0.1:6819/2593407807] [v2:127.0.0.1:6820/2593407807,v1:127.0.0.1:6821/2593407807] exists,up d26fa46f-e265-43ba-83d2-985666052fe3 2026-02-17T05:30:54.005 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:30:54.005 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:30:54.005 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:30:54.005 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:645: TEST_divergent_3: ceph osd set noout 2026-02-17T05:30:54.297 INFO:tasks.workunit.client.0.trial030.stderr:noout is set 2026-02-17T05:30:54.308 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:646: TEST_divergent_3: ceph osd set noin 2026-02-17T05:30:54.601 INFO:tasks.workunit.client.0.trial030.stderr:noin is set 2026-02-17T05:30:54.611 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:647: TEST_divergent_3: ceph osd set nodown 2026-02-17T05:30:54.906 INFO:tasks.workunit.client.0.trial030.stderr:nodown is set 2026-02-17T05:30:54.918 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:648: TEST_divergent_3: create_pool test 1 1 2026-02-17T05:30:54.918 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2026-02-17T05:30:55.164 INFO:tasks.workunit.client.0.trial030.stderr:pool 'test' already exists 2026-02-17T05:30:55.175 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T05:30:56.176 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:649: TEST_divergent_3: ceph osd pool set test size 3 2026-02-17T05:30:56.487 INFO:tasks.workunit.client.0.trial030.stderr:set pool 1 size to 3 2026-02-17T05:30:56.499 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:650: TEST_divergent_3: ceph osd pool set test min_size 2 2026-02-17T05:30:56.792 INFO:tasks.workunit.client.0.trial030.stderr:set pool 1 min_size to 2 2026-02-17T05:30:56.804 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:653: TEST_divergent_3: ceph osd pool set test pg_autoscale_mode on 2026-02-17T05:30:57.097 INFO:tasks.workunit.client.0.trial030.stderr:set pool 1 pg_autoscale_mode to on 2026-02-17T05:30:57.109 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:655: TEST_divergent_3: divergent=-1 2026-02-17T05:30:57.110 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:656: TEST_divergent_3: date +%s 2026-02-17T05:30:57.112 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:656: TEST_divergent_3: start_time=1771306257 2026-02-17T05:30:57.112 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:657: TEST_divergent_3: max_duration=300 2026-02-17T05:30:57.112 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:659: TEST_divergent_3: '[' -1 -le -1 ']' 2026-02-17T05:30:57.112 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:661: TEST_divergent_3: flush_pg_stats 2026-02-17T05:30:57.112 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T05:30:57.112 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:30:57.332 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:30:57.332 INFO:tasks.workunit.client.0.trial030.stderr:1 2026-02-17T05:30:57.333 INFO:tasks.workunit.client.0.trial030.stderr:2' 2026-02-17T05:30:57.333 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:30:57.333 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:30:57.333 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T05:30:57.418 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836485 2026-02-17T05:30:57.418 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836485 2026-02-17T05:30:57.418 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485' 2026-02-17T05:30:57.418 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:30:57.418 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T05:30:57.498 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705668 2026-02-17T05:30:57.498 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705668 2026-02-17T05:30:57.499 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-38654705668' 2026-02-17T05:30:57.499 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:30:57.499 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T05:30:57.580 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542147 2026-02-17T05:30:57.580 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542147 2026-02-17T05:30:57.580 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-38654705668 2-60129542147' 2026-02-17T05:30:57.580 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:30:57.580 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836485 2026-02-17T05:30:57.580 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:30:57.581 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:30:57.581 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836485 2026-02-17T05:30:57.582 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:30:57.583 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836485 2026-02-17T05:30:57.583 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2026-02-17T05:30:57.584 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.0 seq 21474836485 2026-02-17T05:30:57.584 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:30:57.801 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836485 2026-02-17T05:30:57.801 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:30:58.802 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T05:30:58.803 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:30:59.024 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836485 2026-02-17T05:30:59.025 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:31:00.026 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T05:31:00.026 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:31:00.249 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836485 -lt 21474836485 2026-02-17T05:31:00.249 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:31:00.250 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705668 2026-02-17T05:31:00.250 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:31:00.251 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:31:00.251 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705668 2026-02-17T05:31:00.252 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:31:00.253 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705668 2026-02-17T05:31:00.253 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.1 seq 38654705668 2026-02-17T05:31:00.253 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705668' 2026-02-17T05:31:00.254 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:31:00.478 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705668 -lt 38654705668 2026-02-17T05:31:00.478 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:31:00.478 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542147 2026-02-17T05:31:00.479 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:31:00.480 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:31:00.480 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542147 2026-02-17T05:31:00.480 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:31:00.482 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542147 2026-02-17T05:31:00.482 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542147' 2026-02-17T05:31:00.482 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.2 seq 60129542147 2026-02-17T05:31:00.482 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:31:00.707 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542148 -lt 60129542147 2026-02-17T05:31:00.707 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:662: TEST_divergent_3: wait_for_clean 2026-02-17T05:31:00.707 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T05:31:00.708 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T05:31:00.708 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T05:31:00.708 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T05:31:00.708 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T05:31:00.708 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T05:31:00.709 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T05:31:00.709 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T05:31:00.709 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T05:31:00.816 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T05:31:00.816 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T05:31:00.816 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T05:31:00.816 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T05:31:00.816 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T05:31:00.817 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:31:01.038 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:31:01.038 INFO:tasks.workunit.client.0.trial030.stderr:1 2026-02-17T05:31:01.038 INFO:tasks.workunit.client.0.trial030.stderr:2' 2026-02-17T05:31:01.038 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:31:01.038 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:31:01.039 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T05:31:01.125 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-17T05:31:01.125 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-17T05:31:01.126 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487' 2026-02-17T05:31:01.126 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:31:01.126 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T05:31:01.208 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705671 2026-02-17T05:31:01.208 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705671 2026-02-17T05:31:01.208 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-38654705671' 2026-02-17T05:31:01.208 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:31:01.208 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T05:31:01.292 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542150 2026-02-17T05:31:01.292 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542150 2026-02-17T05:31:01.292 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-38654705671 2-60129542150' 2026-02-17T05:31:01.292 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:31:01.292 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836487 2026-02-17T05:31:01.292 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:31:01.293 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:31:01.294 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-17T05:31:01.294 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:31:01.295 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836487 2026-02-17T05:31:01.296 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.0 seq 21474836487 2026-02-17T05:31:01.296 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-17T05:31:01.296 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:31:01.507 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-17T05:31:01.507 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:31:01.507 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705671 2026-02-17T05:31:01.507 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:31:01.508 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:31:01.509 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705671 2026-02-17T05:31:01.509 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:31:01.511 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705671 2026-02-17T05:31:01.511 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.1 seq 38654705671 2026-02-17T05:31:01.511 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705671' 2026-02-17T05:31:01.511 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:31:01.734 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705671 -lt 38654705671 2026-02-17T05:31:01.734 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:31:01.735 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542150 2026-02-17T05:31:01.735 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:31:01.736 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:31:01.736 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542150 2026-02-17T05:31:01.737 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:31:01.738 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542150 2026-02-17T05:31:01.738 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.2 seq 60129542150 2026-02-17T05:31:01.739 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542150' 2026-02-17T05:31:01.739 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:31:01.964 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542150 -lt 60129542150 2026-02-17T05:31:01.964 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T05:31:01.965 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:31:01.965 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:31:02.258 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T05:31:02.258 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:31:02.258 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:31:02.258 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:31:02.259 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:31:02.259 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:31:02.259 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:31:02.259 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:31:02.472 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T05:31:02.473 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:31:02.473 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:31:02.473 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:31:02.758 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T05:31:02.759 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T05:31:02.759 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T05:31:02.760 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:665: TEST_divergent_3: ceph pg dump pgs --format=json 2026-02-17T05:31:02.760 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:665: TEST_divergent_3: jq '.pg_stats[0].up_primary' 2026-02-17T05:31:02.961 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:31:02.970 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:665: TEST_divergent_3: divergent=1 2026-02-17T05:31:02.970 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:666: TEST_divergent_3: echo 'primary and soon to be divergent is 1' 2026-02-17T05:31:02.971 INFO:tasks.workunit.client.0.trial030.stdout:primary and soon to be divergent is 1 2026-02-17T05:31:02.971 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:667: TEST_divergent_3: ceph pg dump pgs 2026-02-17T05:31:03.182 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T05:31:03.182 INFO:tasks.workunit.client.0.trial030.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T05:30:56.439084+0000 0'0 29:24 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 periodic scrub scheduled @ 2026-02-18T10:00:46.115098+0000 0 0 2026-02-17T05:31:03.182 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-17T05:31:03.182 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T05:31:03.182 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:31:03.191 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:669: TEST_divergent_3: date +%s 2026-02-17T05:31:03.192 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:669: TEST_divergent_3: current_time=1771306263 2026-02-17T05:31:03.193 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:670: TEST_divergent_3: expr 1771306263 - 1771306257 2026-02-17T05:31:03.194 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:670: TEST_divergent_3: elapsed_time=6 2026-02-17T05:31:03.194 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: '[' 6 -gt 300 ']' 2026-02-17T05:31:03.194 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:659: TEST_divergent_3: '[' 1 -le -1 ']' 2026-02-17T05:31:03.194 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:677: TEST_divergent_3: local non_divergent= 2026-02-17T05:31:03.194 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:678: TEST_divergent_3: for i in $osds 2026-02-17T05:31:03.194 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:680: TEST_divergent_3: '[' 0 = 1 ']' 2026-02-17T05:31:03.194 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:683: TEST_divergent_3: non_divergent=' 0' 2026-02-17T05:31:03.194 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:678: TEST_divergent_3: for i in $osds 2026-02-17T05:31:03.195 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:680: TEST_divergent_3: '[' 1 = 1 ']' 2026-02-17T05:31:03.195 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:681: TEST_divergent_3: continue 2026-02-17T05:31:03.195 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:678: TEST_divergent_3: for i in $osds 2026-02-17T05:31:03.195 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:680: TEST_divergent_3: '[' 2 = 1 ']' 2026-02-17T05:31:03.195 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:683: TEST_divergent_3: non_divergent=' 0 2' 2026-02-17T05:31:03.195 INFO:tasks.workunit.client.0.trial030.stdout:writing initial objects 2026-02-17T05:31:03.195 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: echo 'writing initial objects' 2026-02-17T05:31:03.195 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: seq 1 100 2026-02-17T05:31:03.196 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:03.196 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_1 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:03.219 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:03.219 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_2 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:03.248 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:03.248 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_3 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:03.275 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:03.275 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_4 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:03.302 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:03.303 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_5 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:03.322 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:03.322 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_6 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:03.351 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:03.352 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_7 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:03.378 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:03.379 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_8 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:03.398 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:03.398 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_9 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:03.428 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:03.428 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_10 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:03.455 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:03.455 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_11 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:03.482 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:03.482 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_12 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:03.512 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:03.512 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_13 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:03.540 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:03.541 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_14 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:03.569 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:03.569 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_15 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:03.597 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:03.597 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_16 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:03.625 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:03.625 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_17 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:03.652 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:03.652 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_18 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:03.680 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:03.681 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_19 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:03.708 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:03.708 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_20 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:03.736 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:03.736 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_21 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:03.764 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:03.764 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_22 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:03.792 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:03.792 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_23 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:03.821 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:03.821 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_24 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:03.849 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:03.849 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_25 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:03.877 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:03.877 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_26 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:03.905 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:03.905 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_27 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:03.933 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:03.933 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_28 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:03.961 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:03.961 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_29 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:03.990 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:03.990 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_30 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:04.017 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:04.017 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_31 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:04.045 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:04.045 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_32 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:04.074 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:04.074 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_33 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:04.101 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:04.102 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_34 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:04.128 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:04.129 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_35 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:04.157 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:04.157 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_36 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:04.184 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:04.184 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_37 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:04.212 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:04.212 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_38 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:04.240 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:04.240 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_39 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:04.260 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:04.260 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_40 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:04.280 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:04.280 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_41 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:04.309 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:04.309 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_42 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:04.336 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:04.336 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_43 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:04.365 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:04.365 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_44 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:04.392 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:04.393 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_45 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:04.420 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:04.420 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_46 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:04.449 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:04.449 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_47 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:04.475 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:04.475 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_48 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:04.504 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:04.504 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_49 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:04.532 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:04.532 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_50 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:04.561 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:04.561 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_51 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:04.588 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:04.589 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_52 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:04.616 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:04.617 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_53 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:04.645 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:04.645 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_54 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:04.665 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:04.665 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_55 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:04.694 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:04.694 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_56 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:04.721 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:04.721 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_57 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:04.748 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:04.749 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_58 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:04.776 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:04.777 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_59 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:04.805 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:04.805 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_60 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:04.832 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:04.833 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_61 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:04.861 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:04.861 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_62 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:04.888 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:04.888 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_63 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:04.916 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:04.917 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_64 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:04.945 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:04.945 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_65 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:04.973 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:04.973 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_66 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:05.001 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:05.001 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_67 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:05.028 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:05.029 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_68 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:05.057 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:05.057 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_69 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:05.084 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:05.084 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_70 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:05.112 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:05.112 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_71 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:05.141 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:05.141 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_72 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:05.168 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:05.168 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_73 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:05.197 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:05.197 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_74 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:05.225 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:05.225 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_75 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:05.252 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:05.253 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_76 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:05.280 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:05.280 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_77 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:05.309 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:05.309 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_78 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:05.337 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:05.337 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_79 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:05.365 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:05.365 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_80 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:05.392 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:05.393 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_81 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:05.420 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:05.420 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_82 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:05.448 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:05.448 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_83 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:05.477 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:05.477 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_84 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:05.505 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:05.505 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_85 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:05.533 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:05.533 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_86 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:05.561 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:05.561 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_87 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:05.589 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:05.589 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_88 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:05.617 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:05.617 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_89 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:05.645 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:05.645 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_90 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:05.673 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:05.673 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_91 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:05.702 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:05.702 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_92 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:05.731 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:05.731 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_93 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:05.752 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:05.752 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_94 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:05.772 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:05.773 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_95 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:05.801 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:05.801 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_96 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:05.829 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:05.829 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_97 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:05.857 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:05.857 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_98 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:05.884 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:05.884 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_99 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:05.912 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T05:31:05.912 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_100 /tmp/tmp.XGHM5brWzT 2026-02-17T05:31:05.940 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:693: TEST_divergent_3: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-17T05:31:05.940 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:693: TEST_divergent_3: wait_for_clean 2026-02-17T05:31:05.940 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T05:31:05.941 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T05:31:05.941 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T05:31:05.941 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-17T05:31:05.941 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T05:31:05.942 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T05:31:05.942 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T05:31:05.942 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T05:31:05.942 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T05:31:06.011 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-17T05:31:06.012 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T05:31:06.012 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T05:31:06.012 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T05:31:06.012 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T05:31:06.012 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:31:06.229 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:31:06.229 INFO:tasks.workunit.client.0.trial030.stderr:1 2026-02-17T05:31:06.229 INFO:tasks.workunit.client.0.trial030.stderr:2' 2026-02-17T05:31:06.229 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:31:06.229 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:31:06.229 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T05:31:06.312 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836490 2026-02-17T05:31:06.313 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836490 2026-02-17T05:31:06.313 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490' 2026-02-17T05:31:06.313 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:31:06.313 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T05:31:06.394 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705674 2026-02-17T05:31:06.394 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705674 2026-02-17T05:31:06.394 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490 1-38654705674' 2026-02-17T05:31:06.395 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:31:06.395 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T05:31:06.474 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542153 2026-02-17T05:31:06.474 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542153 2026-02-17T05:31:06.474 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490 1-38654705674 2-60129542153' 2026-02-17T05:31:06.474 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:31:06.475 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836490 2026-02-17T05:31:06.475 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:31:06.476 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:31:06.477 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836490 2026-02-17T05:31:06.477 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:31:06.478 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836490 2026-02-17T05:31:06.478 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836490' 2026-02-17T05:31:06.479 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.0 seq 21474836490 2026-02-17T05:31:06.479 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:31:06.696 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836488 -lt 21474836490 2026-02-17T05:31:06.696 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:31:07.698 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T05:31:07.698 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:31:07.914 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836491 -lt 21474836490 2026-02-17T05:31:07.915 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:31:07.915 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705674 2026-02-17T05:31:07.915 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:31:07.917 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:31:07.917 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705674 2026-02-17T05:31:07.918 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:31:07.919 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705674 2026-02-17T05:31:07.919 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705674' 2026-02-17T05:31:07.919 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.1 seq 38654705674 2026-02-17T05:31:07.920 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:31:08.140 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705674 -lt 38654705674 2026-02-17T05:31:08.140 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:31:08.141 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542153 2026-02-17T05:31:08.141 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:31:08.141 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:31:08.142 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542153 2026-02-17T05:31:08.142 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:31:08.144 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542153 2026-02-17T05:31:08.144 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542153' 2026-02-17T05:31:08.144 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.2 seq 60129542153 2026-02-17T05:31:08.144 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:31:08.373 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542153 -lt 60129542153 2026-02-17T05:31:08.373 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T05:31:08.374 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:31:08.374 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:31:08.672 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T05:31:08.672 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:31:08.673 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:31:08.673 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:31:08.673 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:31:08.673 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:31:08.674 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:31:08.674 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:31:08.894 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T05:31:08.895 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:31:08.895 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:31:08.896 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:31:09.180 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T05:31:09.180 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T05:31:09.180 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T05:31:09.180 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:695: TEST_divergent_3: get_pg test existing_1 2026-02-17T05:31:09.181 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=test 2026-02-17T05:31:09.181 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=existing_1 2026-02-17T05:31:09.181 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map test existing_1 2026-02-17T05:31:09.181 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-17T05:31:09.403 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:695: TEST_divergent_3: local pgid=1.0 2026-02-17T05:31:09.404 INFO:tasks.workunit.client.0.trial030.stdout:blackholing osds 0 2 2026-02-17T05:31:09.404 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:698: TEST_divergent_3: echo 'blackholing osds 0 2' 2026-02-17T05:31:09.405 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:699: TEST_divergent_3: ceph pg dump pgs 2026-02-17T05:31:09.613 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T05:31:09.613 INFO:tasks.workunit.client.0.trial030.stdout:1.0 100 0 0 0 0 51200 0 0 16 84 16 active+clean 2026-02-17T05:30:56.439084+0000 29'100 29:124 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 periodic scrub scheduled @ 2026-02-18T10:00:46.115098+0000 0 0 2026-02-17T05:31:09.613 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-17T05:31:09.613 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T05:31:09.613 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:31:09.622 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:700: TEST_divergent_3: for i in $non_divergent 2026-02-17T05:31:09.623 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: get_asok_path osd.0 2026-02-17T05:31:09.623 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-17T05:31:09.623 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-17T05:31:09.623 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T05:31:09.623 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:31:09.623 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:31:09.624 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19532/ceph-osd.0.asok 2026-02-17T05:31:09.624 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: CEPH_ARGS= 2026-02-17T05:31:09.624 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.19532/ceph-osd.0.asok config set objectstore_blackhole 1 2026-02-17T05:31:09.679 INFO:tasks.workunit.client.0.trial030.stdout:{ 2026-02-17T05:31:09.679 INFO:tasks.workunit.client.0.trial030.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-17T05:31:09.680 INFO:tasks.workunit.client.0.trial030.stdout:} 2026-02-17T05:31:09.685 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:700: TEST_divergent_3: for i in $non_divergent 2026-02-17T05:31:09.686 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: get_asok_path osd.2 2026-02-17T05:31:09.686 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-17T05:31:09.686 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-17T05:31:09.686 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T05:31:09.686 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:31:09.687 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:31:09.687 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19532/ceph-osd.2.asok 2026-02-17T05:31:09.687 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: CEPH_ARGS= 2026-02-17T05:31:09.687 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.19532/ceph-osd.2.asok config set objectstore_blackhole 1 2026-02-17T05:31:09.741 INFO:tasks.workunit.client.0.trial030.stdout:{ 2026-02-17T05:31:09.742 INFO:tasks.workunit.client.0.trial030.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-17T05:31:09.742 INFO:tasks.workunit.client.0.trial030.stdout:} 2026-02-17T05:31:09.747 INFO:tasks.workunit.client.0.trial030.stdout:create new divergent objects 2026-02-17T05:31:09.748 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:706: TEST_divergent_3: echo 'create new divergent objects' 2026-02-17T05:31:09.748 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:707: TEST_divergent_3: seq 1 2 2026-02-17T05:31:09.748 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:707: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-17T05:31:09.748 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:707: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-17T05:31:09.749 INFO:tasks.workunit.client.0.trial030.stdout:writing divergent objects 2026-02-17T05:31:09.749 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:712: TEST_divergent_3: echo 'writing divergent objects' 2026-02-17T05:31:09.750 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:709: TEST_divergent_3: rados -p test create newobject_1 2026-02-17T05:31:09.750 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:709: TEST_divergent_3: rados -p test create newobject_2 2026-02-17T05:31:09.750 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:713: TEST_divergent_3: seq 1 2 2026-02-17T05:31:09.751 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:713: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_WRITE) 2026-02-17T05:31:09.751 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:713: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_WRITE) 2026-02-17T05:31:09.751 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:715: TEST_divergent_3: rados -p test put existing_1 /tmp/tmp.vcKO1qtdwa 2026-02-17T05:31:09.751 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:718: TEST_divergent_3: echo 'remove divergent objects' 2026-02-17T05:31:09.751 INFO:tasks.workunit.client.0.trial030.stdout:remove divergent objects 2026-02-17T05:31:09.752 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:715: TEST_divergent_3: rados -p test put existing_2 /tmp/tmp.vcKO1qtdwa 2026-02-17T05:31:09.752 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:719: TEST_divergent_3: seq 1 2 2026-02-17T05:31:09.752 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:719: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_REMOVE) 2026-02-17T05:31:09.752 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:721: TEST_divergent_3: expr 1 + 2 2026-02-17T05:31:09.753 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:721: TEST_divergent_3: rmi=3 2026-02-17T05:31:09.754 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:719: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_REMOVE) 2026-02-17T05:31:09.754 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:722: TEST_divergent_3: rados -p test rm existing_3 2026-02-17T05:31:09.754 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:721: TEST_divergent_3: expr 2 + 2 2026-02-17T05:31:09.755 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:721: TEST_divergent_3: rmi=4 2026-02-17T05:31:09.756 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:724: TEST_divergent_3: sleep 10 2026-02-17T05:31:09.756 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:722: TEST_divergent_3: rados -p test rm existing_4 2026-02-17T05:31:19.757 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:725: TEST_divergent_3: killall -9 rados 2026-02-17T05:31:19.811 INFO:tasks.workunit.client.0.trial030.stderr:rados: no process found 2026-02-17T05:31:19.812 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:728: TEST_divergent_3: echo 'killing all the osds' 2026-02-17T05:31:19.812 INFO:tasks.workunit.client.0.trial030.stdout:killing all the osds 2026-02-17T05:31:19.812 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:729: TEST_divergent_3: ceph pg dump pgs 2026-02-17T05:31:20.031 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T05:31:20.031 INFO:tasks.workunit.client.0.trial030.stdout:1.0 100 0 0 0 0 51152 0 0 16 90 16 active+clean 2026-02-17T05:30:56.439084+0000 29'106 29:130 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 periodic scrub scheduled @ 2026-02-18T10:00:46.115098+0000 0 0 2026-02-17T05:31:20.031 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-17T05:31:20.031 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T05:31:20.031 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:31:20.040 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:730: TEST_divergent_3: kill_daemons td/divergent-priors KILL osd 2026-02-17T05:31:20.041 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:31:20.041 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:31:20.041 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:31:20.041 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:31:20.041 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:31:20.150 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:31:20.150 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:731: TEST_divergent_3: for i in $osds 2026-02-17T05:31:20.150 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:733: TEST_divergent_3: ceph osd down osd.0 2026-02-17T05:31:20.413 INFO:tasks.workunit.client.0.trial030.stderr:osd.0 is already down. 2026-02-17T05:31:20.422 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:731: TEST_divergent_3: for i in $osds 2026-02-17T05:31:20.423 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:733: TEST_divergent_3: ceph osd down osd.1 2026-02-17T05:31:20.687 INFO:tasks.workunit.client.0.trial030.stderr:osd.1 is already down. 2026-02-17T05:31:20.698 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:731: TEST_divergent_3: for i in $osds 2026-02-17T05:31:20.698 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:733: TEST_divergent_3: ceph osd down osd.2 2026-02-17T05:31:20.974 INFO:tasks.workunit.client.0.trial030.stderr:osd.2 is already down. 2026-02-17T05:31:20.984 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:735: TEST_divergent_3: for i in $non_divergent 2026-02-17T05:31:20.984 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:737: TEST_divergent_3: ceph osd out osd.0 2026-02-17T05:31:21.263 INFO:tasks.workunit.client.0.trial030.stderr:osd.0 is already out. 2026-02-17T05:31:21.275 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:735: TEST_divergent_3: for i in $non_divergent 2026-02-17T05:31:21.275 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:737: TEST_divergent_3: ceph osd out osd.2 2026-02-17T05:31:21.555 INFO:tasks.workunit.client.0.trial030.stderr:osd.2 is already out. 2026-02-17T05:31:21.565 INFO:tasks.workunit.client.0.trial030.stdout:bringing up non_divergent 0 2 2026-02-17T05:31:21.566 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:741: TEST_divergent_3: echo 'bringing up non_divergent 0 2' 2026-02-17T05:31:21.566 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:742: TEST_divergent_3: ceph pg dump pgs 2026-02-17T05:31:21.787 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T05:31:21.787 INFO:tasks.workunit.client.0.trial030.stdout:1.0 100 0 0 0 0 51152 0 0 16 90 16 stale+active+clean 2026-02-17T05:30:56.439084+0000 29'106 29:130 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 periodic scrub scheduled @ 2026-02-18T10:00:46.115098+0000 0 0 2026-02-17T05:31:21.787 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-17T05:31:21.788 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T05:31:21.788 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:31:21.798 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:743: TEST_divergent_3: for i in $non_divergent 2026-02-17T05:31:21.799 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:745: TEST_divergent_3: activate_osd td/divergent-priors 0 2026-02-17T05:31:21.799 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-17T05:31:21.799 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T05:31:21.799 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T05:31:21.799 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T05:31:21.799 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/0 2026-02-17T05:31:21.799 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T05:31:21.799 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:31:21.799 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:31:21.799 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:31:21.800 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-17T05:31:21.800 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-17T05:31:21.800 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T05:31:21.800 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T05:31:21.800 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T05:31:21.800 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T05:31:21.800 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:31:21.800 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:31:21.800 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:31:21.800 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:31:21.800 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:31:21.800 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:31:21.801 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:31:21.801 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:31:21.801 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T05:31:21.801 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T05:31:21.801 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:31:21.801 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:31:21.801 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:31:21.801 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:31:21.801 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T05:31:21.801 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T05:31:21.801 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/0 2026-02-17T05:31:21.802 INFO:tasks.workunit.client.0.trial030.stdout:start osd.0 2026-02-17T05:31:21.803 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T05:31:21.803 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T05:31:21.803 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/0/whoami 2026-02-17T05:31:21.803 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T05:31:21.803 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T05:31:21.803 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T05:31:21.803 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T05:31:21.822 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:31:21.815+0000 7fe29e1f1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:31:21.824 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:31:21.819+0000 7fe29e1f1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:31:21.825 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:31:21.819+0000 7fe29e1f1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:31:22.027 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T05:31:22.027 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:31:22.027 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T05:31:22.027 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:31:22.027 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:31:22.027 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:31:22.027 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:31:22.028 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:31:22.028 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:31:22.028 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T05:31:22.224 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:31:22.219+0000 7fe29e1f1a40 -1 Falling back to public interface 2026-02-17T05:31:22.247 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:31:22.816 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:31:22.811+0000 7fe29e1f1a40 -1 osd.0 29 log_to_monitors true 2026-02-17T05:31:23.248 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:31:23.248 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:31:23.248 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T05:31:23.249 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-17T05:31:23.249 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:31:23.249 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T05:31:23.468 INFO:tasks.workunit.client.0.trial030.stdout:osd.0 up out weight 0 up_from 36 up_thru 0 down_at 30 last_clean_interval [5,29) [v2:127.0.0.1:6800/3611726545,v1:127.0.0.1:6801/3611726545] [v2:127.0.0.1:6802/3611726545,v1:127.0.0.1:6803/3611726545] exists,up 16e58abc-e2b0-4883-ba0a-c391c8cc9f6d 2026-02-17T05:31:23.469 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:31:23.469 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:31:23.469 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:31:23.469 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:743: TEST_divergent_3: for i in $non_divergent 2026-02-17T05:31:23.469 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:745: TEST_divergent_3: activate_osd td/divergent-priors 2 2026-02-17T05:31:23.469 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-17T05:31:23.469 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T05:31:23.469 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-17T05:31:23.469 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T05:31:23.469 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/2 2026-02-17T05:31:23.469 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T05:31:23.469 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:31:23.469 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:31:23.469 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:31:23.469 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-17T05:31:23.469 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-17T05:31:23.469 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T05:31:23.469 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T05:31:23.469 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T05:31:23.469 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T05:31:23.469 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:31:23.469 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:31:23.469 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:31:23.469 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:31:23.469 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:31:23.470 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:31:23.470 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:31:23.470 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:31:23.470 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T05:31:23.470 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T05:31:23.470 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:31:23.470 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:31:23.470 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:31:23.470 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:31:23.470 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T05:31:23.470 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T05:31:23.470 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/2 2026-02-17T05:31:23.471 INFO:tasks.workunit.client.0.trial030.stdout:start osd.2 2026-02-17T05:31:23.471 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-17T05:31:23.471 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T05:31:23.471 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/2/whoami 2026-02-17T05:31:23.472 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-17T05:31:23.473 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T05:31:23.473 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T05:31:23.473 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T05:31:23.494 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:31:23.487+0000 7fa5f8545a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:31:23.495 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:31:23.491+0000 7fa5f8545a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:31:23.496 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:31:23.491+0000 7fa5f8545a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:31:23.694 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-17T05:31:23.694 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:31:23.694 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T05:31:23.694 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:31:23.694 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:31:23.694 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:31:23.695 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:31:23.695 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:31:23.695 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:31:23.695 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T05:31:23.856 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:31:23.851+0000 7fa5f8545a40 -1 Falling back to public interface 2026-02-17T05:31:23.907 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:31:24.484 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:31:24.479+0000 7fa5f8545a40 -1 osd.2 29 log_to_monitors true 2026-02-17T05:31:24.909 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:31:24.909 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:31:24.910 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-17T05:31:24.911 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T05:31:24.911 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:31:24.911 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T05:31:25.132 INFO:tasks.workunit.client.0.trial030.stdout:osd.2 up out weight 0 up_from 39 up_thru 0 down_at 32 last_clean_interval [14,29) [v2:127.0.0.1:6810/3922362673,v1:127.0.0.1:6811/3922362673] [v2:127.0.0.1:6812/3922362673,v1:127.0.0.1:6813/3922362673] exists,up d26fa46f-e265-43ba-83d2-985666052fe3 2026-02-17T05:31:25.133 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:31:25.133 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:31:25.133 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:31:25.133 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:747: TEST_divergent_3: for i in $non_divergent 2026-02-17T05:31:25.133 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:749: TEST_divergent_3: ceph osd in osd.0 2026-02-17T05:31:25.376 INFO:tasks.workunit.client.0.trial030.stderr:osd.0 is already in. 2026-02-17T05:31:25.387 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:747: TEST_divergent_3: for i in $non_divergent 2026-02-17T05:31:25.387 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:749: TEST_divergent_3: ceph osd in osd.2 2026-02-17T05:31:25.664 INFO:tasks.workunit.client.0.trial030.stderr:osd.2 is already in. 2026-02-17T05:31:25.674 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:752: TEST_divergent_3: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-17T05:31:25.674 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:752: TEST_divergent_3: wait_for_clean 2026-02-17T05:31:25.674 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T05:31:25.674 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T05:31:25.674 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T05:31:25.675 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-17T05:31:25.675 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T05:31:25.676 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T05:31:25.676 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T05:31:25.676 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T05:31:25.676 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T05:31:25.741 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-17T05:31:25.742 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T05:31:25.742 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T05:31:25.742 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T05:31:25.742 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T05:31:25.742 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:31:25.958 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:31:25.958 INFO:tasks.workunit.client.0.trial030.stderr:1 2026-02-17T05:31:25.958 INFO:tasks.workunit.client.0.trial030.stderr:2' 2026-02-17T05:31:25.958 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:31:25.958 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:31:25.958 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T05:31:26.045 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=154618822659 2026-02-17T05:31:26.045 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 154618822659 2026-02-17T05:31:26.045 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-154618822659' 2026-02-17T05:31:26.045 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:31:26.045 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T05:31:26.112 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-17T05:31:26.113 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: true 2026-02-17T05:31:26.113 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-17T05:31:26.113 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: continue 2026-02-17T05:31:26.113 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:31:26.113 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T05:31:26.195 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=167503724547 2026-02-17T05:31:26.195 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 167503724547 2026-02-17T05:31:26.195 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-154618822659 2-167503724547' 2026-02-17T05:31:26.195 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:31:26.196 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-154618822659 2026-02-17T05:31:26.196 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:31:26.197 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:31:26.198 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-154618822659 2026-02-17T05:31:26.198 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:31:26.199 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=154618822659 2026-02-17T05:31:26.200 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.0 seq 154618822659 2026-02-17T05:31:26.200 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 154618822659' 2026-02-17T05:31:26.200 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:31:26.410 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 154618822659 2026-02-17T05:31:26.411 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:31:27.412 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T05:31:27.412 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:31:27.642 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 154618822659 -lt 154618822659 2026-02-17T05:31:27.642 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:31:27.643 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-167503724547 2026-02-17T05:31:27.643 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:31:27.644 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:31:27.644 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-167503724547 2026-02-17T05:31:27.644 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:31:27.646 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=167503724547 2026-02-17T05:31:27.646 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 167503724547' 2026-02-17T05:31:27.646 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.2 seq 167503724547 2026-02-17T05:31:27.646 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:31:27.875 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 167503724547 -lt 167503724547 2026-02-17T05:31:27.875 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T05:31:27.875 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:31:27.876 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:31:28.169 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T05:31:28.169 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:31:28.169 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:31:28.169 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:31:28.170 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:31:28.170 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:31:28.170 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:31:28.170 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:31:28.383 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:31:28.383 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:31:28.384 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:31:28.384 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:31:28.662 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T05:31:28.662 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-17T05:31:28.662 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-17T05:31:28.662 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-17T05:31:28.662 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T05:31:28.663 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-17T05:31:28.763 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T05:31:28.763 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:31:28.764 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:31:28.764 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:31:28.764 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:31:28.764 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:31:28.765 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:31:28.765 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:31:28.977 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:31:28.977 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:31:28.978 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:31:28.978 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:31:29.254 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T05:31:29.254 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T05:31:29.254 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T05:31:29.254 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T05:31:29.254 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T05:31:29.254 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T05:31:29.254 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T05:31:29.254 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T05:31:29.254 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T05:31:29.549 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T05:31:29.549 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T05:31:29.549 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-17T05:31:29.549 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T05:31:29.549 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-17T05:31:29.750 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T05:31:29.750 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:31:29.751 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:31:29.751 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:31:29.751 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:31:29.751 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:31:29.751 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:31:29.752 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:31:29.975 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:31:29.976 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:31:29.976 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:31:29.976 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:31:30.273 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T05:31:30.273 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T05:31:30.273 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T05:31:30.273 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T05:31:30.273 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T05:31:30.273 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T05:31:30.273 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T05:31:30.273 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T05:31:30.273 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T05:31:30.559 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T05:31:30.560 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T05:31:30.560 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-17T05:31:30.560 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T05:31:30.560 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-17T05:31:30.961 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T05:31:30.961 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:31:30.962 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:31:30.962 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:31:30.963 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:31:30.963 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:31:30.963 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:31:30.963 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:31:31.173 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:31:31.174 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:31:31.174 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:31:31.174 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:31:31.456 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T05:31:31.456 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T05:31:31.456 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T05:31:31.456 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T05:31:31.456 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T05:31:31.456 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T05:31:31.457 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T05:31:31.457 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T05:31:31.457 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T05:31:31.739 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T05:31:31.740 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T05:31:31.740 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-17T05:31:31.740 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T05:31:31.740 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-17T05:31:32.540 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T05:31:32.541 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:31:32.541 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:31:32.541 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:31:32.541 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:31:32.541 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:31:32.541 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:31:32.542 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:31:32.755 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:31:32.756 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:31:32.756 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:31:32.756 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:31:33.035 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T05:31:33.035 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T05:31:33.036 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T05:31:33.036 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T05:31:33.036 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T05:31:33.036 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T05:31:33.036 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T05:31:33.036 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T05:31:33.036 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T05:31:33.317 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T05:31:33.317 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T05:31:33.317 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-17T05:31:33.317 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T05:31:33.317 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-17T05:31:34.918 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T05:31:34.918 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:31:34.919 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:31:34.919 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:31:34.920 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:31:34.920 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:31:34.920 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:31:34.920 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:31:35.128 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:31:35.129 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:31:35.129 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:31:35.129 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:31:35.409 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T05:31:35.410 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T05:31:35.410 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T05:31:35.410 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T05:31:35.410 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T05:31:35.410 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T05:31:35.410 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T05:31:35.410 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T05:31:35.411 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T05:31:35.695 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T05:31:35.695 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T05:31:35.695 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-17T05:31:35.695 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T05:31:35.695 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-17T05:31:38.896 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T05:31:38.896 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:31:38.896 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:31:38.896 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:31:38.897 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:31:38.897 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:31:38.897 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:31:38.898 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:31:39.109 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:31:39.110 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:31:39.110 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:31:39.110 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:31:39.390 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T05:31:39.391 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T05:31:39.391 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T05:31:39.391 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T05:31:39.391 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T05:31:39.391 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T05:31:39.391 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T05:31:39.391 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T05:31:39.391 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T05:31:39.688 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T05:31:39.688 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T05:31:39.688 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-17T05:31:39.688 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T05:31:39.688 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-17T05:31:46.089 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T05:31:46.089 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:31:46.090 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:31:46.090 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:31:46.090 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:31:46.090 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:31:46.090 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:31:46.091 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:31:46.309 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:31:46.310 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:31:46.310 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:31:46.311 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:31:46.604 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T05:31:46.604 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T05:31:46.604 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T05:31:46.604 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T05:31:46.604 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T05:31:46.605 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T05:31:46.605 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T05:31:46.605 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T05:31:46.605 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T05:31:46.892 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T05:31:46.893 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T05:31:46.893 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-17T05:31:46.893 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T05:31:46.893 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-17T05:31:54.194 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T05:31:54.194 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:31:54.195 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:31:54.195 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:31:54.195 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:31:54.195 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:31:54.195 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:31:54.195 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:31:54.415 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:31:54.416 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:31:54.416 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:31:54.416 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:31:54.709 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-17T05:31:54.709 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T05:31:54.710 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T05:31:54.710 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T05:31:54.710 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T05:31:54.710 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T05:31:54.710 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T05:31:54.710 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T05:31:54.710 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T05:31:54.999 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T05:31:54.999 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T05:31:54.999 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-17T05:31:54.999 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-17T05:31:55.270 INFO:tasks.workunit.client.0.trial030.stdout:{ 2026-02-17T05:31:55.270 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_fingerprint": "9b3e8454-c7ae-4678-b5e9-7e250144f229", 2026-02-17T05:31:55.270 INFO:tasks.workunit.client.0.trial030.stdout: "version": "20.3.0-5271-g32585015", 2026-02-17T05:31:55.271 INFO:tasks.workunit.client.0.trial030.stdout: "commit": "325850157d309f65985eea9ec9bb9f1d56726fee", 2026-02-17T05:31:55.271 INFO:tasks.workunit.client.0.trial030.stdout: "timestamp": "2026-02-17T05:31:55.268610+0000", 2026-02-17T05:31:55.271 INFO:tasks.workunit.client.0.trial030.stdout: "tag": "", 2026-02-17T05:31:55.271 INFO:tasks.workunit.client.0.trial030.stdout: "health": { 2026-02-17T05:31:55.271 INFO:tasks.workunit.client.0.trial030.stdout: "status": "HEALTH_WARN", 2026-02-17T05:31:55.271 INFO:tasks.workunit.client.0.trial030.stdout: "checks": { 2026-02-17T05:31:55.271 INFO:tasks.workunit.client.0.trial030.stdout: "OSDMAP_FLAGS": { 2026-02-17T05:31:55.271 INFO:tasks.workunit.client.0.trial030.stdout: "severity": "HEALTH_WARN", 2026-02-17T05:31:55.271 INFO:tasks.workunit.client.0.trial030.stdout: "summary": { 2026-02-17T05:31:55.271 INFO:tasks.workunit.client.0.trial030.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-17T05:31:55.272 INFO:tasks.workunit.client.0.trial030.stdout: "count": 17 2026-02-17T05:31:55.272 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.272 INFO:tasks.workunit.client.0.trial030.stdout: "detail": [], 2026-02-17T05:31:55.272 INFO:tasks.workunit.client.0.trial030.stdout: "muted": false 2026-02-17T05:31:55.272 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.272 INFO:tasks.workunit.client.0.trial030.stdout: "OSD_DOWN": { 2026-02-17T05:31:55.272 INFO:tasks.workunit.client.0.trial030.stdout: "severity": "HEALTH_WARN", 2026-02-17T05:31:55.272 INFO:tasks.workunit.client.0.trial030.stdout: "summary": { 2026-02-17T05:31:55.272 INFO:tasks.workunit.client.0.trial030.stdout: "message": "1 osds down", 2026-02-17T05:31:55.272 INFO:tasks.workunit.client.0.trial030.stdout: "count": 1 2026-02-17T05:31:55.272 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.272 INFO:tasks.workunit.client.0.trial030.stdout: "detail": [ 2026-02-17T05:31:55.273 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.273 INFO:tasks.workunit.client.0.trial030.stdout: "message": "osd.1 (root=default,host=trial030) is down" 2026-02-17T05:31:55.273 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:31:55.273 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:31:55.273 INFO:tasks.workunit.client.0.trial030.stdout: "muted": false 2026-02-17T05:31:55.273 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.273 INFO:tasks.workunit.client.0.trial030.stdout: "PG_DEGRADED": { 2026-02-17T05:31:55.273 INFO:tasks.workunit.client.0.trial030.stdout: "severity": "HEALTH_WARN", 2026-02-17T05:31:55.273 INFO:tasks.workunit.client.0.trial030.stdout: "summary": { 2026-02-17T05:31:55.273 INFO:tasks.workunit.client.0.trial030.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 32 pgs degraded", 2026-02-17T05:31:55.273 INFO:tasks.workunit.client.0.trial030.stdout: "count": 32 2026-02-17T05:31:55.273 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.274 INFO:tasks.workunit.client.0.trial030.stdout: "detail": [ 2026-02-17T05:31:55.274 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.274 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.0 is active+undersized+degraded+wait, acting [0,2]" 2026-02-17T05:31:55.274 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.274 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.274 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.1 is active+undersized+degraded, acting [0,2]" 2026-02-17T05:31:55.274 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.274 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.274 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.2 is active+undersized+degraded, acting [0,2]" 2026-02-17T05:31:55.274 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.274 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.274 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.3 is active+undersized+degraded, acting [0,2]" 2026-02-17T05:31:55.275 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.275 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.275 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.4 is active+undersized+degraded, acting [0,2]" 2026-02-17T05:31:55.275 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.275 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.275 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.5 is active+undersized+degraded, acting [0,2]" 2026-02-17T05:31:55.275 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.275 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.275 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.6 is active+undersized+degraded, acting [0,2]" 2026-02-17T05:31:55.275 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.275 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.275 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.7 is active+undersized+degraded, acting [0,2]" 2026-02-17T05:31:55.275 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.276 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.276 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.8 is active+undersized+degraded, acting [0,2]" 2026-02-17T05:31:55.276 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.276 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.276 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.9 is active+undersized+degraded, acting [0,2]" 2026-02-17T05:31:55.276 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.276 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.276 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.a is active+undersized+degraded, acting [0,2]" 2026-02-17T05:31:55.276 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.276 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.276 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.b is active+undersized+degraded, acting [0,2]" 2026-02-17T05:31:55.276 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.277 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.277 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.c is active+undersized+degraded, acting [0,2]" 2026-02-17T05:31:55.277 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.277 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.277 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.d is active+undersized+degraded, acting [0,2]" 2026-02-17T05:31:55.277 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.277 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.277 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.e is active+undersized+degraded, acting [0,2]" 2026-02-17T05:31:55.277 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.277 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.277 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.f is active+undersized+degraded, acting [0,2]" 2026-02-17T05:31:55.277 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.278 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.278 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.10 is active+undersized+degraded, acting [0,2]" 2026-02-17T05:31:55.278 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.278 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.278 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.11 is active+undersized+degraded, acting [0,2]" 2026-02-17T05:31:55.278 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.278 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.278 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.12 is active+undersized+degraded, acting [0,2]" 2026-02-17T05:31:55.278 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.278 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.278 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.13 is active+undersized+degraded, acting [0,2]" 2026-02-17T05:31:55.278 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.279 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.279 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.14 is active+undersized+degraded, acting [0,2]" 2026-02-17T05:31:55.279 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.279 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.279 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.15 is active+undersized+degraded, acting [0,2]" 2026-02-17T05:31:55.279 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.279 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.279 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.16 is active+undersized+degraded, acting [0,2]" 2026-02-17T05:31:55.279 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.280 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.280 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.17 is active+undersized+degraded, acting [0,2]" 2026-02-17T05:31:55.280 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.280 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.280 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.18 is active+undersized+degraded, acting [0,2]" 2026-02-17T05:31:55.280 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.280 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.280 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.19 is active+undersized+degraded, acting [0,2]" 2026-02-17T05:31:55.280 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.280 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.280 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.1a is active+undersized+degraded, acting [0,2]" 2026-02-17T05:31:55.280 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.281 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.281 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.1b is active+undersized+degraded, acting [0,2]" 2026-02-17T05:31:55.281 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.281 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.281 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.1c is active+undersized+degraded, acting [0,2]" 2026-02-17T05:31:55.281 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.281 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.281 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.1d is active+undersized+degraded, acting [0,2]" 2026-02-17T05:31:55.281 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.281 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.281 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.1e is active+undersized+degraded, acting [0,2]" 2026-02-17T05:31:55.281 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.281 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.282 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.1f is active+undersized+degraded, acting [0,2]" 2026-02-17T05:31:55.282 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:31:55.282 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:31:55.282 INFO:tasks.workunit.client.0.trial030.stdout: "muted": false 2026-02-17T05:31:55.282 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:31:55.282 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.282 INFO:tasks.workunit.client.0.trial030.stdout: "mutes": [] 2026-02-17T05:31:55.282 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.282 INFO:tasks.workunit.client.0.trial030.stdout: "monmap_first_committed": 1, 2026-02-17T05:31:55.282 INFO:tasks.workunit.client.0.trial030.stdout: "monmap_last_committed": 1, 2026-02-17T05:31:55.282 INFO:tasks.workunit.client.0.trial030.stdout: "monmap": { 2026-02-17T05:31:55.282 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 1, 2026-02-17T05:31:55.283 INFO:tasks.workunit.client.0.trial030.stdout: "fsid": "931b36d9-02d4-44f0-bc8b-c9190b7fdb00", 2026-02-17T05:31:55.283 INFO:tasks.workunit.client.0.trial030.stdout: "modified": "2026-02-17T05:30:42.805073Z", 2026-02-17T05:31:55.283 INFO:tasks.workunit.client.0.trial030.stdout: "created": "2026-02-17T05:30:42.805073Z", 2026-02-17T05:31:55.283 INFO:tasks.workunit.client.0.trial030.stdout: "min_mon_release": 20, 2026-02-17T05:31:55.283 INFO:tasks.workunit.client.0.trial030.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:31:55.283 INFO:tasks.workunit.client.0.trial030.stdout: "election_strategy": 1, 2026-02-17T05:31:55.283 INFO:tasks.workunit.client.0.trial030.stdout: "disallowed_leaders": "", 2026-02-17T05:31:55.283 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_mode": false, 2026-02-17T05:31:55.283 INFO:tasks.workunit.client.0.trial030.stdout: "tiebreaker_mon": "", 2026-02-17T05:31:55.283 INFO:tasks.workunit.client.0.trial030.stdout: "removed_ranks": "", 2026-02-17T05:31:55.283 INFO:tasks.workunit.client.0.trial030.stdout: "features": { 2026-02-17T05:31:55.283 INFO:tasks.workunit.client.0.trial030.stdout: "persistent": [ 2026-02-17T05:31:55.283 INFO:tasks.workunit.client.0.trial030.stdout: "kraken", 2026-02-17T05:31:55.284 INFO:tasks.workunit.client.0.trial030.stdout: "luminous", 2026-02-17T05:31:55.284 INFO:tasks.workunit.client.0.trial030.stdout: "mimic", 2026-02-17T05:31:55.284 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap-prune", 2026-02-17T05:31:55.284 INFO:tasks.workunit.client.0.trial030.stdout: "nautilus", 2026-02-17T05:31:55.284 INFO:tasks.workunit.client.0.trial030.stdout: "octopus", 2026-02-17T05:31:55.284 INFO:tasks.workunit.client.0.trial030.stdout: "pacific", 2026-02-17T05:31:55.284 INFO:tasks.workunit.client.0.trial030.stdout: "elector-pinging", 2026-02-17T05:31:55.284 INFO:tasks.workunit.client.0.trial030.stdout: "quincy", 2026-02-17T05:31:55.284 INFO:tasks.workunit.client.0.trial030.stdout: "reef", 2026-02-17T05:31:55.284 INFO:tasks.workunit.client.0.trial030.stdout: "squid", 2026-02-17T05:31:55.284 INFO:tasks.workunit.client.0.trial030.stdout: "tentacle", 2026-02-17T05:31:55.284 INFO:tasks.workunit.client.0.trial030.stdout: "nvmeof_beacon_diff" 2026-02-17T05:31:55.284 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:31:55.285 INFO:tasks.workunit.client.0.trial030.stdout: "optional": [] 2026-02-17T05:31:55.285 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.285 INFO:tasks.workunit.client.0.trial030.stdout: "mons": [ 2026-02-17T05:31:55.285 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.285 INFO:tasks.workunit.client.0.trial030.stdout: "rank": 0, 2026-02-17T05:31:55.285 INFO:tasks.workunit.client.0.trial030.stdout: "name": "a", 2026-02-17T05:31:55.285 INFO:tasks.workunit.client.0.trial030.stdout: "public_addrs": { 2026-02-17T05:31:55.285 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:31:55.285 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.285 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:31:55.285 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:7115", 2026-02-17T05:31:55.285 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 0 2026-02-17T05:31:55.286 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:31:55.286 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:31:55.286 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.286 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:7115/0", 2026-02-17T05:31:55.286 INFO:tasks.workunit.client.0.trial030.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-17T05:31:55.286 INFO:tasks.workunit.client.0.trial030.stdout: "priority": 0, 2026-02-17T05:31:55.286 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 0, 2026-02-17T05:31:55.286 INFO:tasks.workunit.client.0.trial030.stdout: "time_added": "2026-02-17T05:30:42:805067+0000", 2026-02-17T05:31:55.286 INFO:tasks.workunit.client.0.trial030.stdout: "crush_location": [] 2026-02-17T05:31:55.286 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:31:55.286 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:31:55.286 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.286 INFO:tasks.workunit.client.0.trial030.stdout: "quorum": [ 2026-02-17T05:31:55.287 INFO:tasks.workunit.client.0.trial030.stdout: 0 2026-02-17T05:31:55.287 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:31:55.287 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap": { 2026-02-17T05:31:55.287 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 45, 2026-02-17T05:31:55.287 INFO:tasks.workunit.client.0.trial030.stdout: "fsid": "931b36d9-02d4-44f0-bc8b-c9190b7fdb00", 2026-02-17T05:31:55.287 INFO:tasks.workunit.client.0.trial030.stdout: "created": "2026-02-17T05:30:42.887795+0000", 2026-02-17T05:31:55.287 INFO:tasks.workunit.client.0.trial030.stdout: "modified": "2026-02-17T05:31:47.462777+0000", 2026-02-17T05:31:55.287 INFO:tasks.workunit.client.0.trial030.stdout: "last_up_change": "2026-02-17T05:31:24.639578+0000", 2026-02-17T05:31:55.287 INFO:tasks.workunit.client.0.trial030.stdout: "last_in_change": "2026-02-17T05:31:25.603220+0000", 2026-02-17T05:31:55.287 INFO:tasks.workunit.client.0.trial030.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-17T05:31:55.287 INFO:tasks.workunit.client.0.trial030.stdout: "flags_num": 5800384, 2026-02-17T05:31:55.287 INFO:tasks.workunit.client.0.trial030.stdout: "flags_set": [ 2026-02-17T05:31:55.287 INFO:tasks.workunit.client.0.trial030.stdout: "nodown", 2026-02-17T05:31:55.288 INFO:tasks.workunit.client.0.trial030.stdout: "noin", 2026-02-17T05:31:55.288 INFO:tasks.workunit.client.0.trial030.stdout: "noout", 2026-02-17T05:31:55.288 INFO:tasks.workunit.client.0.trial030.stdout: "pglog_hardlimit", 2026-02-17T05:31:55.288 INFO:tasks.workunit.client.0.trial030.stdout: "purged_snapdirs", 2026-02-17T05:31:55.288 INFO:tasks.workunit.client.0.trial030.stdout: "recovery_deletes", 2026-02-17T05:31:55.288 INFO:tasks.workunit.client.0.trial030.stdout: "sortbitwise" 2026-02-17T05:31:55.288 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:31:55.288 INFO:tasks.workunit.client.0.trial030.stdout: "crush_version": 9, 2026-02-17T05:31:55.288 INFO:tasks.workunit.client.0.trial030.stdout: "full_ratio": 0.99000000953674316, 2026-02-17T05:31:55.288 INFO:tasks.workunit.client.0.trial030.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-17T05:31:55.288 INFO:tasks.workunit.client.0.trial030.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-17T05:31:55.288 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_snapshot": "", 2026-02-17T05:31:55.289 INFO:tasks.workunit.client.0.trial030.stdout: "pool_max": 1, 2026-02-17T05:31:55.289 INFO:tasks.workunit.client.0.trial030.stdout: "max_osd": 3, 2026-02-17T05:31:55.289 INFO:tasks.workunit.client.0.trial030.stdout: "require_min_compat_client": "luminous", 2026-02-17T05:31:55.289 INFO:tasks.workunit.client.0.trial030.stdout: "min_compat_client": "jewel", 2026-02-17T05:31:55.289 INFO:tasks.workunit.client.0.trial030.stdout: "require_osd_release": "tentacle", 2026-02-17T05:31:55.289 INFO:tasks.workunit.client.0.trial030.stdout: "allow_crimson": false, 2026-02-17T05:31:55.289 INFO:tasks.workunit.client.0.trial030.stdout: "pools": [ 2026-02-17T05:31:55.289 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.289 INFO:tasks.workunit.client.0.trial030.stdout: "pool": 1, 2026-02-17T05:31:55.289 INFO:tasks.workunit.client.0.trial030.stdout: "pool_name": "test", 2026-02-17T05:31:55.289 INFO:tasks.workunit.client.0.trial030.stdout: "create_time": "2026-02-17T05:30:55.088171+0000", 2026-02-17T05:31:55.289 INFO:tasks.workunit.client.0.trial030.stdout: "flags": 1, 2026-02-17T05:31:55.290 INFO:tasks.workunit.client.0.trial030.stdout: "flags_names": "hashpspool", 2026-02-17T05:31:55.290 INFO:tasks.workunit.client.0.trial030.stdout: "type": 1, 2026-02-17T05:31:55.290 INFO:tasks.workunit.client.0.trial030.stdout: "size": 3, 2026-02-17T05:31:55.290 INFO:tasks.workunit.client.0.trial030.stdout: "min_size": 2, 2026-02-17T05:31:55.290 INFO:tasks.workunit.client.0.trial030.stdout: "crush_rule": 0, 2026-02-17T05:31:55.290 INFO:tasks.workunit.client.0.trial030.stdout: "peering_crush_bucket_count": 0, 2026-02-17T05:31:55.290 INFO:tasks.workunit.client.0.trial030.stdout: "peering_crush_bucket_target": 0, 2026-02-17T05:31:55.290 INFO:tasks.workunit.client.0.trial030.stdout: "peering_crush_bucket_barrier": 0, 2026-02-17T05:31:55.290 INFO:tasks.workunit.client.0.trial030.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-17T05:31:55.290 INFO:tasks.workunit.client.0.trial030.stdout: "is_stretch_pool": false, 2026-02-17T05:31:55.290 INFO:tasks.workunit.client.0.trial030.stdout: "object_hash": 2, 2026-02-17T05:31:55.290 INFO:tasks.workunit.client.0.trial030.stdout: "pg_autoscale_mode": "on", 2026-02-17T05:31:55.290 INFO:tasks.workunit.client.0.trial030.stdout: "pg_num": 32, 2026-02-17T05:31:55.291 INFO:tasks.workunit.client.0.trial030.stdout: "pg_placement_num": 1, 2026-02-17T05:31:55.291 INFO:tasks.workunit.client.0.trial030.stdout: "pg_placement_num_target": 32, 2026-02-17T05:31:55.291 INFO:tasks.workunit.client.0.trial030.stdout: "pg_num_target": 32, 2026-02-17T05:31:55.291 INFO:tasks.workunit.client.0.trial030.stdout: "pg_num_pending": 32, 2026-02-17T05:31:55.291 INFO:tasks.workunit.client.0.trial030.stdout: "last_pg_merge_meta": { 2026-02-17T05:31:55.291 INFO:tasks.workunit.client.0.trial030.stdout: "source_pgid": "0.0", 2026-02-17T05:31:55.291 INFO:tasks.workunit.client.0.trial030.stdout: "ready_epoch": 0, 2026-02-17T05:31:55.291 INFO:tasks.workunit.client.0.trial030.stdout: "last_epoch_started": 0, 2026-02-17T05:31:55.291 INFO:tasks.workunit.client.0.trial030.stdout: "last_epoch_clean": 0, 2026-02-17T05:31:55.291 INFO:tasks.workunit.client.0.trial030.stdout: "source_version": "0'0", 2026-02-17T05:31:55.291 INFO:tasks.workunit.client.0.trial030.stdout: "target_version": "0'0" 2026-02-17T05:31:55.291 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.291 INFO:tasks.workunit.client.0.trial030.stdout: "last_change": "44", 2026-02-17T05:31:55.292 INFO:tasks.workunit.client.0.trial030.stdout: "last_force_op_resend": "0", 2026-02-17T05:31:55.292 INFO:tasks.workunit.client.0.trial030.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-17T05:31:55.292 INFO:tasks.workunit.client.0.trial030.stdout: "last_force_op_resend_preluminous": "44", 2026-02-17T05:31:55.292 INFO:tasks.workunit.client.0.trial030.stdout: "auid": 0, 2026-02-17T05:31:55.292 INFO:tasks.workunit.client.0.trial030.stdout: "snap_mode": "selfmanaged", 2026-02-17T05:31:55.292 INFO:tasks.workunit.client.0.trial030.stdout: "snap_seq": 0, 2026-02-17T05:31:55.292 INFO:tasks.workunit.client.0.trial030.stdout: "snap_epoch": 0, 2026-02-17T05:31:55.292 INFO:tasks.workunit.client.0.trial030.stdout: "pool_snaps": [], 2026-02-17T05:31:55.292 INFO:tasks.workunit.client.0.trial030.stdout: "removed_snaps": "[]", 2026-02-17T05:31:55.292 INFO:tasks.workunit.client.0.trial030.stdout: "quota_max_bytes": 0, 2026-02-17T05:31:55.292 INFO:tasks.workunit.client.0.trial030.stdout: "quota_max_objects": 0, 2026-02-17T05:31:55.292 INFO:tasks.workunit.client.0.trial030.stdout: "tiers": [], 2026-02-17T05:31:55.292 INFO:tasks.workunit.client.0.trial030.stdout: "tier_of": -1, 2026-02-17T05:31:55.293 INFO:tasks.workunit.client.0.trial030.stdout: "read_tier": -1, 2026-02-17T05:31:55.293 INFO:tasks.workunit.client.0.trial030.stdout: "write_tier": -1, 2026-02-17T05:31:55.293 INFO:tasks.workunit.client.0.trial030.stdout: "cache_mode": "none", 2026-02-17T05:31:55.293 INFO:tasks.workunit.client.0.trial030.stdout: "target_max_bytes": 0, 2026-02-17T05:31:55.293 INFO:tasks.workunit.client.0.trial030.stdout: "target_max_objects": 0, 2026-02-17T05:31:55.293 INFO:tasks.workunit.client.0.trial030.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-17T05:31:55.293 INFO:tasks.workunit.client.0.trial030.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-17T05:31:55.293 INFO:tasks.workunit.client.0.trial030.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-17T05:31:55.293 INFO:tasks.workunit.client.0.trial030.stdout: "cache_min_flush_age": 0, 2026-02-17T05:31:55.293 INFO:tasks.workunit.client.0.trial030.stdout: "cache_min_evict_age": 0, 2026-02-17T05:31:55.293 INFO:tasks.workunit.client.0.trial030.stdout: "erasure_code_profile": "", 2026-02-17T05:31:55.293 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_params": { 2026-02-17T05:31:55.294 INFO:tasks.workunit.client.0.trial030.stdout: "type": "none" 2026-02-17T05:31:55.294 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.294 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_period": 0, 2026-02-17T05:31:55.294 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_count": 0, 2026-02-17T05:31:55.294 INFO:tasks.workunit.client.0.trial030.stdout: "use_gmt_hitset": true, 2026-02-17T05:31:55.294 INFO:tasks.workunit.client.0.trial030.stdout: "min_read_recency_for_promote": 0, 2026-02-17T05:31:55.294 INFO:tasks.workunit.client.0.trial030.stdout: "min_write_recency_for_promote": 0, 2026-02-17T05:31:55.294 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_grade_decay_rate": 0, 2026-02-17T05:31:55.294 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_search_last_n": 0, 2026-02-17T05:31:55.294 INFO:tasks.workunit.client.0.trial030.stdout: "grade_table": [], 2026-02-17T05:31:55.294 INFO:tasks.workunit.client.0.trial030.stdout: "stripe_width": 0, 2026-02-17T05:31:55.295 INFO:tasks.workunit.client.0.trial030.stdout: "expected_num_objects": 0, 2026-02-17T05:31:55.295 INFO:tasks.workunit.client.0.trial030.stdout: "fast_read": false, 2026-02-17T05:31:55.295 INFO:tasks.workunit.client.0.trial030.stdout: "nonprimary_shards": "{}", 2026-02-17T05:31:55.295 INFO:tasks.workunit.client.0.trial030.stdout: "options": {}, 2026-02-17T05:31:55.295 INFO:tasks.workunit.client.0.trial030.stdout: "application_metadata": {}, 2026-02-17T05:31:55.295 INFO:tasks.workunit.client.0.trial030.stdout: "read_balance": { 2026-02-17T05:31:55.295 INFO:tasks.workunit.client.0.trial030.stdout: "score_type": "Fair distribution", 2026-02-17T05:31:55.295 INFO:tasks.workunit.client.0.trial030.stdout: "score_acting": 2.9900000095367432, 2026-02-17T05:31:55.295 INFO:tasks.workunit.client.0.trial030.stdout: "score_stable": 2.9900000095367432, 2026-02-17T05:31:55.295 INFO:tasks.workunit.client.0.trial030.stdout: "optimal_score": 0.67000001668930054, 2026-02-17T05:31:55.295 INFO:tasks.workunit.client.0.trial030.stdout: "raw_score_acting": 2, 2026-02-17T05:31:55.295 INFO:tasks.workunit.client.0.trial030.stdout: "raw_score_stable": 2, 2026-02-17T05:31:55.295 INFO:tasks.workunit.client.0.trial030.stdout: "primary_affinity_weighted": 1, 2026-02-17T05:31:55.296 INFO:tasks.workunit.client.0.trial030.stdout: "average_primary_affinity": 1, 2026-02-17T05:31:55.296 INFO:tasks.workunit.client.0.trial030.stdout: "average_primary_affinity_weighted": 1 2026-02-17T05:31:55.296 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:31:55.296 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:31:55.296 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:31:55.296 INFO:tasks.workunit.client.0.trial030.stdout: "osds": [ 2026-02-17T05:31:55.296 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.296 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 0, 2026-02-17T05:31:55.296 INFO:tasks.workunit.client.0.trial030.stdout: "uuid": "16e58abc-e2b0-4883-ba0a-c391c8cc9f6d", 2026-02-17T05:31:55.296 INFO:tasks.workunit.client.0.trial030.stdout: "up": 1, 2026-02-17T05:31:55.296 INFO:tasks.workunit.client.0.trial030.stdout: "in": 1, 2026-02-17T05:31:55.296 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 1, 2026-02-17T05:31:55.296 INFO:tasks.workunit.client.0.trial030.stdout: "primary_affinity": 1, 2026-02-17T05:31:55.297 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_begin": 5, 2026-02-17T05:31:55.297 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_end": 29, 2026-02-17T05:31:55.297 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 36, 2026-02-17T05:31:55.297 INFO:tasks.workunit.client.0.trial030.stdout: "up_thru": 44, 2026-02-17T05:31:55.297 INFO:tasks.workunit.client.0.trial030.stdout: "down_at": 30, 2026-02-17T05:31:55.297 INFO:tasks.workunit.client.0.trial030.stdout: "lost_at": 0, 2026-02-17T05:31:55.297 INFO:tasks.workunit.client.0.trial030.stdout: "public_addrs": { 2026-02-17T05:31:55.297 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:31:55.297 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.297 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:31:55.297 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6800", 2026-02-17T05:31:55.297 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3611726545 2026-02-17T05:31:55.298 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.298 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.298 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:31:55.298 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6801", 2026-02-17T05:31:55.298 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3611726545 2026-02-17T05:31:55.298 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:31:55.298 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:31:55.298 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.298 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addrs": { 2026-02-17T05:31:55.298 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:31:55.298 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.298 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:31:55.299 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6802", 2026-02-17T05:31:55.299 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3611726545 2026-02-17T05:31:55.299 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.299 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.299 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:31:55.299 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6803", 2026-02-17T05:31:55.299 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3611726545 2026-02-17T05:31:55.299 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:31:55.299 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:31:55.299 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.299 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addrs": { 2026-02-17T05:31:55.299 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:31:55.299 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.300 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:31:55.300 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6806", 2026-02-17T05:31:55.300 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3611726545 2026-02-17T05:31:55.300 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.300 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.300 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:31:55.300 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6807", 2026-02-17T05:31:55.300 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3611726545 2026-02-17T05:31:55.300 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:31:55.300 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:31:55.300 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.300 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addrs": { 2026-02-17T05:31:55.300 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:31:55.301 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.301 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:31:55.301 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6804", 2026-02-17T05:31:55.301 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3611726545 2026-02-17T05:31:55.301 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.301 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.301 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:31:55.301 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6805", 2026-02-17T05:31:55.301 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3611726545 2026-02-17T05:31:55.301 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:31:55.301 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:31:55.301 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.302 INFO:tasks.workunit.client.0.trial030.stdout: "public_addr": "127.0.0.1:6801/3611726545", 2026-02-17T05:31:55.302 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addr": "127.0.0.1:6803/3611726545", 2026-02-17T05:31:55.302 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addr": "127.0.0.1:6807/3611726545", 2026-02-17T05:31:55.302 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addr": "127.0.0.1:6805/3611726545", 2026-02-17T05:31:55.302 INFO:tasks.workunit.client.0.trial030.stdout: "state": [ 2026-02-17T05:31:55.302 INFO:tasks.workunit.client.0.trial030.stdout: "exists", 2026-02-17T05:31:55.302 INFO:tasks.workunit.client.0.trial030.stdout: "up" 2026-02-17T05:31:55.302 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:31:55.302 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.302 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.302 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 1, 2026-02-17T05:31:55.302 INFO:tasks.workunit.client.0.trial030.stdout: "uuid": "ba7ef7d8-8279-40c2-9fe4-6d18fe327556", 2026-02-17T05:31:55.302 INFO:tasks.workunit.client.0.trial030.stdout: "up": 0, 2026-02-17T05:31:55.303 INFO:tasks.workunit.client.0.trial030.stdout: "in": 1, 2026-02-17T05:31:55.303 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 1, 2026-02-17T05:31:55.303 INFO:tasks.workunit.client.0.trial030.stdout: "primary_affinity": 1, 2026-02-17T05:31:55.303 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_begin": 0, 2026-02-17T05:31:55.303 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_end": 0, 2026-02-17T05:31:55.303 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 9, 2026-02-17T05:31:55.303 INFO:tasks.workunit.client.0.trial030.stdout: "up_thru": 22, 2026-02-17T05:31:55.303 INFO:tasks.workunit.client.0.trial030.stdout: "down_at": 31, 2026-02-17T05:31:55.303 INFO:tasks.workunit.client.0.trial030.stdout: "lost_at": 0, 2026-02-17T05:31:55.303 INFO:tasks.workunit.client.0.trial030.stdout: "public_addrs": { 2026-02-17T05:31:55.303 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:31:55.303 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.303 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:31:55.303 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6810", 2026-02-17T05:31:55.304 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3197791047 2026-02-17T05:31:55.304 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.304 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.304 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:31:55.304 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6811", 2026-02-17T05:31:55.304 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3197791047 2026-02-17T05:31:55.304 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:31:55.304 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:31:55.304 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.304 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addrs": { 2026-02-17T05:31:55.304 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:31:55.304 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.305 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:31:55.305 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6812", 2026-02-17T05:31:55.305 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3197791047 2026-02-17T05:31:55.305 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.305 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.305 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:31:55.305 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6813", 2026-02-17T05:31:55.305 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3197791047 2026-02-17T05:31:55.305 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:31:55.305 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:31:55.305 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.305 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addrs": { 2026-02-17T05:31:55.305 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:31:55.306 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.306 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:31:55.306 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6816", 2026-02-17T05:31:55.306 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3197791047 2026-02-17T05:31:55.306 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.306 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.306 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:31:55.306 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6817", 2026-02-17T05:31:55.306 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3197791047 2026-02-17T05:31:55.306 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:31:55.306 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:31:55.306 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.307 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addrs": { 2026-02-17T05:31:55.307 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:31:55.307 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.307 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:31:55.307 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6814", 2026-02-17T05:31:55.307 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3197791047 2026-02-17T05:31:55.307 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.307 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.307 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:31:55.307 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6815", 2026-02-17T05:31:55.307 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3197791047 2026-02-17T05:31:55.307 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:31:55.307 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:31:55.307 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.307 INFO:tasks.workunit.client.0.trial030.stdout: "public_addr": "127.0.0.1:6811/3197791047", 2026-02-17T05:31:55.308 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addr": "127.0.0.1:6813/3197791047", 2026-02-17T05:31:55.308 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addr": "127.0.0.1:6817/3197791047", 2026-02-17T05:31:55.308 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addr": "127.0.0.1:6815/3197791047", 2026-02-17T05:31:55.308 INFO:tasks.workunit.client.0.trial030.stdout: "state": [ 2026-02-17T05:31:55.308 INFO:tasks.workunit.client.0.trial030.stdout: "exists" 2026-02-17T05:31:55.308 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:31:55.308 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.308 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.308 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2, 2026-02-17T05:31:55.308 INFO:tasks.workunit.client.0.trial030.stdout: "uuid": "d26fa46f-e265-43ba-83d2-985666052fe3", 2026-02-17T05:31:55.308 INFO:tasks.workunit.client.0.trial030.stdout: "up": 1, 2026-02-17T05:31:55.308 INFO:tasks.workunit.client.0.trial030.stdout: "in": 1, 2026-02-17T05:31:55.308 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 1, 2026-02-17T05:31:55.308 INFO:tasks.workunit.client.0.trial030.stdout: "primary_affinity": 1, 2026-02-17T05:31:55.309 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_begin": 14, 2026-02-17T05:31:55.309 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_end": 29, 2026-02-17T05:31:55.309 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 39, 2026-02-17T05:31:55.309 INFO:tasks.workunit.client.0.trial030.stdout: "up_thru": 0, 2026-02-17T05:31:55.309 INFO:tasks.workunit.client.0.trial030.stdout: "down_at": 32, 2026-02-17T05:31:55.309 INFO:tasks.workunit.client.0.trial030.stdout: "lost_at": 0, 2026-02-17T05:31:55.309 INFO:tasks.workunit.client.0.trial030.stdout: "public_addrs": { 2026-02-17T05:31:55.309 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:31:55.309 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.309 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:31:55.309 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6810", 2026-02-17T05:31:55.309 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3922362673 2026-02-17T05:31:55.309 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.309 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.310 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:31:55.310 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6811", 2026-02-17T05:31:55.310 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3922362673 2026-02-17T05:31:55.310 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:31:55.310 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:31:55.310 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.310 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addrs": { 2026-02-17T05:31:55.310 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:31:55.310 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.310 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:31:55.310 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6812", 2026-02-17T05:31:55.310 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3922362673 2026-02-17T05:31:55.310 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.310 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.310 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:31:55.310 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6813", 2026-02-17T05:31:55.311 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3922362673 2026-02-17T05:31:55.311 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:31:55.311 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:31:55.311 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.311 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addrs": { 2026-02-17T05:31:55.311 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:31:55.311 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.311 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:31:55.311 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6816", 2026-02-17T05:31:55.311 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3922362673 2026-02-17T05:31:55.311 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.311 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.311 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:31:55.311 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6817", 2026-02-17T05:31:55.311 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3922362673 2026-02-17T05:31:55.311 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:31:55.312 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:31:55.312 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.312 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addrs": { 2026-02-17T05:31:55.312 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:31:55.312 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.312 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:31:55.312 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6814", 2026-02-17T05:31:55.312 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3922362673 2026-02-17T05:31:55.312 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.312 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.312 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:31:55.312 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6815", 2026-02-17T05:31:55.312 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3922362673 2026-02-17T05:31:55.312 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:31:55.313 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:31:55.313 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.313 INFO:tasks.workunit.client.0.trial030.stdout: "public_addr": "127.0.0.1:6811/3922362673", 2026-02-17T05:31:55.313 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addr": "127.0.0.1:6813/3922362673", 2026-02-17T05:31:55.313 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addr": "127.0.0.1:6817/3922362673", 2026-02-17T05:31:55.313 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addr": "127.0.0.1:6815/3922362673", 2026-02-17T05:31:55.313 INFO:tasks.workunit.client.0.trial030.stdout: "state": [ 2026-02-17T05:31:55.313 INFO:tasks.workunit.client.0.trial030.stdout: "exists", 2026-02-17T05:31:55.313 INFO:tasks.workunit.client.0.trial030.stdout: "up" 2026-02-17T05:31:55.313 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:31:55.313 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:31:55.313 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:31:55.313 INFO:tasks.workunit.client.0.trial030.stdout: "osd_xinfo": [ 2026-02-17T05:31:55.313 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.313 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 0, 2026-02-17T05:31:55.313 INFO:tasks.workunit.client.0.trial030.stdout: "down_stamp": "2026-02-17T05:31:20.356846+0000", 2026-02-17T05:31:55.314 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_probability": 0, 2026-02-17T05:31:55.314 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_interval": 0, 2026-02-17T05:31:55.314 INFO:tasks.workunit.client.0.trial030.stdout: "features": 4544132024016699391, 2026-02-17T05:31:55.314 INFO:tasks.workunit.client.0.trial030.stdout: "old_weight": 0, 2026-02-17T05:31:55.314 INFO:tasks.workunit.client.0.trial030.stdout: "last_purged_snaps_scrub": "2026-02-17T05:30:46.614140+0000", 2026-02-17T05:31:55.314 INFO:tasks.workunit.client.0.trial030.stdout: "dead_epoch": 0 2026-02-17T05:31:55.314 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.314 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.314 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 1, 2026-02-17T05:31:55.314 INFO:tasks.workunit.client.0.trial030.stdout: "down_stamp": "2026-02-17T05:31:20.632227+0000", 2026-02-17T05:31:55.314 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_probability": 0, 2026-02-17T05:31:55.314 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_interval": 0, 2026-02-17T05:31:55.314 INFO:tasks.workunit.client.0.trial030.stdout: "features": 4544132024016699391, 2026-02-17T05:31:55.314 INFO:tasks.workunit.client.0.trial030.stdout: "old_weight": 0, 2026-02-17T05:31:55.314 INFO:tasks.workunit.client.0.trial030.stdout: "last_purged_snaps_scrub": "2026-02-17T05:30:50.052206+0000", 2026-02-17T05:31:55.314 INFO:tasks.workunit.client.0.trial030.stdout: "dead_epoch": 0 2026-02-17T05:31:55.314 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.315 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.315 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2, 2026-02-17T05:31:55.315 INFO:tasks.workunit.client.0.trial030.stdout: "down_stamp": "2026-02-17T05:31:20.913349+0000", 2026-02-17T05:31:55.315 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_probability": 0, 2026-02-17T05:31:55.315 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_interval": 0, 2026-02-17T05:31:55.315 INFO:tasks.workunit.client.0.trial030.stdout: "features": 4544132024016699391, 2026-02-17T05:31:55.315 INFO:tasks.workunit.client.0.trial030.stdout: "old_weight": 0, 2026-02-17T05:31:55.315 INFO:tasks.workunit.client.0.trial030.stdout: "last_purged_snaps_scrub": "2026-02-17T05:30:53.128275+0000", 2026-02-17T05:31:55.315 INFO:tasks.workunit.client.0.trial030.stdout: "dead_epoch": 0 2026-02-17T05:31:55.315 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:31:55.315 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:31:55.315 INFO:tasks.workunit.client.0.trial030.stdout: "pg_upmap": [], 2026-02-17T05:31:55.315 INFO:tasks.workunit.client.0.trial030.stdout: "pg_upmap_items": [], 2026-02-17T05:31:55.315 INFO:tasks.workunit.client.0.trial030.stdout: "pg_upmap_primaries": [], 2026-02-17T05:31:55.315 INFO:tasks.workunit.client.0.trial030.stdout: "pg_temp": [], 2026-02-17T05:31:55.315 INFO:tasks.workunit.client.0.trial030.stdout: "primary_temp": [], 2026-02-17T05:31:55.315 INFO:tasks.workunit.client.0.trial030.stdout: "blocklist": {}, 2026-02-17T05:31:55.315 INFO:tasks.workunit.client.0.trial030.stdout: "range_blocklist": {}, 2026-02-17T05:31:55.316 INFO:tasks.workunit.client.0.trial030.stdout: "erasure_code_profiles": { 2026-02-17T05:31:55.316 INFO:tasks.workunit.client.0.trial030.stdout: "default": { 2026-02-17T05:31:55.316 INFO:tasks.workunit.client.0.trial030.stdout: "k": "2", 2026-02-17T05:31:55.316 INFO:tasks.workunit.client.0.trial030.stdout: "m": "2", 2026-02-17T05:31:55.316 INFO:tasks.workunit.client.0.trial030.stdout: "plugin": "isa", 2026-02-17T05:31:55.316 INFO:tasks.workunit.client.0.trial030.stdout: "technique": "reed_sol_van" 2026-02-17T05:31:55.316 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:31:55.316 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.316 INFO:tasks.workunit.client.0.trial030.stdout: "removed_snaps_queue": [], 2026-02-17T05:31:55.316 INFO:tasks.workunit.client.0.trial030.stdout: "new_removed_snaps": [], 2026-02-17T05:31:55.316 INFO:tasks.workunit.client.0.trial030.stdout: "new_purged_snaps": [], 2026-02-17T05:31:55.316 INFO:tasks.workunit.client.0.trial030.stdout: "crush_node_flags": {}, 2026-02-17T05:31:55.316 INFO:tasks.workunit.client.0.trial030.stdout: "device_class_flags": {}, 2026-02-17T05:31:55.316 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_mode": { 2026-02-17T05:31:55.316 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_mode_enabled": false, 2026-02-17T05:31:55.316 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_bucket_count": 0, 2026-02-17T05:31:55.316 INFO:tasks.workunit.client.0.trial030.stdout: "degraded_stretch_mode": 0, 2026-02-17T05:31:55.317 INFO:tasks.workunit.client.0.trial030.stdout: "recovering_stretch_mode": 0, 2026-02-17T05:31:55.317 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_mode_bucket": 0 2026-02-17T05:31:55.317 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:31:55.317 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.317 INFO:tasks.workunit.client.0.trial030.stdout: "osd_metadata": [ 2026-02-17T05:31:55.317 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.317 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-17T05:31:55.317 INFO:tasks.workunit.client.0.trial030.stdout: "arch": "x86_64", 2026-02-17T05:31:55.317 INFO:tasks.workunit.client.0.trial030.stdout: "back_addr": "[v2:127.0.0.1:6802/3611726545,v1:127.0.0.1:6803/3611726545]", 2026-02-17T05:31:55.317 INFO:tasks.workunit.client.0.trial030.stdout: "back_iface": "", 2026-02-17T05:31:55.317 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs": "1", 2026-02-17T05:31:55.317 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_db": "0", 2026-02-17T05:31:55.317 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T05:31:55.317 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_single_shared_device": "1", 2026-02-17T05:31:55.317 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T05:31:55.317 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocator": "hybrid", 2026-02-17T05:31:55.317 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T05:31:55.317 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T05:31:55.317 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T05:31:55.318 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T05:31:55.318 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T05:31:55.318 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-17T05:31:55.318 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T05:31:55.318 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T05:31:55.318 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T05:31:55.318 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T05:31:55.318 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-17T05:31:55.318 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T05:31:55.318 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T05:31:55.318 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_write_mode": "classic", 2026-02-17T05:31:55.318 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_release": "tentacle", 2026-02-17T05:31:55.318 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version": "ceph version 20.3.0-5271-g32585015 (325850157d309f65985eea9ec9bb9f1d56726fee) tentacle (dev - None)", 2026-02-17T05:31:55.318 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_short": "20.3.0-5271-g32585015", 2026-02-17T05:31:55.318 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_when_created": "ceph version 20.3.0-5271-g32585015 (325850157d309f65985eea9ec9bb9f1d56726fee) tentacle (dev - None)", 2026-02-17T05:31:55.318 INFO:tasks.workunit.client.0.trial030.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T05:31:55.318 INFO:tasks.workunit.client.0.trial030.stdout: "created_at": "2026-02-17T05:30:43.871896Z", 2026-02-17T05:31:55.318 INFO:tasks.workunit.client.0.trial030.stdout: "default_device_class": "ssd", 2026-02-17T05:31:55.318 INFO:tasks.workunit.client.0.trial030.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6B65", 2026-02-17T05:31:55.319 INFO:tasks.workunit.client.0.trial030.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T05:31:55.319 INFO:tasks.workunit.client.0.trial030.stdout: "devices": "nvme0n1", 2026-02-17T05:31:55.319 INFO:tasks.workunit.client.0.trial030.stdout: "distro": "ubuntu", 2026-02-17T05:31:55.319 INFO:tasks.workunit.client.0.trial030.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T05:31:55.319 INFO:tasks.workunit.client.0.trial030.stdout: "distro_version": "22.04", 2026-02-17T05:31:55.319 INFO:tasks.workunit.client.0.trial030.stdout: "front_addr": "[v2:127.0.0.1:6800/3611726545,v1:127.0.0.1:6801/3611726545]", 2026-02-17T05:31:55.319 INFO:tasks.workunit.client.0.trial030.stdout: "front_iface": "", 2026-02-17T05:31:55.319 INFO:tasks.workunit.client.0.trial030.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/3611726545,v1:127.0.0.1:6807/3611726545]", 2026-02-17T05:31:55.319 INFO:tasks.workunit.client.0.trial030.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/3611726545,v1:127.0.0.1:6805/3611726545]", 2026-02-17T05:31:55.319 INFO:tasks.workunit.client.0.trial030.stdout: "hostname": "trial030", 2026-02-17T05:31:55.319 INFO:tasks.workunit.client.0.trial030.stdout: "journal_rotational": "0", 2026-02-17T05:31:55.319 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T05:31:55.319 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T05:31:55.319 INFO:tasks.workunit.client.0.trial030.stdout: "mem_swap_kb": "8388604", 2026-02-17T05:31:55.319 INFO:tasks.workunit.client.0.trial030.stdout: "mem_total_kb": "130961692", 2026-02-17T05:31:55.320 INFO:tasks.workunit.client.0.trial030.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T05:31:55.320 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_node": "0", 2026-02-17T05:31:55.320 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_nodes": "0", 2026-02-17T05:31:55.320 INFO:tasks.workunit.client.0.trial030.stdout: "os": "Linux", 2026-02-17T05:31:55.320 INFO:tasks.workunit.client.0.trial030.stdout: "osd_data": "td/divergent-priors/0", 2026-02-17T05:31:55.320 INFO:tasks.workunit.client.0.trial030.stdout: "osd_objectstore": "bluestore", 2026-02-17T05:31:55.320 INFO:tasks.workunit.client.0.trial030.stdout: "osdspec_affinity": "", 2026-02-17T05:31:55.320 INFO:tasks.workunit.client.0.trial030.stdout: "rotational": "0" 2026-02-17T05:31:55.320 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.320 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.320 INFO:tasks.workunit.client.0.trial030.stdout: "id": 1, 2026-02-17T05:31:55.320 INFO:tasks.workunit.client.0.trial030.stdout: "arch": "x86_64", 2026-02-17T05:31:55.320 INFO:tasks.workunit.client.0.trial030.stdout: "back_addr": "[v2:127.0.0.1:6812/3197791047,v1:127.0.0.1:6813/3197791047]", 2026-02-17T05:31:55.320 INFO:tasks.workunit.client.0.trial030.stdout: "back_iface": "", 2026-02-17T05:31:55.320 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs": "1", 2026-02-17T05:31:55.320 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_db": "0", 2026-02-17T05:31:55.320 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T05:31:55.320 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_single_shared_device": "1", 2026-02-17T05:31:55.320 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T05:31:55.320 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocator": "hybrid", 2026-02-17T05:31:55.321 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T05:31:55.321 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T05:31:55.321 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T05:31:55.321 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T05:31:55.321 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T05:31:55.321 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-17T05:31:55.321 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T05:31:55.321 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T05:31:55.321 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T05:31:55.321 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T05:31:55.321 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-17T05:31:55.321 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T05:31:55.321 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T05:31:55.321 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_write_mode": "classic", 2026-02-17T05:31:55.321 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_release": "tentacle", 2026-02-17T05:31:55.321 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version": "ceph version 20.3.0-5271-g32585015 (325850157d309f65985eea9ec9bb9f1d56726fee) tentacle (dev - None)", 2026-02-17T05:31:55.321 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_short": "20.3.0-5271-g32585015", 2026-02-17T05:31:55.321 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_when_created": "ceph version 20.3.0-5271-g32585015 (325850157d309f65985eea9ec9bb9f1d56726fee) tentacle (dev - None)", 2026-02-17T05:31:55.321 INFO:tasks.workunit.client.0.trial030.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T05:31:55.321 INFO:tasks.workunit.client.0.trial030.stdout: "created_at": "2026-02-17T05:30:47.657417Z", 2026-02-17T05:31:55.321 INFO:tasks.workunit.client.0.trial030.stdout: "default_device_class": "ssd", 2026-02-17T05:31:55.321 INFO:tasks.workunit.client.0.trial030.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6B65", 2026-02-17T05:31:55.322 INFO:tasks.workunit.client.0.trial030.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T05:31:55.322 INFO:tasks.workunit.client.0.trial030.stdout: "devices": "nvme0n1", 2026-02-17T05:31:55.322 INFO:tasks.workunit.client.0.trial030.stdout: "distro": "ubuntu", 2026-02-17T05:31:55.322 INFO:tasks.workunit.client.0.trial030.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T05:31:55.322 INFO:tasks.workunit.client.0.trial030.stdout: "distro_version": "22.04", 2026-02-17T05:31:55.322 INFO:tasks.workunit.client.0.trial030.stdout: "front_addr": "[v2:127.0.0.1:6810/3197791047,v1:127.0.0.1:6811/3197791047]", 2026-02-17T05:31:55.322 INFO:tasks.workunit.client.0.trial030.stdout: "front_iface": "", 2026-02-17T05:31:55.322 INFO:tasks.workunit.client.0.trial030.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/3197791047,v1:127.0.0.1:6817/3197791047]", 2026-02-17T05:31:55.322 INFO:tasks.workunit.client.0.trial030.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/3197791047,v1:127.0.0.1:6815/3197791047]", 2026-02-17T05:31:55.322 INFO:tasks.workunit.client.0.trial030.stdout: "hostname": "trial030", 2026-02-17T05:31:55.322 INFO:tasks.workunit.client.0.trial030.stdout: "journal_rotational": "0", 2026-02-17T05:31:55.322 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T05:31:55.322 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T05:31:55.322 INFO:tasks.workunit.client.0.trial030.stdout: "mem_swap_kb": "8388604", 2026-02-17T05:31:55.322 INFO:tasks.workunit.client.0.trial030.stdout: "mem_total_kb": "130961692", 2026-02-17T05:31:55.322 INFO:tasks.workunit.client.0.trial030.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T05:31:55.322 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_node": "0", 2026-02-17T05:31:55.322 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_nodes": "0", 2026-02-17T05:31:55.323 INFO:tasks.workunit.client.0.trial030.stdout: "os": "Linux", 2026-02-17T05:31:55.323 INFO:tasks.workunit.client.0.trial030.stdout: "osd_data": "td/divergent-priors/1", 2026-02-17T05:31:55.323 INFO:tasks.workunit.client.0.trial030.stdout: "osd_objectstore": "bluestore", 2026-02-17T05:31:55.323 INFO:tasks.workunit.client.0.trial030.stdout: "osdspec_affinity": "", 2026-02-17T05:31:55.323 INFO:tasks.workunit.client.0.trial030.stdout: "rotational": "0" 2026-02-17T05:31:55.323 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.323 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.323 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-17T05:31:55.323 INFO:tasks.workunit.client.0.trial030.stdout: "arch": "x86_64", 2026-02-17T05:31:55.323 INFO:tasks.workunit.client.0.trial030.stdout: "back_addr": "[v2:127.0.0.1:6812/3922362673,v1:127.0.0.1:6813/3922362673]", 2026-02-17T05:31:55.324 INFO:tasks.workunit.client.0.trial030.stdout: "back_iface": "", 2026-02-17T05:31:55.324 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs": "1", 2026-02-17T05:31:55.324 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_db": "0", 2026-02-17T05:31:55.324 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T05:31:55.324 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_single_shared_device": "1", 2026-02-17T05:31:55.324 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T05:31:55.324 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocator": "hybrid", 2026-02-17T05:31:55.324 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T05:31:55.324 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T05:31:55.324 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T05:31:55.324 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T05:31:55.324 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T05:31:55.324 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-17T05:31:55.324 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T05:31:55.325 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T05:31:55.325 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T05:31:55.325 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T05:31:55.325 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-17T05:31:55.325 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T05:31:55.325 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T05:31:55.325 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_write_mode": "classic", 2026-02-17T05:31:55.325 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_release": "tentacle", 2026-02-17T05:31:55.325 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version": "ceph version 20.3.0-5271-g32585015 (325850157d309f65985eea9ec9bb9f1d56726fee) tentacle (dev - None)", 2026-02-17T05:31:55.325 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_short": "20.3.0-5271-g32585015", 2026-02-17T05:31:55.325 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_when_created": "ceph version 20.3.0-5271-g32585015 (325850157d309f65985eea9ec9bb9f1d56726fee) tentacle (dev - None)", 2026-02-17T05:31:55.325 INFO:tasks.workunit.client.0.trial030.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T05:31:55.325 INFO:tasks.workunit.client.0.trial030.stdout: "created_at": "2026-02-17T05:30:50.725225Z", 2026-02-17T05:31:55.325 INFO:tasks.workunit.client.0.trial030.stdout: "default_device_class": "ssd", 2026-02-17T05:31:55.325 INFO:tasks.workunit.client.0.trial030.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6B65", 2026-02-17T05:31:55.325 INFO:tasks.workunit.client.0.trial030.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T05:31:55.325 INFO:tasks.workunit.client.0.trial030.stdout: "devices": "nvme0n1", 2026-02-17T05:31:55.325 INFO:tasks.workunit.client.0.trial030.stdout: "distro": "ubuntu", 2026-02-17T05:31:55.325 INFO:tasks.workunit.client.0.trial030.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T05:31:55.325 INFO:tasks.workunit.client.0.trial030.stdout: "distro_version": "22.04", 2026-02-17T05:31:55.325 INFO:tasks.workunit.client.0.trial030.stdout: "front_addr": "[v2:127.0.0.1:6810/3922362673,v1:127.0.0.1:6811/3922362673]", 2026-02-17T05:31:55.325 INFO:tasks.workunit.client.0.trial030.stdout: "front_iface": "", 2026-02-17T05:31:55.326 INFO:tasks.workunit.client.0.trial030.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/3922362673,v1:127.0.0.1:6817/3922362673]", 2026-02-17T05:31:55.326 INFO:tasks.workunit.client.0.trial030.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/3922362673,v1:127.0.0.1:6815/3922362673]", 2026-02-17T05:31:55.326 INFO:tasks.workunit.client.0.trial030.stdout: "hostname": "trial030", 2026-02-17T05:31:55.326 INFO:tasks.workunit.client.0.trial030.stdout: "journal_rotational": "0", 2026-02-17T05:31:55.326 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T05:31:55.326 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T05:31:55.326 INFO:tasks.workunit.client.0.trial030.stdout: "mem_swap_kb": "8388604", 2026-02-17T05:31:55.326 INFO:tasks.workunit.client.0.trial030.stdout: "mem_total_kb": "130961692", 2026-02-17T05:31:55.326 INFO:tasks.workunit.client.0.trial030.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T05:31:55.326 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_node": "0", 2026-02-17T05:31:55.326 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_nodes": "0", 2026-02-17T05:31:55.326 INFO:tasks.workunit.client.0.trial030.stdout: "os": "Linux", 2026-02-17T05:31:55.326 INFO:tasks.workunit.client.0.trial030.stdout: "osd_data": "td/divergent-priors/2", 2026-02-17T05:31:55.326 INFO:tasks.workunit.client.0.trial030.stdout: "osd_objectstore": "bluestore", 2026-02-17T05:31:55.326 INFO:tasks.workunit.client.0.trial030.stdout: "osdspec_affinity": "", 2026-02-17T05:31:55.326 INFO:tasks.workunit.client.0.trial030.stdout: "rotational": "0" 2026-02-17T05:31:55.326 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:31:55.326 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:31:55.326 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap_clean_epochs": { 2026-02-17T05:31:55.326 INFO:tasks.workunit.client.0.trial030.stdout: "min_last_epoch_clean": 0, 2026-02-17T05:31:55.326 INFO:tasks.workunit.client.0.trial030.stdout: "last_epoch_clean": { 2026-02-17T05:31:55.326 INFO:tasks.workunit.client.0.trial030.stdout: "per_pool": [] 2026-02-17T05:31:55.327 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.327 INFO:tasks.workunit.client.0.trial030.stdout: "osd_epochs": [ 2026-02-17T05:31:55.327 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.327 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-17T05:31:55.327 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 36 2026-02-17T05:31:55.327 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.327 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.327 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-17T05:31:55.327 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 40 2026-02-17T05:31:55.327 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:31:55.327 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:31:55.327 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.327 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap_first_committed": 1, 2026-02-17T05:31:55.327 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap_last_committed": 45, 2026-02-17T05:31:55.327 INFO:tasks.workunit.client.0.trial030.stdout: "crushmap": { 2026-02-17T05:31:55.327 INFO:tasks.workunit.client.0.trial030.stdout: "devices": [ 2026-02-17T05:31:55.327 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.327 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-17T05:31:55.327 INFO:tasks.workunit.client.0.trial030.stdout: "name": "osd.0", 2026-02-17T05:31:55.327 INFO:tasks.workunit.client.0.trial030.stdout: "class": "ssd" 2026-02-17T05:31:55.327 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.327 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.327 INFO:tasks.workunit.client.0.trial030.stdout: "id": 1, 2026-02-17T05:31:55.328 INFO:tasks.workunit.client.0.trial030.stdout: "name": "osd.1", 2026-02-17T05:31:55.328 INFO:tasks.workunit.client.0.trial030.stdout: "class": "ssd" 2026-02-17T05:31:55.328 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.328 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.328 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-17T05:31:55.328 INFO:tasks.workunit.client.0.trial030.stdout: "name": "osd.2", 2026-02-17T05:31:55.328 INFO:tasks.workunit.client.0.trial030.stdout: "class": "ssd" 2026-02-17T05:31:55.328 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:31:55.328 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:31:55.328 INFO:tasks.workunit.client.0.trial030.stdout: "types": [ 2026-02-17T05:31:55.328 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.328 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 0, 2026-02-17T05:31:55.328 INFO:tasks.workunit.client.0.trial030.stdout: "name": "osd" 2026-02-17T05:31:55.328 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.328 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.328 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 1, 2026-02-17T05:31:55.328 INFO:tasks.workunit.client.0.trial030.stdout: "name": "host" 2026-02-17T05:31:55.328 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.328 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.328 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 2, 2026-02-17T05:31:55.328 INFO:tasks.workunit.client.0.trial030.stdout: "name": "chassis" 2026-02-17T05:31:55.328 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.328 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.328 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 3, 2026-02-17T05:31:55.329 INFO:tasks.workunit.client.0.trial030.stdout: "name": "rack" 2026-02-17T05:31:55.329 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.329 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.329 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 4, 2026-02-17T05:31:55.329 INFO:tasks.workunit.client.0.trial030.stderr:report 2385130557 2026-02-17T05:31:55.329 INFO:tasks.workunit.client.0.trial030.stdout: "name": "row" 2026-02-17T05:31:55.329 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.329 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.329 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 5, 2026-02-17T05:31:55.329 INFO:tasks.workunit.client.0.trial030.stdout: "name": "pdu" 2026-02-17T05:31:55.329 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.329 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.330 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 6, 2026-02-17T05:31:55.330 INFO:tasks.workunit.client.0.trial030.stdout: "name": "pod" 2026-02-17T05:31:55.330 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.330 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.330 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 7, 2026-02-17T05:31:55.330 INFO:tasks.workunit.client.0.trial030.stdout: "name": "room" 2026-02-17T05:31:55.330 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.330 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.330 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 8, 2026-02-17T05:31:55.330 INFO:tasks.workunit.client.0.trial030.stdout: "name": "datacenter" 2026-02-17T05:31:55.330 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.330 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.330 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 9, 2026-02-17T05:31:55.330 INFO:tasks.workunit.client.0.trial030.stdout: "name": "zone" 2026-02-17T05:31:55.330 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.330 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.330 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 10, 2026-02-17T05:31:55.330 INFO:tasks.workunit.client.0.trial030.stdout: "name": "region" 2026-02-17T05:31:55.330 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.330 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.330 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 11, 2026-02-17T05:31:55.330 INFO:tasks.workunit.client.0.trial030.stdout: "name": "root" 2026-02-17T05:31:55.331 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:31:55.331 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:31:55.331 INFO:tasks.workunit.client.0.trial030.stdout: "buckets": [ 2026-02-17T05:31:55.331 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.331 INFO:tasks.workunit.client.0.trial030.stdout: "id": -1, 2026-02-17T05:31:55.331 INFO:tasks.workunit.client.0.trial030.stdout: "name": "default", 2026-02-17T05:31:55.331 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 11, 2026-02-17T05:31:55.331 INFO:tasks.workunit.client.0.trial030.stdout: "type_name": "root", 2026-02-17T05:31:55.331 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-17T05:31:55.331 INFO:tasks.workunit.client.0.trial030.stdout: "alg": "straw2", 2026-02-17T05:31:55.331 INFO:tasks.workunit.client.0.trial030.stdout: "hash": "rjenkins1", 2026-02-17T05:31:55.331 INFO:tasks.workunit.client.0.trial030.stdout: "items": [ 2026-02-17T05:31:55.331 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.331 INFO:tasks.workunit.client.0.trial030.stdout: "id": -3, 2026-02-17T05:31:55.331 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-17T05:31:55.331 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 0 2026-02-17T05:31:55.331 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:31:55.331 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:31:55.331 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.331 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.331 INFO:tasks.workunit.client.0.trial030.stdout: "id": -2, 2026-02-17T05:31:55.331 INFO:tasks.workunit.client.0.trial030.stdout: "name": "default~ssd", 2026-02-17T05:31:55.331 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 11, 2026-02-17T05:31:55.331 INFO:tasks.workunit.client.0.trial030.stdout: "type_name": "root", 2026-02-17T05:31:55.331 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-17T05:31:55.331 INFO:tasks.workunit.client.0.trial030.stdout: "alg": "straw2", 2026-02-17T05:31:55.332 INFO:tasks.workunit.client.0.trial030.stdout: "hash": "rjenkins1", 2026-02-17T05:31:55.332 INFO:tasks.workunit.client.0.trial030.stdout: "items": [ 2026-02-17T05:31:55.332 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.332 INFO:tasks.workunit.client.0.trial030.stdout: "id": -4, 2026-02-17T05:31:55.332 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-17T05:31:55.332 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 0 2026-02-17T05:31:55.332 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:31:55.332 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:31:55.332 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.332 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.332 INFO:tasks.workunit.client.0.trial030.stdout: "id": -3, 2026-02-17T05:31:55.332 INFO:tasks.workunit.client.0.trial030.stdout: "name": "trial030", 2026-02-17T05:31:55.332 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 1, 2026-02-17T05:31:55.332 INFO:tasks.workunit.client.0.trial030.stdout: "type_name": "host", 2026-02-17T05:31:55.332 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-17T05:31:55.332 INFO:tasks.workunit.client.0.trial030.stdout: "alg": "straw2", 2026-02-17T05:31:55.332 INFO:tasks.workunit.client.0.trial030.stdout: "hash": "rjenkins1", 2026-02-17T05:31:55.332 INFO:tasks.workunit.client.0.trial030.stdout: "items": [ 2026-02-17T05:31:55.332 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.332 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-17T05:31:55.332 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-17T05:31:55.332 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 0 2026-02-17T05:31:55.332 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.332 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.332 INFO:tasks.workunit.client.0.trial030.stdout: "id": 1, 2026-02-17T05:31:55.333 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-17T05:31:55.333 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 1 2026-02-17T05:31:55.333 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.333 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.333 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-17T05:31:55.333 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-17T05:31:55.333 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 2 2026-02-17T05:31:55.333 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:31:55.333 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:31:55.333 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.333 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.333 INFO:tasks.workunit.client.0.trial030.stdout: "id": -4, 2026-02-17T05:31:55.333 INFO:tasks.workunit.client.0.trial030.stdout: "name": "trial030~ssd", 2026-02-17T05:31:55.333 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 1, 2026-02-17T05:31:55.333 INFO:tasks.workunit.client.0.trial030.stdout: "type_name": "host", 2026-02-17T05:31:55.333 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-17T05:31:55.333 INFO:tasks.workunit.client.0.trial030.stdout: "alg": "straw2", 2026-02-17T05:31:55.333 INFO:tasks.workunit.client.0.trial030.stdout: "hash": "rjenkins1", 2026-02-17T05:31:55.333 INFO:tasks.workunit.client.0.trial030.stdout: "items": [ 2026-02-17T05:31:55.333 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.333 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-17T05:31:55.333 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-17T05:31:55.333 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 0 2026-02-17T05:31:55.333 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.333 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.333 INFO:tasks.workunit.client.0.trial030.stdout: "id": 1, 2026-02-17T05:31:55.334 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-17T05:31:55.334 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 1 2026-02-17T05:31:55.334 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.334 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.334 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-17T05:31:55.334 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-17T05:31:55.334 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 2 2026-02-17T05:31:55.334 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:31:55.334 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:31:55.334 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:31:55.334 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:31:55.334 INFO:tasks.workunit.client.0.trial030.stdout: "rules": [ 2026-02-17T05:31:55.334 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.334 INFO:tasks.workunit.client.0.trial030.stdout: "rule_id": 0, 2026-02-17T05:31:55.334 INFO:tasks.workunit.client.0.trial030.stdout: "rule_name": "replicated_rule", 2026-02-17T05:31:55.334 INFO:tasks.workunit.client.0.trial030.stdout: "type": 1, 2026-02-17T05:31:55.334 INFO:tasks.workunit.client.0.trial030.stdout: "steps": [ 2026-02-17T05:31:55.334 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.334 INFO:tasks.workunit.client.0.trial030.stdout: "op": "take", 2026-02-17T05:31:55.334 INFO:tasks.workunit.client.0.trial030.stdout: "item": -1, 2026-02-17T05:31:55.334 INFO:tasks.workunit.client.0.trial030.stdout: "item_name": "default" 2026-02-17T05:31:55.334 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.334 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.334 INFO:tasks.workunit.client.0.trial030.stdout: "op": "choose_firstn", 2026-02-17T05:31:55.334 INFO:tasks.workunit.client.0.trial030.stdout: "num": 0, 2026-02-17T05:31:55.334 INFO:tasks.workunit.client.0.trial030.stdout: "type": "osd" 2026-02-17T05:31:55.335 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.335 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.335 INFO:tasks.workunit.client.0.trial030.stdout: "op": "emit" 2026-02-17T05:31:55.335 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:31:55.335 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:31:55.335 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:31:55.335 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:31:55.335 INFO:tasks.workunit.client.0.trial030.stdout: "tunables": { 2026-02-17T05:31:55.335 INFO:tasks.workunit.client.0.trial030.stdout: "choose_local_tries": 0, 2026-02-17T05:31:55.335 INFO:tasks.workunit.client.0.trial030.stdout: "choose_local_fallback_tries": 0, 2026-02-17T05:31:55.335 INFO:tasks.workunit.client.0.trial030.stdout: "choose_total_tries": 50, 2026-02-17T05:31:55.335 INFO:tasks.workunit.client.0.trial030.stdout: "chooseleaf_descend_once": 1, 2026-02-17T05:31:55.335 INFO:tasks.workunit.client.0.trial030.stdout: "chooseleaf_vary_r": 1, 2026-02-17T05:31:55.335 INFO:tasks.workunit.client.0.trial030.stdout: "chooseleaf_stable": 1, 2026-02-17T05:31:55.335 INFO:tasks.workunit.client.0.trial030.stdout: "msr_descents": 100, 2026-02-17T05:31:55.335 INFO:tasks.workunit.client.0.trial030.stdout: "msr_collision_tries": 100, 2026-02-17T05:31:55.335 INFO:tasks.workunit.client.0.trial030.stdout: "straw_calc_version": 1, 2026-02-17T05:31:55.335 INFO:tasks.workunit.client.0.trial030.stdout: "allowed_bucket_algs": 54, 2026-02-17T05:31:55.335 INFO:tasks.workunit.client.0.trial030.stdout: "profile": "jewel", 2026-02-17T05:31:55.335 INFO:tasks.workunit.client.0.trial030.stdout: "optimal_tunables": 1, 2026-02-17T05:31:55.335 INFO:tasks.workunit.client.0.trial030.stdout: "legacy_tunables": 0, 2026-02-17T05:31:55.335 INFO:tasks.workunit.client.0.trial030.stdout: "minimum_required_version": "jewel", 2026-02-17T05:31:55.335 INFO:tasks.workunit.client.0.trial030.stdout: "require_feature_tunables": 1, 2026-02-17T05:31:55.335 INFO:tasks.workunit.client.0.trial030.stdout: "require_feature_tunables2": 1, 2026-02-17T05:31:55.335 INFO:tasks.workunit.client.0.trial030.stdout: "has_v2_rules": 0, 2026-02-17T05:31:55.335 INFO:tasks.workunit.client.0.trial030.stdout: "require_feature_tunables3": 1, 2026-02-17T05:31:55.335 INFO:tasks.workunit.client.0.trial030.stdout: "has_v3_rules": 0, 2026-02-17T05:31:55.335 INFO:tasks.workunit.client.0.trial030.stdout: "has_v4_buckets": 1, 2026-02-17T05:31:55.336 INFO:tasks.workunit.client.0.trial030.stdout: "require_feature_tunables5": 1, 2026-02-17T05:31:55.336 INFO:tasks.workunit.client.0.trial030.stdout: "has_v5_rules": 0, 2026-02-17T05:31:55.336 INFO:tasks.workunit.client.0.trial030.stdout: "has_msr_rules": 0 2026-02-17T05:31:55.336 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.336 INFO:tasks.workunit.client.0.trial030.stdout: "choose_args": {} 2026-02-17T05:31:55.336 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.336 INFO:tasks.workunit.client.0.trial030.stdout: "fsmap": { 2026-02-17T05:31:55.336 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 1, 2026-02-17T05:31:55.336 INFO:tasks.workunit.client.0.trial030.stdout: "btime": "2026-02-17T05:30:42:887561+0000", 2026-02-17T05:31:55.336 INFO:tasks.workunit.client.0.trial030.stdout: "default_fscid": -1, 2026-02-17T05:31:55.336 INFO:tasks.workunit.client.0.trial030.stdout: "compat": { 2026-02-17T05:31:55.336 INFO:tasks.workunit.client.0.trial030.stdout: "compat": {}, 2026-02-17T05:31:55.336 INFO:tasks.workunit.client.0.trial030.stdout: "ro_compat": {}, 2026-02-17T05:31:55.336 INFO:tasks.workunit.client.0.trial030.stdout: "incompat": { 2026-02-17T05:31:55.336 INFO:tasks.workunit.client.0.trial030.stdout: "feature_1": "base v0.20", 2026-02-17T05:31:55.336 INFO:tasks.workunit.client.0.trial030.stdout: "feature_2": "client writeable ranges", 2026-02-17T05:31:55.336 INFO:tasks.workunit.client.0.trial030.stdout: "feature_3": "default file layouts on dirs", 2026-02-17T05:31:55.336 INFO:tasks.workunit.client.0.trial030.stdout: "feature_4": "dir inode in separate object", 2026-02-17T05:31:55.336 INFO:tasks.workunit.client.0.trial030.stdout: "feature_5": "mds uses versioned encoding", 2026-02-17T05:31:55.336 INFO:tasks.workunit.client.0.trial030.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-17T05:31:55.336 INFO:tasks.workunit.client.0.trial030.stdout: "feature_8": "no anchor table", 2026-02-17T05:31:55.336 INFO:tasks.workunit.client.0.trial030.stdout: "feature_9": "file layout v2", 2026-02-17T05:31:55.336 INFO:tasks.workunit.client.0.trial030.stdout: "feature_10": "snaprealm v2", 2026-02-17T05:31:55.336 INFO:tasks.workunit.client.0.trial030.stdout: "feature_11": "minor log segments", 2026-02-17T05:31:55.336 INFO:tasks.workunit.client.0.trial030.stdout: "feature_12": "quiesce subvolumes" 2026-02-17T05:31:55.336 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:31:55.336 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.336 INFO:tasks.workunit.client.0.trial030.stdout: "feature_flags": { 2026-02-17T05:31:55.336 INFO:tasks.workunit.client.0.trial030.stdout: "enable_multiple": true, 2026-02-17T05:31:55.337 INFO:tasks.workunit.client.0.trial030.stdout: "ever_enabled_multiple": true 2026-02-17T05:31:55.337 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.337 INFO:tasks.workunit.client.0.trial030.stdout: "standbys": [], 2026-02-17T05:31:55.337 INFO:tasks.workunit.client.0.trial030.stdout: "filesystems": [] 2026-02-17T05:31:55.337 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.337 INFO:tasks.workunit.client.0.trial030.stdout: "mdsmap_first_committed": 1, 2026-02-17T05:31:55.337 INFO:tasks.workunit.client.0.trial030.stdout: "mdsmap_last_committed": 1, 2026-02-17T05:31:55.337 INFO:tasks.workunit.client.0.trial030.stdout: "auth": { 2026-02-17T05:31:55.337 INFO:tasks.workunit.client.0.trial030.stdout: "first_committed": 1, 2026-02-17T05:31:55.337 INFO:tasks.workunit.client.0.trial030.stdout: "last_committed": 5, 2026-02-17T05:31:55.337 INFO:tasks.workunit.client.0.trial030.stdout: "num_secrets": 3 2026-02-17T05:31:55.337 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.337 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg": 32, 2026-02-17T05:31:55.337 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg_active": 32, 2026-02-17T05:31:55.337 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg_unknown": 0, 2026-02-17T05:31:55.337 INFO:tasks.workunit.client.0.trial030.stdout: "num_osd": 3, 2026-02-17T05:31:55.337 INFO:tasks.workunit.client.0.trial030.stdout: "pool_sum": { 2026-02-17T05:31:55.337 INFO:tasks.workunit.client.0.trial030.stdout: "stat_sum": { 2026-02-17T05:31:55.337 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes": 51200, 2026-02-17T05:31:55.337 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects": 100, 2026-02-17T05:31:55.337 INFO:tasks.workunit.client.0.trial030.stdout: "num_object_clones": 0, 2026-02-17T05:31:55.337 INFO:tasks.workunit.client.0.trial030.stdout: "num_object_copies": 300, 2026-02-17T05:31:55.337 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T05:31:55.337 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_missing": 0, 2026-02-17T05:31:55.337 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_degraded": 100, 2026-02-17T05:31:55.337 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_misplaced": 0, 2026-02-17T05:31:55.337 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_unfound": 0, 2026-02-17T05:31:55.337 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_dirty": 100, 2026-02-17T05:31:55.337 INFO:tasks.workunit.client.0.trial030.stdout: "num_whiteouts": 0, 2026-02-17T05:31:55.338 INFO:tasks.workunit.client.0.trial030.stdout: "num_read": 0, 2026-02-17T05:31:55.338 INFO:tasks.workunit.client.0.trial030.stdout: "num_read_kb": 0, 2026-02-17T05:31:55.338 INFO:tasks.workunit.client.0.trial030.stdout: "num_write": 100, 2026-02-17T05:31:55.338 INFO:tasks.workunit.client.0.trial030.stdout: "num_write_kb": 100, 2026-02-17T05:31:55.338 INFO:tasks.workunit.client.0.trial030.stdout: "num_scrub_errors": 0, 2026-02-17T05:31:55.338 INFO:tasks.workunit.client.0.trial030.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T05:31:55.338 INFO:tasks.workunit.client.0.trial030.stdout: "num_deep_scrub_errors": 0, 2026-02-17T05:31:55.338 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_recovered": 0, 2026-02-17T05:31:55.338 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes_recovered": 0, 2026-02-17T05:31:55.338 INFO:tasks.workunit.client.0.trial030.stdout: "num_keys_recovered": 0, 2026-02-17T05:31:55.338 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_omap": 0, 2026-02-17T05:31:55.338 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T05:31:55.338 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T05:31:55.338 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush": 0, 2026-02-17T05:31:55.338 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_kb": 0, 2026-02-17T05:31:55.338 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict": 0, 2026-02-17T05:31:55.338 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_kb": 0, 2026-02-17T05:31:55.338 INFO:tasks.workunit.client.0.trial030.stdout: "num_promote": 0, 2026-02-17T05:31:55.338 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_mode_high": 0, 2026-02-17T05:31:55.338 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_mode_low": 0, 2026-02-17T05:31:55.338 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_mode_some": 0, 2026-02-17T05:31:55.338 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_mode_full": 0, 2026-02-17T05:31:55.338 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_pinned": 0, 2026-02-17T05:31:55.338 INFO:tasks.workunit.client.0.trial030.stdout: "num_legacy_snapsets": 0, 2026-02-17T05:31:55.338 INFO:tasks.workunit.client.0.trial030.stdout: "num_large_omap_objects": 0, 2026-02-17T05:31:55.338 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_manifest": 0, 2026-02-17T05:31:55.338 INFO:tasks.workunit.client.0.trial030.stdout: "num_omap_bytes": 0, 2026-02-17T05:31:55.338 INFO:tasks.workunit.client.0.trial030.stdout: "num_omap_keys": 0, 2026-02-17T05:31:55.338 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_repaired": 0 2026-02-17T05:31:55.339 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.339 INFO:tasks.workunit.client.0.trial030.stdout: "store_stats": { 2026-02-17T05:31:55.339 INFO:tasks.workunit.client.0.trial030.stdout: "total": 0, 2026-02-17T05:31:55.339 INFO:tasks.workunit.client.0.trial030.stdout: "available": 0, 2026-02-17T05:31:55.339 INFO:tasks.workunit.client.0.trial030.stdout: "internally_reserved": 0, 2026-02-17T05:31:55.339 INFO:tasks.workunit.client.0.trial030.stdout: "allocated": 0, 2026-02-17T05:31:55.339 INFO:tasks.workunit.client.0.trial030.stdout: "data_stored": 0, 2026-02-17T05:31:55.339 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed": 0, 2026-02-17T05:31:55.339 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_allocated": 0, 2026-02-17T05:31:55.339 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_original": 0, 2026-02-17T05:31:55.339 INFO:tasks.workunit.client.0.trial030.stdout: "omap_allocated": 0, 2026-02-17T05:31:55.339 INFO:tasks.workunit.client.0.trial030.stdout: "internal_metadata": 0 2026-02-17T05:31:55.339 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.339 INFO:tasks.workunit.client.0.trial030.stdout: "log_size": 512, 2026-02-17T05:31:55.339 INFO:tasks.workunit.client.0.trial030.stdout: "ondisk_log_size": 512, 2026-02-17T05:31:55.339 INFO:tasks.workunit.client.0.trial030.stdout: "up": 64, 2026-02-17T05:31:55.339 INFO:tasks.workunit.client.0.trial030.stdout: "acting": 64, 2026-02-17T05:31:55.339 INFO:tasks.workunit.client.0.trial030.stdout: "num_store_stats": 0 2026-02-17T05:31:55.339 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.339 INFO:tasks.workunit.client.0.trial030.stdout: "osd_sum": { 2026-02-17T05:31:55.339 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 0, 2026-02-17T05:31:55.339 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 0, 2026-02-17T05:31:55.339 INFO:tasks.workunit.client.0.trial030.stdout: "num_pgs": 65, 2026-02-17T05:31:55.339 INFO:tasks.workunit.client.0.trial030.stdout: "num_osds": 3, 2026-02-17T05:31:55.339 INFO:tasks.workunit.client.0.trial030.stdout: "num_per_pool_osds": 3, 2026-02-17T05:31:55.339 INFO:tasks.workunit.client.0.trial030.stdout: "num_per_pool_omap_osds": 3, 2026-02-17T05:31:55.339 INFO:tasks.workunit.client.0.trial030.stdout: "kb": 314572800, 2026-02-17T05:31:55.339 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used": 83952, 2026-02-17T05:31:55.339 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_data": 2168, 2026-02-17T05:31:55.339 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_omap": 29, 2026-02-17T05:31:55.340 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_meta": 81698, 2026-02-17T05:31:55.340 INFO:tasks.workunit.client.0.trial030.stdout: "kb_avail": 314488848, 2026-02-17T05:31:55.340 INFO:tasks.workunit.client.0.trial030.stdout: "statfs": { 2026-02-17T05:31:55.340 INFO:tasks.workunit.client.0.trial030.stdout: "total": 322122547200, 2026-02-17T05:31:55.340 INFO:tasks.workunit.client.0.trial030.stdout: "available": 322036580352, 2026-02-17T05:31:55.340 INFO:tasks.workunit.client.0.trial030.stdout: "internally_reserved": 0, 2026-02-17T05:31:55.340 INFO:tasks.workunit.client.0.trial030.stdout: "allocated": 2220032, 2026-02-17T05:31:55.340 INFO:tasks.workunit.client.0.trial030.stdout: "data_stored": 455884, 2026-02-17T05:31:55.340 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed": 0, 2026-02-17T05:31:55.340 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_allocated": 0, 2026-02-17T05:31:55.340 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_original": 0, 2026-02-17T05:31:55.340 INFO:tasks.workunit.client.0.trial030.stdout: "omap_allocated": 30616, 2026-02-17T05:31:55.340 INFO:tasks.workunit.client.0.trial030.stdout: "internal_metadata": 83658856 2026-02-17T05:31:55.340 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.340 INFO:tasks.workunit.client.0.trial030.stdout: "hb_peers": [], 2026-02-17T05:31:55.340 INFO:tasks.workunit.client.0.trial030.stdout: "snap_trim_queue_len": 0, 2026-02-17T05:31:55.340 INFO:tasks.workunit.client.0.trial030.stdout: "num_snap_trimming": 0, 2026-02-17T05:31:55.340 INFO:tasks.workunit.client.0.trial030.stdout: "num_shards_repaired": 0, 2026-02-17T05:31:55.340 INFO:tasks.workunit.client.0.trial030.stdout: "op_queue_age_hist": { 2026-02-17T05:31:55.340 INFO:tasks.workunit.client.0.trial030.stdout: "histogram": [], 2026-02-17T05:31:55.340 INFO:tasks.workunit.client.0.trial030.stdout: "upper_bound": 1 2026-02-17T05:31:55.340 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.340 INFO:tasks.workunit.client.0.trial030.stdout: "perf_stat": { 2026-02-17T05:31:55.340 INFO:tasks.workunit.client.0.trial030.stdout: "commit_latency_ms": 0, 2026-02-17T05:31:55.340 INFO:tasks.workunit.client.0.trial030.stdout: "apply_latency_ms": 0, 2026-02-17T05:31:55.340 INFO:tasks.workunit.client.0.trial030.stdout: "commit_latency_ns": 0, 2026-02-17T05:31:55.340 INFO:tasks.workunit.client.0.trial030.stdout: "apply_latency_ns": 0 2026-02-17T05:31:55.340 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.340 INFO:tasks.workunit.client.0.trial030.stdout: "alerts": [], 2026-02-17T05:31:55.340 INFO:tasks.workunit.client.0.trial030.stdout: "network_ping_times": [] 2026-02-17T05:31:55.341 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.341 INFO:tasks.workunit.client.0.trial030.stdout: "osd_sum_by_class": { 2026-02-17T05:31:55.341 INFO:tasks.workunit.client.0.trial030.stdout: "ssd": { 2026-02-17T05:31:55.341 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 0, 2026-02-17T05:31:55.341 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 0, 2026-02-17T05:31:55.341 INFO:tasks.workunit.client.0.trial030.stdout: "num_pgs": 65, 2026-02-17T05:31:55.341 INFO:tasks.workunit.client.0.trial030.stdout: "num_osds": 3, 2026-02-17T05:31:55.341 INFO:tasks.workunit.client.0.trial030.stdout: "num_per_pool_osds": 3, 2026-02-17T05:31:55.341 INFO:tasks.workunit.client.0.trial030.stdout: "num_per_pool_omap_osds": 3, 2026-02-17T05:31:55.341 INFO:tasks.workunit.client.0.trial030.stdout: "kb": 314572800, 2026-02-17T05:31:55.341 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used": 83952, 2026-02-17T05:31:55.341 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_data": 2168, 2026-02-17T05:31:55.341 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_omap": 29, 2026-02-17T05:31:55.341 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_meta": 81698, 2026-02-17T05:31:55.341 INFO:tasks.workunit.client.0.trial030.stdout: "kb_avail": 314488848, 2026-02-17T05:31:55.341 INFO:tasks.workunit.client.0.trial030.stdout: "statfs": { 2026-02-17T05:31:55.341 INFO:tasks.workunit.client.0.trial030.stdout: "total": 322122547200, 2026-02-17T05:31:55.341 INFO:tasks.workunit.client.0.trial030.stdout: "available": 322036580352, 2026-02-17T05:31:55.341 INFO:tasks.workunit.client.0.trial030.stdout: "internally_reserved": 0, 2026-02-17T05:31:55.341 INFO:tasks.workunit.client.0.trial030.stdout: "allocated": 2220032, 2026-02-17T05:31:55.341 INFO:tasks.workunit.client.0.trial030.stdout: "data_stored": 455884, 2026-02-17T05:31:55.341 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed": 0, 2026-02-17T05:31:55.341 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_allocated": 0, 2026-02-17T05:31:55.341 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_original": 0, 2026-02-17T05:31:55.341 INFO:tasks.workunit.client.0.trial030.stdout: "omap_allocated": 30616, 2026-02-17T05:31:55.341 INFO:tasks.workunit.client.0.trial030.stdout: "internal_metadata": 83658856 2026-02-17T05:31:55.341 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.341 INFO:tasks.workunit.client.0.trial030.stdout: "hb_peers": [], 2026-02-17T05:31:55.341 INFO:tasks.workunit.client.0.trial030.stdout: "snap_trim_queue_len": 0, 2026-02-17T05:31:55.341 INFO:tasks.workunit.client.0.trial030.stdout: "num_snap_trimming": 0, 2026-02-17T05:31:55.341 INFO:tasks.workunit.client.0.trial030.stdout: "num_shards_repaired": 0, 2026-02-17T05:31:55.341 INFO:tasks.workunit.client.0.trial030.stdout: "op_queue_age_hist": { 2026-02-17T05:31:55.342 INFO:tasks.workunit.client.0.trial030.stdout: "histogram": [], 2026-02-17T05:31:55.342 INFO:tasks.workunit.client.0.trial030.stdout: "upper_bound": 1 2026-02-17T05:31:55.342 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.342 INFO:tasks.workunit.client.0.trial030.stdout: "perf_stat": { 2026-02-17T05:31:55.342 INFO:tasks.workunit.client.0.trial030.stdout: "commit_latency_ms": 0, 2026-02-17T05:31:55.342 INFO:tasks.workunit.client.0.trial030.stdout: "apply_latency_ms": 0, 2026-02-17T05:31:55.342 INFO:tasks.workunit.client.0.trial030.stdout: "commit_latency_ns": 0, 2026-02-17T05:31:55.342 INFO:tasks.workunit.client.0.trial030.stdout: "apply_latency_ns": 0 2026-02-17T05:31:55.342 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.342 INFO:tasks.workunit.client.0.trial030.stdout: "alerts": [], 2026-02-17T05:31:55.342 INFO:tasks.workunit.client.0.trial030.stdout: "network_ping_times": [] 2026-02-17T05:31:55.342 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:31:55.342 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.342 INFO:tasks.workunit.client.0.trial030.stdout: "pool_stats": [ 2026-02-17T05:31:55.342 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.342 INFO:tasks.workunit.client.0.trial030.stdout: "poolid": 1, 2026-02-17T05:31:55.342 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg": 32, 2026-02-17T05:31:55.342 INFO:tasks.workunit.client.0.trial030.stdout: "stat_sum": { 2026-02-17T05:31:55.342 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes": 51200, 2026-02-17T05:31:55.342 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects": 100, 2026-02-17T05:31:55.342 INFO:tasks.workunit.client.0.trial030.stdout: "num_object_clones": 0, 2026-02-17T05:31:55.342 INFO:tasks.workunit.client.0.trial030.stdout: "num_object_copies": 300, 2026-02-17T05:31:55.342 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T05:31:55.342 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_missing": 0, 2026-02-17T05:31:55.342 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_degraded": 100, 2026-02-17T05:31:55.342 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_misplaced": 0, 2026-02-17T05:31:55.342 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_unfound": 0, 2026-02-17T05:31:55.342 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_dirty": 100, 2026-02-17T05:31:55.342 INFO:tasks.workunit.client.0.trial030.stdout: "num_whiteouts": 0, 2026-02-17T05:31:55.342 INFO:tasks.workunit.client.0.trial030.stdout: "num_read": 0, 2026-02-17T05:31:55.342 INFO:tasks.workunit.client.0.trial030.stdout: "num_read_kb": 0, 2026-02-17T05:31:55.342 INFO:tasks.workunit.client.0.trial030.stdout: "num_write": 100, 2026-02-17T05:31:55.343 INFO:tasks.workunit.client.0.trial030.stdout: "num_write_kb": 100, 2026-02-17T05:31:55.343 INFO:tasks.workunit.client.0.trial030.stdout: "num_scrub_errors": 0, 2026-02-17T05:31:55.343 INFO:tasks.workunit.client.0.trial030.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T05:31:55.343 INFO:tasks.workunit.client.0.trial030.stdout: "num_deep_scrub_errors": 0, 2026-02-17T05:31:55.343 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_recovered": 0, 2026-02-17T05:31:55.343 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes_recovered": 0, 2026-02-17T05:31:55.343 INFO:tasks.workunit.client.0.trial030.stdout: "num_keys_recovered": 0, 2026-02-17T05:31:55.343 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_omap": 0, 2026-02-17T05:31:55.343 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T05:31:55.343 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T05:31:55.343 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush": 0, 2026-02-17T05:31:55.343 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_kb": 0, 2026-02-17T05:31:55.343 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict": 0, 2026-02-17T05:31:55.343 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_kb": 0, 2026-02-17T05:31:55.343 INFO:tasks.workunit.client.0.trial030.stdout: "num_promote": 0, 2026-02-17T05:31:55.343 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_mode_high": 0, 2026-02-17T05:31:55.343 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_mode_low": 0, 2026-02-17T05:31:55.343 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_mode_some": 0, 2026-02-17T05:31:55.343 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_mode_full": 0, 2026-02-17T05:31:55.343 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_pinned": 0, 2026-02-17T05:31:55.343 INFO:tasks.workunit.client.0.trial030.stdout: "num_legacy_snapsets": 0, 2026-02-17T05:31:55.343 INFO:tasks.workunit.client.0.trial030.stdout: "num_large_omap_objects": 0, 2026-02-17T05:31:55.343 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_manifest": 0, 2026-02-17T05:31:55.343 INFO:tasks.workunit.client.0.trial030.stdout: "num_omap_bytes": 0, 2026-02-17T05:31:55.343 INFO:tasks.workunit.client.0.trial030.stdout: "num_omap_keys": 0, 2026-02-17T05:31:55.343 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_repaired": 0 2026-02-17T05:31:55.343 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.343 INFO:tasks.workunit.client.0.trial030.stdout: "store_stats": { 2026-02-17T05:31:55.343 INFO:tasks.workunit.client.0.trial030.stdout: "total": 0, 2026-02-17T05:31:55.343 INFO:tasks.workunit.client.0.trial030.stdout: "available": 0, 2026-02-17T05:31:55.343 INFO:tasks.workunit.client.0.trial030.stdout: "internally_reserved": 0, 2026-02-17T05:31:55.343 INFO:tasks.workunit.client.0.trial030.stdout: "allocated": 1220608, 2026-02-17T05:31:55.344 INFO:tasks.workunit.client.0.trial030.stdout: "data_stored": 153552, 2026-02-17T05:31:55.344 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed": 0, 2026-02-17T05:31:55.344 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_allocated": 0, 2026-02-17T05:31:55.344 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_original": 0, 2026-02-17T05:31:55.344 INFO:tasks.workunit.client.0.trial030.stdout: "omap_allocated": 0, 2026-02-17T05:31:55.344 INFO:tasks.workunit.client.0.trial030.stdout: "internal_metadata": 0 2026-02-17T05:31:55.344 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.344 INFO:tasks.workunit.client.0.trial030.stdout: "log_size": 512, 2026-02-17T05:31:55.344 INFO:tasks.workunit.client.0.trial030.stdout: "ondisk_log_size": 512, 2026-02-17T05:31:55.344 INFO:tasks.workunit.client.0.trial030.stdout: "up": 64, 2026-02-17T05:31:55.344 INFO:tasks.workunit.client.0.trial030.stdout: "acting": 64, 2026-02-17T05:31:55.344 INFO:tasks.workunit.client.0.trial030.stdout: "num_store_stats": 3 2026-02-17T05:31:55.344 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:31:55.344 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:31:55.344 INFO:tasks.workunit.client.0.trial030.stdout: "osd_stats": [ 2026-02-17T05:31:55.344 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.344 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 0, 2026-02-17T05:31:55.344 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 154618822665 2026-02-17T05:31:55.344 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.344 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.344 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 1, 2026-02-17T05:31:55.344 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 38654705676 2026-02-17T05:31:55.344 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.344 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.344 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2, 2026-02-17T05:31:55.344 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 167503724552 2026-02-17T05:31:55.344 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:31:55.344 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:31:55.344 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg_by_state": [ 2026-02-17T05:31:55.344 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.344 INFO:tasks.workunit.client.0.trial030.stdout: "state": "active+undersized+degraded+wait", 2026-02-17T05:31:55.344 INFO:tasks.workunit.client.0.trial030.stdout: "num": 1 2026-02-17T05:31:55.344 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.345 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.345 INFO:tasks.workunit.client.0.trial030.stdout: "state": "active+undersized+degraded", 2026-02-17T05:31:55.345 INFO:tasks.workunit.client.0.trial030.stdout: "num": 31 2026-02-17T05:31:55.345 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:31:55.345 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:31:55.345 INFO:tasks.workunit.client.0.trial030.stdout: "pool_pg_unavailable_map": [ 2026-02-17T05:31:55.345 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.345 INFO:tasks.workunit.client.0.trial030.stdout: "poolid": "1", 2026-02-17T05:31:55.345 INFO:tasks.workunit.client.0.trial030.stdout: "pgs": [] 2026-02-17T05:31:55.345 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:31:55.345 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:31:55.345 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg_by_osd": [ 2026-02-17T05:31:55.345 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.345 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2, 2026-02-17T05:31:55.345 INFO:tasks.workunit.client.0.trial030.stdout: "num_primary_pg": 0, 2026-02-17T05:31:55.345 INFO:tasks.workunit.client.0.trial030.stdout: "num_acting_pg": 32, 2026-02-17T05:31:55.345 INFO:tasks.workunit.client.0.trial030.stdout: "num_up_not_acting_pg": 0 2026-02-17T05:31:55.345 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.345 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.345 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 0, 2026-02-17T05:31:55.345 INFO:tasks.workunit.client.0.trial030.stdout: "num_primary_pg": 32, 2026-02-17T05:31:55.345 INFO:tasks.workunit.client.0.trial030.stdout: "num_acting_pg": 32, 2026-02-17T05:31:55.345 INFO:tasks.workunit.client.0.trial030.stdout: "num_up_not_acting_pg": 0 2026-02-17T05:31:55.345 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.345 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.345 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 1, 2026-02-17T05:31:55.345 INFO:tasks.workunit.client.0.trial030.stdout: "num_primary_pg": 0, 2026-02-17T05:31:55.345 INFO:tasks.workunit.client.0.trial030.stdout: "num_acting_pg": 0, 2026-02-17T05:31:55.345 INFO:tasks.workunit.client.0.trial030.stdout: "num_up_not_acting_pg": 0 2026-02-17T05:31:55.345 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:31:55.345 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:31:55.345 INFO:tasks.workunit.client.0.trial030.stdout: "purged_snaps": [ 2026-02-17T05:31:55.345 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:31:55.346 INFO:tasks.workunit.client.0.trial030.stdout: "pool": 1, 2026-02-17T05:31:55.346 INFO:tasks.workunit.client.0.trial030.stdout: "purged_snaps": {} 2026-02-17T05:31:55.346 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:31:55.346 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:31:55.346 INFO:tasks.workunit.client.0.trial030.stdout: "servicemap": { 2026-02-17T05:31:55.346 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 3, 2026-02-17T05:31:55.346 INFO:tasks.workunit.client.0.trial030.stdout: "modified": "2026-02-17T05:31:51.310991+0000", 2026-02-17T05:31:55.346 INFO:tasks.workunit.client.0.trial030.stdout: "services": { 2026-02-17T05:31:55.346 INFO:tasks.workunit.client.0.trial030.stdout: "osd": { 2026-02-17T05:31:55.346 INFO:tasks.workunit.client.0.trial030.stdout: "daemons": { 2026-02-17T05:31:55.346 INFO:tasks.workunit.client.0.trial030.stdout: "summary": "", 2026-02-17T05:31:55.346 INFO:tasks.workunit.client.0.trial030.stdout: "0": { 2026-02-17T05:31:55.346 INFO:tasks.workunit.client.0.trial030.stdout: "start_epoch": 0, 2026-02-17T05:31:55.346 INFO:tasks.workunit.client.0.trial030.stdout: "start_stamp": "0.000000", 2026-02-17T05:31:55.346 INFO:tasks.workunit.client.0.trial030.stdout: "gid": 0, 2026-02-17T05:31:55.346 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-17T05:31:55.346 INFO:tasks.workunit.client.0.trial030.stdout: "metadata": {}, 2026-02-17T05:31:55.346 INFO:tasks.workunit.client.0.trial030.stdout: "task_status": {} 2026-02-17T05:31:55.346 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.346 INFO:tasks.workunit.client.0.trial030.stdout: "2": { 2026-02-17T05:31:55.346 INFO:tasks.workunit.client.0.trial030.stdout: "start_epoch": 0, 2026-02-17T05:31:55.346 INFO:tasks.workunit.client.0.trial030.stdout: "start_stamp": "0.000000", 2026-02-17T05:31:55.346 INFO:tasks.workunit.client.0.trial030.stdout: "gid": 0, 2026-02-17T05:31:55.346 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-17T05:31:55.346 INFO:tasks.workunit.client.0.trial030.stdout: "metadata": {}, 2026-02-17T05:31:55.346 INFO:tasks.workunit.client.0.trial030.stdout: "task_status": {} 2026-02-17T05:31:55.346 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:31:55.346 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:31:55.346 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:31:55.346 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:31:55.346 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:31:55.346 INFO:tasks.workunit.client.0.trial030.stdout: "mgrstat_first_committed": 1, 2026-02-17T05:31:55.346 INFO:tasks.workunit.client.0.trial030.stdout: "mgrstat_last_committed": 36, 2026-02-17T05:31:55.346 INFO:tasks.workunit.client.0.trial030.stdout: "logm_first_committed": 1, 2026-02-17T05:31:55.346 INFO:tasks.workunit.client.0.trial030.stdout: "logm_last_committed": 228, 2026-02-17T05:31:55.347 INFO:tasks.workunit.client.0.trial030.stdout: "paxos": { 2026-02-17T05:31:55.347 INFO:tasks.workunit.client.0.trial030.stdout: "first_committed": 1, 2026-02-17T05:31:55.347 INFO:tasks.workunit.client.0.trial030.stdout: "last_committed": 319, 2026-02-17T05:31:55.347 INFO:tasks.workunit.client.0.trial030.stdout: "last_pn": 0, 2026-02-17T05:31:55.347 INFO:tasks.workunit.client.0.trial030.stdout: "accepted_pn": 0 2026-02-17T05:31:55.347 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:31:55.347 INFO:tasks.workunit.client.0.trial030.stdout:} 2026-02-17T05:31:55.347 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-17T05:31:55.347 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:755: TEST_divergent_3: expr 2 + 2 2026-02-17T05:31:55.347 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:755: TEST_divergent_3: objname=existing_4 2026-02-17T05:31:55.347 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:756: TEST_divergent_3: echo 'writing non-divergent object existing_4' 2026-02-17T05:31:55.347 INFO:tasks.workunit.client.0.trial030.stdout:writing non-divergent object existing_4 2026-02-17T05:31:55.347 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:757: TEST_divergent_3: ceph pg dump pgs 2026-02-17T05:31:55.494 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T05:31:55.494 INFO:tasks.workunit.client.0.trial030.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475386+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:31:55.494 INFO:tasks.workunit.client.0.trial030.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475735+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:31:55.494 INFO:tasks.workunit.client.0.trial030.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475384+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:31:55.494 INFO:tasks.workunit.client.0.trial030.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473236+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:31:55.494 INFO:tasks.workunit.client.0.trial030.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473301+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:31:55.494 INFO:tasks.workunit.client.0.trial030.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473278+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:31:55.494 INFO:tasks.workunit.client.0.trial030.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473183+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:31:55.494 INFO:tasks.workunit.client.0.trial030.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473574+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:31:55.494 INFO:tasks.workunit.client.0.trial030.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473683+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:31:55.494 INFO:tasks.workunit.client.0.trial030.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473242+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:31:55.495 INFO:tasks.workunit.client.0.trial030.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473269+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:31:55.495 INFO:tasks.workunit.client.0.trial030.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475754+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:31:55.495 INFO:tasks.workunit.client.0.trial030.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473125+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:31:55.495 INFO:tasks.workunit.client.0.trial030.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473523+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:31:55.495 INFO:tasks.workunit.client.0.trial030.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.472885+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:31:55.495 INFO:tasks.workunit.client.0.trial030.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475660+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:31:55.495 INFO:tasks.workunit.client.0.trial030.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded+wait 2026-02-17T05:31:47.469549+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:31:55.495 INFO:tasks.workunit.client.0.trial030.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473488+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:31:55.495 INFO:tasks.workunit.client.0.trial030.stdout:1.e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473420+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:31:55.495 INFO:tasks.workunit.client.0.trial030.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473513+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:31:55.495 INFO:tasks.workunit.client.0.trial030.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.474067+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:31:55.495 INFO:tasks.workunit.client.0.trial030.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.474512+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:31:55.495 INFO:tasks.workunit.client.0.trial030.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473926+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:31:55.495 INFO:tasks.workunit.client.0.trial030.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473600+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:31:55.495 INFO:tasks.workunit.client.0.trial030.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475615+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:31:55.495 INFO:tasks.workunit.client.0.trial030.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475686+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:31:55.495 INFO:tasks.workunit.client.0.trial030.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475643+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:31:55.495 INFO:tasks.workunit.client.0.trial030.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475538+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:31:55.495 INFO:tasks.workunit.client.0.trial030.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473932+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:31:55.495 INFO:tasks.workunit.client.0.trial030.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473622+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:31:55.495 INFO:tasks.workunit.client.0.trial030.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475784+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:31:55.495 INFO:tasks.workunit.client.0.trial030.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475304+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:31:55.495 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-17T05:31:55.495 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T05:31:55.496 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:31:55.503 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:758: TEST_divergent_3: rados -p test put existing_4 /tmp/tmp.vcKO1qtdwa 2026-02-17T05:31:55.533 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:760: TEST_divergent_3: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-17T05:31:55.533 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:760: TEST_divergent_3: wait_for_clean 2026-02-17T05:31:55.533 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T05:31:55.533 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T05:31:55.533 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T05:31:55.534 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-17T05:31:55.534 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T05:31:55.534 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T05:31:55.534 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T05:31:55.534 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T05:31:55.535 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T05:31:55.605 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-17T05:31:55.605 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T05:31:55.605 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T05:31:55.605 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T05:31:55.605 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T05:31:55.605 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:31:55.818 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:31:55.818 INFO:tasks.workunit.client.0.trial030.stderr:1 2026-02-17T05:31:55.819 INFO:tasks.workunit.client.0.trial030.stderr:2' 2026-02-17T05:31:55.819 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:31:55.819 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:31:55.819 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T05:31:55.900 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=154618822667 2026-02-17T05:31:55.900 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 154618822667 2026-02-17T05:31:55.901 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-154618822667' 2026-02-17T05:31:55.901 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:31:55.901 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T05:31:55.962 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-17T05:31:55.962 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: true 2026-02-17T05:31:55.962 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-17T05:31:55.962 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: continue 2026-02-17T05:31:55.962 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:31:55.963 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T05:31:56.047 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=167503724555 2026-02-17T05:31:56.047 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 167503724555 2026-02-17T05:31:56.047 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-154618822667 2-167503724555' 2026-02-17T05:31:56.047 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:31:56.047 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-154618822667 2026-02-17T05:31:56.047 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:31:56.049 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:31:56.049 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-154618822667 2026-02-17T05:31:56.050 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:31:56.051 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=154618822667 2026-02-17T05:31:56.051 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 154618822667' 2026-02-17T05:31:56.051 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.0 seq 154618822667 2026-02-17T05:31:56.051 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:31:56.277 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 154618822665 -lt 154618822667 2026-02-17T05:31:56.277 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:31:57.278 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T05:31:57.278 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:31:57.497 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 154618822667 -lt 154618822667 2026-02-17T05:31:57.497 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:31:57.498 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-167503724555 2026-02-17T05:31:57.498 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:31:57.499 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:31:57.500 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-167503724555 2026-02-17T05:31:57.500 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:31:57.502 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=167503724555 2026-02-17T05:31:57.502 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.2 seq 167503724555 2026-02-17T05:31:57.503 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 167503724555' 2026-02-17T05:31:57.503 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:31:57.732 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 167503724555 -lt 167503724555 2026-02-17T05:31:57.732 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T05:31:57.733 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:31:57.733 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:31:58.028 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 32 == 0 2026-02-17T05:31:58.029 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:31:58.029 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:31:58.029 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:31:58.029 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:31:58.029 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:31:58.029 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:31:58.029 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:31:58.254 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:31:58.254 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:31:58.255 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:31:58.255 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:31:58.547 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-17T05:31:58.547 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-17T05:31:58.547 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-17T05:31:58.547 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-17T05:31:58.547 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T05:31:58.547 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-17T05:31:58.647 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T05:31:58.647 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:31:58.647 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:31:58.647 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:31:58.647 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:31:58.647 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:31:58.648 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:31:58.648 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:31:58.863 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:31:58.864 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:31:58.864 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:31:58.864 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:31:59.152 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-17T05:31:59.152 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T05:31:59.152 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T05:31:59.152 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T05:31:59.152 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T05:31:59.152 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T05:31:59.153 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T05:31:59.153 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T05:31:59.153 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T05:31:59.441 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T05:31:59.441 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T05:31:59.441 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-17T05:31:59.441 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T05:31:59.441 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-17T05:31:59.642 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T05:31:59.642 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:31:59.643 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:31:59.643 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:31:59.644 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:31:59.644 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:31:59.644 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:31:59.644 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:31:59.855 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:31:59.856 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:31:59.856 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:31:59.857 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:32:00.149 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-17T05:32:00.149 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T05:32:00.149 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T05:32:00.149 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T05:32:00.149 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T05:32:00.149 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T05:32:00.149 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T05:32:00.149 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T05:32:00.149 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T05:32:00.443 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T05:32:00.443 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T05:32:00.444 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-17T05:32:00.444 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T05:32:00.444 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-17T05:32:00.843 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T05:32:00.844 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:32:00.844 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:32:00.844 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:32:00.844 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:32:00.844 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:32:00.845 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:32:00.845 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:32:01.062 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:32:01.063 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:32:01.063 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:32:01.063 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:32:01.364 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-17T05:32:01.364 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T05:32:01.364 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T05:32:01.364 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T05:32:01.364 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T05:32:01.365 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T05:32:01.365 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T05:32:01.365 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T05:32:01.365 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T05:32:01.658 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T05:32:01.658 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T05:32:01.658 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-17T05:32:01.658 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T05:32:01.658 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-17T05:32:02.459 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T05:32:02.459 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:32:02.459 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:32:02.459 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:32:02.459 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:32:02.460 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:32:02.460 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:32:02.460 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:32:02.672 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:32:02.673 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:32:02.673 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:32:02.673 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:32:02.969 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-17T05:32:02.969 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T05:32:02.969 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T05:32:02.969 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T05:32:02.969 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T05:32:02.970 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T05:32:02.970 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T05:32:02.970 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T05:32:02.970 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T05:32:03.261 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T05:32:03.261 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T05:32:03.261 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-17T05:32:03.261 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T05:32:03.261 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-17T05:32:04.862 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T05:32:04.862 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:32:04.863 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:32:04.863 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:32:04.863 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:32:04.863 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:32:04.863 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:32:04.863 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:32:05.079 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:32:05.080 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:32:05.080 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:32:05.081 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:32:05.370 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-17T05:32:05.370 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T05:32:05.370 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T05:32:05.370 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T05:32:05.370 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T05:32:05.370 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T05:32:05.370 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T05:32:05.371 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T05:32:05.371 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T05:32:05.658 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T05:32:05.658 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T05:32:05.658 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-17T05:32:05.658 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T05:32:05.658 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-17T05:32:08.859 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T05:32:08.859 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:32:08.860 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:32:08.860 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:32:08.860 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:32:08.860 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:32:08.860 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:32:08.860 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:32:09.077 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:32:09.077 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:32:09.077 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:32:09.078 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:32:09.372 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-17T05:32:09.372 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T05:32:09.372 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T05:32:09.372 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T05:32:09.372 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T05:32:09.372 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T05:32:09.373 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T05:32:09.373 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T05:32:09.373 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T05:32:09.665 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T05:32:09.665 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T05:32:09.665 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-17T05:32:09.665 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T05:32:09.665 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-17T05:32:16.065 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T05:32:16.065 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:32:16.066 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:32:16.066 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:32:16.066 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:32:16.066 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:32:16.067 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:32:16.067 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:32:16.296 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:32:16.297 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:32:16.297 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:32:16.297 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:32:16.587 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-17T05:32:16.588 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T05:32:16.588 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T05:32:16.588 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T05:32:16.588 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T05:32:16.588 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T05:32:16.588 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T05:32:16.588 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T05:32:16.588 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T05:32:16.875 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T05:32:16.876 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T05:32:16.876 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-17T05:32:16.876 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T05:32:16.876 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-17T05:32:24.176 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T05:32:24.176 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:32:24.178 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:32:24.178 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:32:24.178 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:32:24.178 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:32:24.178 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:32:24.178 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:32:24.391 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:32:24.391 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:32:24.392 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:32:24.392 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:32:24.684 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-17T05:32:24.684 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T05:32:24.685 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T05:32:24.685 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T05:32:24.685 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T05:32:24.685 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T05:32:24.685 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T05:32:24.685 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T05:32:24.685 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T05:32:24.977 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T05:32:24.977 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T05:32:24.977 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-17T05:32:24.977 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-17T05:32:25.265 INFO:tasks.workunit.client.0.trial030.stdout:{ 2026-02-17T05:32:25.265 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_fingerprint": "9b3e8454-c7ae-4678-b5e9-7e250144f229", 2026-02-17T05:32:25.265 INFO:tasks.workunit.client.0.trial030.stdout: "version": "20.3.0-5271-g32585015", 2026-02-17T05:32:25.265 INFO:tasks.workunit.client.0.trial030.stdout: "commit": "325850157d309f65985eea9ec9bb9f1d56726fee", 2026-02-17T05:32:25.265 INFO:tasks.workunit.client.0.trial030.stdout: "timestamp": "2026-02-17T05:32:25.262999+0000", 2026-02-17T05:32:25.266 INFO:tasks.workunit.client.0.trial030.stdout: "tag": "", 2026-02-17T05:32:25.266 INFO:tasks.workunit.client.0.trial030.stdout: "health": { 2026-02-17T05:32:25.266 INFO:tasks.workunit.client.0.trial030.stdout: "status": "HEALTH_WARN", 2026-02-17T05:32:25.266 INFO:tasks.workunit.client.0.trial030.stdout: "checks": { 2026-02-17T05:32:25.266 INFO:tasks.workunit.client.0.trial030.stdout: "OSDMAP_FLAGS": { 2026-02-17T05:32:25.266 INFO:tasks.workunit.client.0.trial030.stdout: "severity": "HEALTH_WARN", 2026-02-17T05:32:25.267 INFO:tasks.workunit.client.0.trial030.stdout: "summary": { 2026-02-17T05:32:25.267 INFO:tasks.workunit.client.0.trial030.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-17T05:32:25.267 INFO:tasks.workunit.client.0.trial030.stdout: "count": 17 2026-02-17T05:32:25.267 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.267 INFO:tasks.workunit.client.0.trial030.stdout: "detail": [], 2026-02-17T05:32:25.267 INFO:tasks.workunit.client.0.trial030.stdout: "muted": false 2026-02-17T05:32:25.268 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.268 INFO:tasks.workunit.client.0.trial030.stdout: "OSD_DOWN": { 2026-02-17T05:32:25.268 INFO:tasks.workunit.client.0.trial030.stdout: "severity": "HEALTH_WARN", 2026-02-17T05:32:25.268 INFO:tasks.workunit.client.0.trial030.stdout: "summary": { 2026-02-17T05:32:25.268 INFO:tasks.workunit.client.0.trial030.stdout: "message": "1 osds down", 2026-02-17T05:32:25.268 INFO:tasks.workunit.client.0.trial030.stdout: "count": 1 2026-02-17T05:32:25.268 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.268 INFO:tasks.workunit.client.0.trial030.stdout: "detail": [ 2026-02-17T05:32:25.269 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.269 INFO:tasks.workunit.client.0.trial030.stdout: "message": "osd.1 (root=default,host=trial030) is down" 2026-02-17T05:32:25.269 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:32:25.269 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:32:25.269 INFO:tasks.workunit.client.0.trial030.stdout: "muted": false 2026-02-17T05:32:25.269 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.269 INFO:tasks.workunit.client.0.trial030.stdout: "PG_DEGRADED": { 2026-02-17T05:32:25.269 INFO:tasks.workunit.client.0.trial030.stdout: "severity": "HEALTH_WARN", 2026-02-17T05:32:25.270 INFO:tasks.workunit.client.0.trial030.stdout: "summary": { 2026-02-17T05:32:25.270 INFO:tasks.workunit.client.0.trial030.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 32 pgs degraded", 2026-02-17T05:32:25.270 INFO:tasks.workunit.client.0.trial030.stdout: "count": 32 2026-02-17T05:32:25.270 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.270 INFO:tasks.workunit.client.0.trial030.stdout: "detail": [ 2026-02-17T05:32:25.270 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.270 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [0,2]" 2026-02-17T05:32:25.270 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.270 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.271 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.1 is active+undersized+degraded, acting [0,2]" 2026-02-17T05:32:25.271 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.271 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.271 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.2 is active+undersized+degraded, acting [0,2]" 2026-02-17T05:32:25.271 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.271 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.271 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.3 is active+undersized+degraded, acting [0,2]" 2026-02-17T05:32:25.271 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.272 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.272 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.4 is active+undersized+degraded, acting [0,2]" 2026-02-17T05:32:25.272 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.272 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.272 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.5 is active+undersized+degraded, acting [0,2]" 2026-02-17T05:32:25.272 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.272 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.272 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.6 is active+undersized+degraded, acting [0,2]" 2026-02-17T05:32:25.272 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.273 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.273 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.7 is active+undersized+degraded, acting [0,2]" 2026-02-17T05:32:25.273 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.273 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.273 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.8 is active+undersized+degraded, acting [0,2]" 2026-02-17T05:32:25.273 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.273 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.273 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.9 is active+undersized+degraded, acting [0,2]" 2026-02-17T05:32:25.274 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.274 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.274 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.a is active+undersized+degraded, acting [0,2]" 2026-02-17T05:32:25.274 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.274 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.274 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.b is active+undersized+degraded, acting [0,2]" 2026-02-17T05:32:25.274 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.274 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.274 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.c is active+undersized+degraded, acting [0,2]" 2026-02-17T05:32:25.275 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.275 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.275 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.d is active+undersized+degraded, acting [0,2]" 2026-02-17T05:32:25.275 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.275 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.275 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.e is active+undersized+degraded, acting [0,2]" 2026-02-17T05:32:25.275 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.275 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.275 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.f is active+undersized+degraded, acting [0,2]" 2026-02-17T05:32:25.276 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.276 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.276 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.10 is active+undersized+degraded, acting [0,2]" 2026-02-17T05:32:25.276 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.276 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.276 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.11 is active+undersized+degraded, acting [0,2]" 2026-02-17T05:32:25.276 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.276 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.277 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.12 is active+undersized+degraded, acting [0,2]" 2026-02-17T05:32:25.277 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.277 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.277 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.13 is active+undersized+degraded, acting [0,2]" 2026-02-17T05:32:25.277 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.277 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.277 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.14 is active+undersized+degraded, acting [0,2]" 2026-02-17T05:32:25.277 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.278 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.278 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.15 is active+undersized+degraded, acting [0,2]" 2026-02-17T05:32:25.278 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.278 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.278 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.16 is active+undersized+degraded, acting [0,2]" 2026-02-17T05:32:25.278 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.278 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.278 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.17 is active+undersized+degraded, acting [0,2]" 2026-02-17T05:32:25.278 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.279 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.279 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.18 is active+undersized+degraded, acting [0,2]" 2026-02-17T05:32:25.279 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.279 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.279 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.19 is active+undersized+degraded, acting [0,2]" 2026-02-17T05:32:25.279 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.279 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.279 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.1a is active+undersized+degraded, acting [0,2]" 2026-02-17T05:32:25.279 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.279 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.279 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.1b is active+undersized+degraded, acting [0,2]" 2026-02-17T05:32:25.280 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.280 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.280 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.1c is active+undersized+degraded, acting [0,2]" 2026-02-17T05:32:25.280 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.280 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.280 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.1d is active+undersized+degraded, acting [0,2]" 2026-02-17T05:32:25.280 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.280 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.280 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.1e is active+undersized+degraded, acting [0,2]" 2026-02-17T05:32:25.280 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.280 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.280 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.1f is active+undersized+degraded, acting [0,2]" 2026-02-17T05:32:25.280 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:32:25.281 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:32:25.281 INFO:tasks.workunit.client.0.trial030.stdout: "muted": false 2026-02-17T05:32:25.281 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:32:25.281 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.281 INFO:tasks.workunit.client.0.trial030.stdout: "mutes": [] 2026-02-17T05:32:25.281 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.281 INFO:tasks.workunit.client.0.trial030.stdout: "monmap_first_committed": 1, 2026-02-17T05:32:25.281 INFO:tasks.workunit.client.0.trial030.stdout: "monmap_last_committed": 1, 2026-02-17T05:32:25.281 INFO:tasks.workunit.client.0.trial030.stdout: "monmap": { 2026-02-17T05:32:25.281 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 1, 2026-02-17T05:32:25.281 INFO:tasks.workunit.client.0.trial030.stdout: "fsid": "931b36d9-02d4-44f0-bc8b-c9190b7fdb00", 2026-02-17T05:32:25.281 INFO:tasks.workunit.client.0.trial030.stdout: "modified": "2026-02-17T05:30:42.805073Z", 2026-02-17T05:32:25.282 INFO:tasks.workunit.client.0.trial030.stdout: "created": "2026-02-17T05:30:42.805073Z", 2026-02-17T05:32:25.282 INFO:tasks.workunit.client.0.trial030.stdout: "min_mon_release": 20, 2026-02-17T05:32:25.282 INFO:tasks.workunit.client.0.trial030.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:32:25.282 INFO:tasks.workunit.client.0.trial030.stdout: "election_strategy": 1, 2026-02-17T05:32:25.282 INFO:tasks.workunit.client.0.trial030.stdout: "disallowed_leaders": "", 2026-02-17T05:32:25.282 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_mode": false, 2026-02-17T05:32:25.282 INFO:tasks.workunit.client.0.trial030.stdout: "tiebreaker_mon": "", 2026-02-17T05:32:25.282 INFO:tasks.workunit.client.0.trial030.stdout: "removed_ranks": "", 2026-02-17T05:32:25.282 INFO:tasks.workunit.client.0.trial030.stdout: "features": { 2026-02-17T05:32:25.282 INFO:tasks.workunit.client.0.trial030.stdout: "persistent": [ 2026-02-17T05:32:25.282 INFO:tasks.workunit.client.0.trial030.stdout: "kraken", 2026-02-17T05:32:25.282 INFO:tasks.workunit.client.0.trial030.stdout: "luminous", 2026-02-17T05:32:25.283 INFO:tasks.workunit.client.0.trial030.stdout: "mimic", 2026-02-17T05:32:25.283 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap-prune", 2026-02-17T05:32:25.283 INFO:tasks.workunit.client.0.trial030.stdout: "nautilus", 2026-02-17T05:32:25.283 INFO:tasks.workunit.client.0.trial030.stdout: "octopus", 2026-02-17T05:32:25.283 INFO:tasks.workunit.client.0.trial030.stdout: "pacific", 2026-02-17T05:32:25.283 INFO:tasks.workunit.client.0.trial030.stdout: "elector-pinging", 2026-02-17T05:32:25.283 INFO:tasks.workunit.client.0.trial030.stdout: "quincy", 2026-02-17T05:32:25.283 INFO:tasks.workunit.client.0.trial030.stdout: "reef", 2026-02-17T05:32:25.283 INFO:tasks.workunit.client.0.trial030.stdout: "squid", 2026-02-17T05:32:25.283 INFO:tasks.workunit.client.0.trial030.stdout: "tentacle", 2026-02-17T05:32:25.283 INFO:tasks.workunit.client.0.trial030.stdout: "nvmeof_beacon_diff" 2026-02-17T05:32:25.283 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:32:25.284 INFO:tasks.workunit.client.0.trial030.stdout: "optional": [] 2026-02-17T05:32:25.284 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.284 INFO:tasks.workunit.client.0.trial030.stdout: "mons": [ 2026-02-17T05:32:25.284 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.284 INFO:tasks.workunit.client.0.trial030.stdout: "rank": 0, 2026-02-17T05:32:25.284 INFO:tasks.workunit.client.0.trial030.stdout: "name": "a", 2026-02-17T05:32:25.284 INFO:tasks.workunit.client.0.trial030.stdout: "public_addrs": { 2026-02-17T05:32:25.284 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:32:25.284 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.284 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:32:25.284 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:7115", 2026-02-17T05:32:25.284 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 0 2026-02-17T05:32:25.284 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:32:25.285 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:32:25.285 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.285 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:7115/0", 2026-02-17T05:32:25.285 INFO:tasks.workunit.client.0.trial030.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-17T05:32:25.285 INFO:tasks.workunit.client.0.trial030.stdout: "priority": 0, 2026-02-17T05:32:25.285 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 0, 2026-02-17T05:32:25.285 INFO:tasks.workunit.client.0.trial030.stdout: "time_added": "2026-02-17T05:30:42:805067+0000", 2026-02-17T05:32:25.285 INFO:tasks.workunit.client.0.trial030.stdout: "crush_location": [] 2026-02-17T05:32:25.285 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:32:25.285 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:32:25.285 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.285 INFO:tasks.workunit.client.0.trial030.stdout: "quorum": [ 2026-02-17T05:32:25.285 INFO:tasks.workunit.client.0.trial030.stdout: 0 2026-02-17T05:32:25.286 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:32:25.286 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap": { 2026-02-17T05:32:25.286 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 45, 2026-02-17T05:32:25.286 INFO:tasks.workunit.client.0.trial030.stdout: "fsid": "931b36d9-02d4-44f0-bc8b-c9190b7fdb00", 2026-02-17T05:32:25.286 INFO:tasks.workunit.client.0.trial030.stdout: "created": "2026-02-17T05:30:42.887795+0000", 2026-02-17T05:32:25.286 INFO:tasks.workunit.client.0.trial030.stdout: "modified": "2026-02-17T05:31:47.462777+0000", 2026-02-17T05:32:25.286 INFO:tasks.workunit.client.0.trial030.stdout: "last_up_change": "2026-02-17T05:31:24.639578+0000", 2026-02-17T05:32:25.286 INFO:tasks.workunit.client.0.trial030.stdout: "last_in_change": "2026-02-17T05:31:25.603220+0000", 2026-02-17T05:32:25.286 INFO:tasks.workunit.client.0.trial030.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-17T05:32:25.286 INFO:tasks.workunit.client.0.trial030.stdout: "flags_num": 5800384, 2026-02-17T05:32:25.286 INFO:tasks.workunit.client.0.trial030.stdout: "flags_set": [ 2026-02-17T05:32:25.286 INFO:tasks.workunit.client.0.trial030.stdout: "nodown", 2026-02-17T05:32:25.286 INFO:tasks.workunit.client.0.trial030.stdout: "noin", 2026-02-17T05:32:25.287 INFO:tasks.workunit.client.0.trial030.stdout: "noout", 2026-02-17T05:32:25.287 INFO:tasks.workunit.client.0.trial030.stdout: "pglog_hardlimit", 2026-02-17T05:32:25.287 INFO:tasks.workunit.client.0.trial030.stdout: "purged_snapdirs", 2026-02-17T05:32:25.287 INFO:tasks.workunit.client.0.trial030.stdout: "recovery_deletes", 2026-02-17T05:32:25.287 INFO:tasks.workunit.client.0.trial030.stdout: "sortbitwise" 2026-02-17T05:32:25.287 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:32:25.287 INFO:tasks.workunit.client.0.trial030.stdout: "crush_version": 9, 2026-02-17T05:32:25.287 INFO:tasks.workunit.client.0.trial030.stdout: "full_ratio": 0.99000000953674316, 2026-02-17T05:32:25.287 INFO:tasks.workunit.client.0.trial030.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-17T05:32:25.287 INFO:tasks.workunit.client.0.trial030.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-17T05:32:25.287 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_snapshot": "", 2026-02-17T05:32:25.287 INFO:tasks.workunit.client.0.trial030.stdout: "pool_max": 1, 2026-02-17T05:32:25.288 INFO:tasks.workunit.client.0.trial030.stdout: "max_osd": 3, 2026-02-17T05:32:25.288 INFO:tasks.workunit.client.0.trial030.stdout: "require_min_compat_client": "luminous", 2026-02-17T05:32:25.288 INFO:tasks.workunit.client.0.trial030.stdout: "min_compat_client": "jewel", 2026-02-17T05:32:25.288 INFO:tasks.workunit.client.0.trial030.stdout: "require_osd_release": "tentacle", 2026-02-17T05:32:25.288 INFO:tasks.workunit.client.0.trial030.stdout: "allow_crimson": false, 2026-02-17T05:32:25.288 INFO:tasks.workunit.client.0.trial030.stdout: "pools": [ 2026-02-17T05:32:25.288 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.288 INFO:tasks.workunit.client.0.trial030.stdout: "pool": 1, 2026-02-17T05:32:25.288 INFO:tasks.workunit.client.0.trial030.stdout: "pool_name": "test", 2026-02-17T05:32:25.288 INFO:tasks.workunit.client.0.trial030.stdout: "create_time": "2026-02-17T05:30:55.088171+0000", 2026-02-17T05:32:25.288 INFO:tasks.workunit.client.0.trial030.stdout: "flags": 1, 2026-02-17T05:32:25.288 INFO:tasks.workunit.client.0.trial030.stdout: "flags_names": "hashpspool", 2026-02-17T05:32:25.289 INFO:tasks.workunit.client.0.trial030.stdout: "type": 1, 2026-02-17T05:32:25.289 INFO:tasks.workunit.client.0.trial030.stdout: "size": 3, 2026-02-17T05:32:25.289 INFO:tasks.workunit.client.0.trial030.stdout: "min_size": 2, 2026-02-17T05:32:25.289 INFO:tasks.workunit.client.0.trial030.stdout: "crush_rule": 0, 2026-02-17T05:32:25.289 INFO:tasks.workunit.client.0.trial030.stdout: "peering_crush_bucket_count": 0, 2026-02-17T05:32:25.289 INFO:tasks.workunit.client.0.trial030.stdout: "peering_crush_bucket_target": 0, 2026-02-17T05:32:25.289 INFO:tasks.workunit.client.0.trial030.stdout: "peering_crush_bucket_barrier": 0, 2026-02-17T05:32:25.289 INFO:tasks.workunit.client.0.trial030.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-17T05:32:25.289 INFO:tasks.workunit.client.0.trial030.stdout: "is_stretch_pool": false, 2026-02-17T05:32:25.289 INFO:tasks.workunit.client.0.trial030.stdout: "object_hash": 2, 2026-02-17T05:32:25.289 INFO:tasks.workunit.client.0.trial030.stdout: "pg_autoscale_mode": "on", 2026-02-17T05:32:25.289 INFO:tasks.workunit.client.0.trial030.stdout: "pg_num": 32, 2026-02-17T05:32:25.290 INFO:tasks.workunit.client.0.trial030.stdout: "pg_placement_num": 1, 2026-02-17T05:32:25.290 INFO:tasks.workunit.client.0.trial030.stdout: "pg_placement_num_target": 32, 2026-02-17T05:32:25.290 INFO:tasks.workunit.client.0.trial030.stdout: "pg_num_target": 32, 2026-02-17T05:32:25.290 INFO:tasks.workunit.client.0.trial030.stdout: "pg_num_pending": 32, 2026-02-17T05:32:25.290 INFO:tasks.workunit.client.0.trial030.stdout: "last_pg_merge_meta": { 2026-02-17T05:32:25.290 INFO:tasks.workunit.client.0.trial030.stdout: "source_pgid": "0.0", 2026-02-17T05:32:25.290 INFO:tasks.workunit.client.0.trial030.stdout: "ready_epoch": 0, 2026-02-17T05:32:25.290 INFO:tasks.workunit.client.0.trial030.stdout: "last_epoch_started": 0, 2026-02-17T05:32:25.290 INFO:tasks.workunit.client.0.trial030.stdout: "last_epoch_clean": 0, 2026-02-17T05:32:25.290 INFO:tasks.workunit.client.0.trial030.stdout: "source_version": "0'0", 2026-02-17T05:32:25.290 INFO:tasks.workunit.client.0.trial030.stdout: "target_version": "0'0" 2026-02-17T05:32:25.290 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.290 INFO:tasks.workunit.client.0.trial030.stdout: "last_change": "44", 2026-02-17T05:32:25.291 INFO:tasks.workunit.client.0.trial030.stdout: "last_force_op_resend": "0", 2026-02-17T05:32:25.291 INFO:tasks.workunit.client.0.trial030.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-17T05:32:25.291 INFO:tasks.workunit.client.0.trial030.stdout: "last_force_op_resend_preluminous": "44", 2026-02-17T05:32:25.291 INFO:tasks.workunit.client.0.trial030.stdout: "auid": 0, 2026-02-17T05:32:25.291 INFO:tasks.workunit.client.0.trial030.stdout: "snap_mode": "selfmanaged", 2026-02-17T05:32:25.291 INFO:tasks.workunit.client.0.trial030.stdout: "snap_seq": 0, 2026-02-17T05:32:25.291 INFO:tasks.workunit.client.0.trial030.stdout: "snap_epoch": 0, 2026-02-17T05:32:25.291 INFO:tasks.workunit.client.0.trial030.stdout: "pool_snaps": [], 2026-02-17T05:32:25.291 INFO:tasks.workunit.client.0.trial030.stdout: "removed_snaps": "[]", 2026-02-17T05:32:25.291 INFO:tasks.workunit.client.0.trial030.stdout: "quota_max_bytes": 0, 2026-02-17T05:32:25.291 INFO:tasks.workunit.client.0.trial030.stdout: "quota_max_objects": 0, 2026-02-17T05:32:25.291 INFO:tasks.workunit.client.0.trial030.stdout: "tiers": [], 2026-02-17T05:32:25.291 INFO:tasks.workunit.client.0.trial030.stdout: "tier_of": -1, 2026-02-17T05:32:25.292 INFO:tasks.workunit.client.0.trial030.stdout: "read_tier": -1, 2026-02-17T05:32:25.292 INFO:tasks.workunit.client.0.trial030.stdout: "write_tier": -1, 2026-02-17T05:32:25.292 INFO:tasks.workunit.client.0.trial030.stdout: "cache_mode": "none", 2026-02-17T05:32:25.292 INFO:tasks.workunit.client.0.trial030.stdout: "target_max_bytes": 0, 2026-02-17T05:32:25.292 INFO:tasks.workunit.client.0.trial030.stdout: "target_max_objects": 0, 2026-02-17T05:32:25.292 INFO:tasks.workunit.client.0.trial030.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-17T05:32:25.292 INFO:tasks.workunit.client.0.trial030.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-17T05:32:25.292 INFO:tasks.workunit.client.0.trial030.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-17T05:32:25.292 INFO:tasks.workunit.client.0.trial030.stdout: "cache_min_flush_age": 0, 2026-02-17T05:32:25.292 INFO:tasks.workunit.client.0.trial030.stdout: "cache_min_evict_age": 0, 2026-02-17T05:32:25.292 INFO:tasks.workunit.client.0.trial030.stdout: "erasure_code_profile": "", 2026-02-17T05:32:25.292 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_params": { 2026-02-17T05:32:25.292 INFO:tasks.workunit.client.0.trial030.stdout: "type": "none" 2026-02-17T05:32:25.293 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.293 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_period": 0, 2026-02-17T05:32:25.293 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_count": 0, 2026-02-17T05:32:25.293 INFO:tasks.workunit.client.0.trial030.stdout: "use_gmt_hitset": true, 2026-02-17T05:32:25.293 INFO:tasks.workunit.client.0.trial030.stdout: "min_read_recency_for_promote": 0, 2026-02-17T05:32:25.293 INFO:tasks.workunit.client.0.trial030.stdout: "min_write_recency_for_promote": 0, 2026-02-17T05:32:25.293 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_grade_decay_rate": 0, 2026-02-17T05:32:25.293 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_search_last_n": 0, 2026-02-17T05:32:25.293 INFO:tasks.workunit.client.0.trial030.stdout: "grade_table": [], 2026-02-17T05:32:25.293 INFO:tasks.workunit.client.0.trial030.stdout: "stripe_width": 0, 2026-02-17T05:32:25.293 INFO:tasks.workunit.client.0.trial030.stdout: "expected_num_objects": 0, 2026-02-17T05:32:25.293 INFO:tasks.workunit.client.0.trial030.stdout: "fast_read": false, 2026-02-17T05:32:25.293 INFO:tasks.workunit.client.0.trial030.stdout: "nonprimary_shards": "{}", 2026-02-17T05:32:25.294 INFO:tasks.workunit.client.0.trial030.stdout: "options": {}, 2026-02-17T05:32:25.294 INFO:tasks.workunit.client.0.trial030.stdout: "application_metadata": {}, 2026-02-17T05:32:25.294 INFO:tasks.workunit.client.0.trial030.stdout: "read_balance": { 2026-02-17T05:32:25.294 INFO:tasks.workunit.client.0.trial030.stdout: "score_type": "Fair distribution", 2026-02-17T05:32:25.294 INFO:tasks.workunit.client.0.trial030.stdout: "score_acting": 2.9900000095367432, 2026-02-17T05:32:25.294 INFO:tasks.workunit.client.0.trial030.stdout: "score_stable": 2.9900000095367432, 2026-02-17T05:32:25.294 INFO:tasks.workunit.client.0.trial030.stdout: "optimal_score": 0.67000001668930054, 2026-02-17T05:32:25.294 INFO:tasks.workunit.client.0.trial030.stdout: "raw_score_acting": 2, 2026-02-17T05:32:25.294 INFO:tasks.workunit.client.0.trial030.stdout: "raw_score_stable": 2, 2026-02-17T05:32:25.294 INFO:tasks.workunit.client.0.trial030.stdout: "primary_affinity_weighted": 1, 2026-02-17T05:32:25.294 INFO:tasks.workunit.client.0.trial030.stdout: "average_primary_affinity": 1, 2026-02-17T05:32:25.295 INFO:tasks.workunit.client.0.trial030.stdout: "average_primary_affinity_weighted": 1 2026-02-17T05:32:25.295 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:32:25.295 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:32:25.295 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:32:25.295 INFO:tasks.workunit.client.0.trial030.stdout: "osds": [ 2026-02-17T05:32:25.295 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.295 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 0, 2026-02-17T05:32:25.295 INFO:tasks.workunit.client.0.trial030.stdout: "uuid": "16e58abc-e2b0-4883-ba0a-c391c8cc9f6d", 2026-02-17T05:32:25.295 INFO:tasks.workunit.client.0.trial030.stdout: "up": 1, 2026-02-17T05:32:25.295 INFO:tasks.workunit.client.0.trial030.stdout: "in": 1, 2026-02-17T05:32:25.295 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 1, 2026-02-17T05:32:25.295 INFO:tasks.workunit.client.0.trial030.stdout: "primary_affinity": 1, 2026-02-17T05:32:25.296 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_begin": 5, 2026-02-17T05:32:25.296 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_end": 29, 2026-02-17T05:32:25.296 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 36, 2026-02-17T05:32:25.296 INFO:tasks.workunit.client.0.trial030.stdout: "up_thru": 44, 2026-02-17T05:32:25.296 INFO:tasks.workunit.client.0.trial030.stdout: "down_at": 30, 2026-02-17T05:32:25.296 INFO:tasks.workunit.client.0.trial030.stdout: "lost_at": 0, 2026-02-17T05:32:25.296 INFO:tasks.workunit.client.0.trial030.stdout: "public_addrs": { 2026-02-17T05:32:25.296 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:32:25.296 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.296 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:32:25.296 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6800", 2026-02-17T05:32:25.296 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3611726545 2026-02-17T05:32:25.296 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.296 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.297 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:32:25.297 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6801", 2026-02-17T05:32:25.297 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3611726545 2026-02-17T05:32:25.297 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:32:25.297 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:32:25.297 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.297 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addrs": { 2026-02-17T05:32:25.297 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:32:25.297 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.297 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:32:25.297 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6802", 2026-02-17T05:32:25.297 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3611726545 2026-02-17T05:32:25.297 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.297 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.297 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:32:25.298 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6803", 2026-02-17T05:32:25.298 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3611726545 2026-02-17T05:32:25.298 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:32:25.298 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:32:25.298 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.298 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addrs": { 2026-02-17T05:32:25.298 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:32:25.298 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.298 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:32:25.298 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6806", 2026-02-17T05:32:25.298 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3611726545 2026-02-17T05:32:25.298 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.298 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.299 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:32:25.299 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6807", 2026-02-17T05:32:25.299 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3611726545 2026-02-17T05:32:25.299 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:32:25.299 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:32:25.299 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.299 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addrs": { 2026-02-17T05:32:25.299 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:32:25.299 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.299 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:32:25.299 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6804", 2026-02-17T05:32:25.299 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3611726545 2026-02-17T05:32:25.299 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.299 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.299 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:32:25.299 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6805", 2026-02-17T05:32:25.300 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3611726545 2026-02-17T05:32:25.300 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:32:25.300 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:32:25.300 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.300 INFO:tasks.workunit.client.0.trial030.stdout: "public_addr": "127.0.0.1:6801/3611726545", 2026-02-17T05:32:25.300 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addr": "127.0.0.1:6803/3611726545", 2026-02-17T05:32:25.300 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addr": "127.0.0.1:6807/3611726545", 2026-02-17T05:32:25.300 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addr": "127.0.0.1:6805/3611726545", 2026-02-17T05:32:25.300 INFO:tasks.workunit.client.0.trial030.stdout: "state": [ 2026-02-17T05:32:25.300 INFO:tasks.workunit.client.0.trial030.stdout: "exists", 2026-02-17T05:32:25.300 INFO:tasks.workunit.client.0.trial030.stdout: "up" 2026-02-17T05:32:25.300 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:32:25.300 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.300 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.300 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 1, 2026-02-17T05:32:25.301 INFO:tasks.workunit.client.0.trial030.stdout: "uuid": "ba7ef7d8-8279-40c2-9fe4-6d18fe327556", 2026-02-17T05:32:25.301 INFO:tasks.workunit.client.0.trial030.stdout: "up": 0, 2026-02-17T05:32:25.301 INFO:tasks.workunit.client.0.trial030.stdout: "in": 1, 2026-02-17T05:32:25.301 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 1, 2026-02-17T05:32:25.301 INFO:tasks.workunit.client.0.trial030.stdout: "primary_affinity": 1, 2026-02-17T05:32:25.301 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_begin": 0, 2026-02-17T05:32:25.301 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_end": 0, 2026-02-17T05:32:25.301 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 9, 2026-02-17T05:32:25.301 INFO:tasks.workunit.client.0.trial030.stdout: "up_thru": 22, 2026-02-17T05:32:25.301 INFO:tasks.workunit.client.0.trial030.stdout: "down_at": 31, 2026-02-17T05:32:25.301 INFO:tasks.workunit.client.0.trial030.stdout: "lost_at": 0, 2026-02-17T05:32:25.301 INFO:tasks.workunit.client.0.trial030.stdout: "public_addrs": { 2026-02-17T05:32:25.301 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:32:25.301 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.301 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:32:25.301 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6810", 2026-02-17T05:32:25.301 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3197791047 2026-02-17T05:32:25.302 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.302 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.302 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:32:25.302 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6811", 2026-02-17T05:32:25.302 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3197791047 2026-02-17T05:32:25.302 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:32:25.302 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:32:25.302 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.302 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addrs": { 2026-02-17T05:32:25.302 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:32:25.302 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.302 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:32:25.302 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6812", 2026-02-17T05:32:25.302 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3197791047 2026-02-17T05:32:25.302 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.302 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.303 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:32:25.303 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6813", 2026-02-17T05:32:25.303 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3197791047 2026-02-17T05:32:25.303 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:32:25.303 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:32:25.303 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.303 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addrs": { 2026-02-17T05:32:25.303 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:32:25.303 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.303 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:32:25.303 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6816", 2026-02-17T05:32:25.303 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3197791047 2026-02-17T05:32:25.303 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.303 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.304 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:32:25.304 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6817", 2026-02-17T05:32:25.304 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3197791047 2026-02-17T05:32:25.304 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:32:25.304 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:32:25.304 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.304 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addrs": { 2026-02-17T05:32:25.304 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:32:25.304 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.304 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:32:25.304 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6814", 2026-02-17T05:32:25.304 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3197791047 2026-02-17T05:32:25.304 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.304 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.304 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:32:25.304 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6815", 2026-02-17T05:32:25.304 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3197791047 2026-02-17T05:32:25.305 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:32:25.305 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:32:25.305 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.305 INFO:tasks.workunit.client.0.trial030.stdout: "public_addr": "127.0.0.1:6811/3197791047", 2026-02-17T05:32:25.305 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addr": "127.0.0.1:6813/3197791047", 2026-02-17T05:32:25.305 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addr": "127.0.0.1:6817/3197791047", 2026-02-17T05:32:25.305 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addr": "127.0.0.1:6815/3197791047", 2026-02-17T05:32:25.305 INFO:tasks.workunit.client.0.trial030.stdout: "state": [ 2026-02-17T05:32:25.305 INFO:tasks.workunit.client.0.trial030.stdout: "exists" 2026-02-17T05:32:25.305 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:32:25.305 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.305 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.305 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2, 2026-02-17T05:32:25.305 INFO:tasks.workunit.client.0.trial030.stdout: "uuid": "d26fa46f-e265-43ba-83d2-985666052fe3", 2026-02-17T05:32:25.305 INFO:tasks.workunit.client.0.trial030.stdout: "up": 1, 2026-02-17T05:32:25.305 INFO:tasks.workunit.client.0.trial030.stdout: "in": 1, 2026-02-17T05:32:25.305 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 1, 2026-02-17T05:32:25.306 INFO:tasks.workunit.client.0.trial030.stdout: "primary_affinity": 1, 2026-02-17T05:32:25.306 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_begin": 14, 2026-02-17T05:32:25.306 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_end": 29, 2026-02-17T05:32:25.306 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 39, 2026-02-17T05:32:25.306 INFO:tasks.workunit.client.0.trial030.stdout: "up_thru": 0, 2026-02-17T05:32:25.306 INFO:tasks.workunit.client.0.trial030.stdout: "down_at": 32, 2026-02-17T05:32:25.306 INFO:tasks.workunit.client.0.trial030.stdout: "lost_at": 0, 2026-02-17T05:32:25.306 INFO:tasks.workunit.client.0.trial030.stdout: "public_addrs": { 2026-02-17T05:32:25.306 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:32:25.306 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.306 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:32:25.306 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6810", 2026-02-17T05:32:25.306 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3922362673 2026-02-17T05:32:25.306 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.306 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.306 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:32:25.306 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6811", 2026-02-17T05:32:25.306 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3922362673 2026-02-17T05:32:25.306 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:32:25.307 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:32:25.307 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.307 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addrs": { 2026-02-17T05:32:25.307 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:32:25.307 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.307 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:32:25.307 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6812", 2026-02-17T05:32:25.307 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3922362673 2026-02-17T05:32:25.307 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.307 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.307 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:32:25.307 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6813", 2026-02-17T05:32:25.307 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3922362673 2026-02-17T05:32:25.307 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:32:25.307 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:32:25.307 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.307 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addrs": { 2026-02-17T05:32:25.307 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:32:25.307 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.308 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:32:25.308 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6816", 2026-02-17T05:32:25.308 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3922362673 2026-02-17T05:32:25.308 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.308 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.308 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:32:25.308 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6817", 2026-02-17T05:32:25.308 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3922362673 2026-02-17T05:32:25.308 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:32:25.308 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:32:25.308 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.308 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addrs": { 2026-02-17T05:32:25.308 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:32:25.308 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.308 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:32:25.308 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6814", 2026-02-17T05:32:25.308 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3922362673 2026-02-17T05:32:25.308 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.308 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.308 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:32:25.309 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6815", 2026-02-17T05:32:25.309 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 3922362673 2026-02-17T05:32:25.309 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:32:25.309 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:32:25.309 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.309 INFO:tasks.workunit.client.0.trial030.stdout: "public_addr": "127.0.0.1:6811/3922362673", 2026-02-17T05:32:25.309 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addr": "127.0.0.1:6813/3922362673", 2026-02-17T05:32:25.309 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addr": "127.0.0.1:6817/3922362673", 2026-02-17T05:32:25.309 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addr": "127.0.0.1:6815/3922362673", 2026-02-17T05:32:25.309 INFO:tasks.workunit.client.0.trial030.stdout: "state": [ 2026-02-17T05:32:25.309 INFO:tasks.workunit.client.0.trial030.stdout: "exists", 2026-02-17T05:32:25.309 INFO:tasks.workunit.client.0.trial030.stdout: "up" 2026-02-17T05:32:25.309 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:32:25.309 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:32:25.309 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:32:25.309 INFO:tasks.workunit.client.0.trial030.stdout: "osd_xinfo": [ 2026-02-17T05:32:25.309 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.309 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 0, 2026-02-17T05:32:25.309 INFO:tasks.workunit.client.0.trial030.stdout: "down_stamp": "2026-02-17T05:31:20.356846+0000", 2026-02-17T05:32:25.309 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_probability": 0, 2026-02-17T05:32:25.310 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_interval": 0, 2026-02-17T05:32:25.310 INFO:tasks.workunit.client.0.trial030.stdout: "features": 4544132024016699391, 2026-02-17T05:32:25.310 INFO:tasks.workunit.client.0.trial030.stdout: "old_weight": 0, 2026-02-17T05:32:25.310 INFO:tasks.workunit.client.0.trial030.stdout: "last_purged_snaps_scrub": "2026-02-17T05:30:46.614140+0000", 2026-02-17T05:32:25.310 INFO:tasks.workunit.client.0.trial030.stdout: "dead_epoch": 0 2026-02-17T05:32:25.310 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.310 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.310 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 1, 2026-02-17T05:32:25.310 INFO:tasks.workunit.client.0.trial030.stdout: "down_stamp": "2026-02-17T05:31:20.632227+0000", 2026-02-17T05:32:25.310 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_probability": 0, 2026-02-17T05:32:25.310 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_interval": 0, 2026-02-17T05:32:25.310 INFO:tasks.workunit.client.0.trial030.stdout: "features": 4544132024016699391, 2026-02-17T05:32:25.310 INFO:tasks.workunit.client.0.trial030.stdout: "old_weight": 0, 2026-02-17T05:32:25.310 INFO:tasks.workunit.client.0.trial030.stdout: "last_purged_snaps_scrub": "2026-02-17T05:30:50.052206+0000", 2026-02-17T05:32:25.310 INFO:tasks.workunit.client.0.trial030.stdout: "dead_epoch": 0 2026-02-17T05:32:25.310 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.310 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.310 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2, 2026-02-17T05:32:25.310 INFO:tasks.workunit.client.0.trial030.stdout: "down_stamp": "2026-02-17T05:31:20.913349+0000", 2026-02-17T05:32:25.310 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_probability": 0, 2026-02-17T05:32:25.311 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_interval": 0, 2026-02-17T05:32:25.311 INFO:tasks.workunit.client.0.trial030.stdout: "features": 4544132024016699391, 2026-02-17T05:32:25.311 INFO:tasks.workunit.client.0.trial030.stdout: "old_weight": 0, 2026-02-17T05:32:25.311 INFO:tasks.workunit.client.0.trial030.stdout: "last_purged_snaps_scrub": "2026-02-17T05:30:53.128275+0000", 2026-02-17T05:32:25.311 INFO:tasks.workunit.client.0.trial030.stdout: "dead_epoch": 0 2026-02-17T05:32:25.311 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:32:25.311 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:32:25.311 INFO:tasks.workunit.client.0.trial030.stdout: "pg_upmap": [], 2026-02-17T05:32:25.311 INFO:tasks.workunit.client.0.trial030.stdout: "pg_upmap_items": [], 2026-02-17T05:32:25.311 INFO:tasks.workunit.client.0.trial030.stdout: "pg_upmap_primaries": [], 2026-02-17T05:32:25.311 INFO:tasks.workunit.client.0.trial030.stdout: "pg_temp": [], 2026-02-17T05:32:25.311 INFO:tasks.workunit.client.0.trial030.stdout: "primary_temp": [], 2026-02-17T05:32:25.311 INFO:tasks.workunit.client.0.trial030.stdout: "blocklist": {}, 2026-02-17T05:32:25.311 INFO:tasks.workunit.client.0.trial030.stdout: "range_blocklist": {}, 2026-02-17T05:32:25.311 INFO:tasks.workunit.client.0.trial030.stdout: "erasure_code_profiles": { 2026-02-17T05:32:25.311 INFO:tasks.workunit.client.0.trial030.stdout: "default": { 2026-02-17T05:32:25.311 INFO:tasks.workunit.client.0.trial030.stdout: "k": "2", 2026-02-17T05:32:25.311 INFO:tasks.workunit.client.0.trial030.stdout: "m": "2", 2026-02-17T05:32:25.311 INFO:tasks.workunit.client.0.trial030.stdout: "plugin": "isa", 2026-02-17T05:32:25.311 INFO:tasks.workunit.client.0.trial030.stdout: "technique": "reed_sol_van" 2026-02-17T05:32:25.311 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:32:25.312 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.312 INFO:tasks.workunit.client.0.trial030.stdout: "removed_snaps_queue": [], 2026-02-17T05:32:25.312 INFO:tasks.workunit.client.0.trial030.stdout: "new_removed_snaps": [], 2026-02-17T05:32:25.312 INFO:tasks.workunit.client.0.trial030.stdout: "new_purged_snaps": [], 2026-02-17T05:32:25.312 INFO:tasks.workunit.client.0.trial030.stdout: "crush_node_flags": {}, 2026-02-17T05:32:25.312 INFO:tasks.workunit.client.0.trial030.stdout: "device_class_flags": {}, 2026-02-17T05:32:25.312 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_mode": { 2026-02-17T05:32:25.312 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_mode_enabled": false, 2026-02-17T05:32:25.312 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_bucket_count": 0, 2026-02-17T05:32:25.312 INFO:tasks.workunit.client.0.trial030.stdout: "degraded_stretch_mode": 0, 2026-02-17T05:32:25.312 INFO:tasks.workunit.client.0.trial030.stdout: "recovering_stretch_mode": 0, 2026-02-17T05:32:25.312 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_mode_bucket": 0 2026-02-17T05:32:25.312 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:32:25.312 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.312 INFO:tasks.workunit.client.0.trial030.stdout: "osd_metadata": [ 2026-02-17T05:32:25.312 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.312 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-17T05:32:25.312 INFO:tasks.workunit.client.0.trial030.stdout: "arch": "x86_64", 2026-02-17T05:32:25.312 INFO:tasks.workunit.client.0.trial030.stdout: "back_addr": "[v2:127.0.0.1:6802/3611726545,v1:127.0.0.1:6803/3611726545]", 2026-02-17T05:32:25.312 INFO:tasks.workunit.client.0.trial030.stdout: "back_iface": "", 2026-02-17T05:32:25.312 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs": "1", 2026-02-17T05:32:25.313 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_db": "0", 2026-02-17T05:32:25.313 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T05:32:25.313 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_single_shared_device": "1", 2026-02-17T05:32:25.313 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T05:32:25.313 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocator": "hybrid", 2026-02-17T05:32:25.313 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T05:32:25.313 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T05:32:25.313 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T05:32:25.313 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T05:32:25.313 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T05:32:25.313 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-17T05:32:25.313 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T05:32:25.313 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T05:32:25.313 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T05:32:25.313 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T05:32:25.313 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-17T05:32:25.313 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T05:32:25.313 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T05:32:25.313 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_write_mode": "classic", 2026-02-17T05:32:25.313 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_release": "tentacle", 2026-02-17T05:32:25.313 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version": "ceph version 20.3.0-5271-g32585015 (325850157d309f65985eea9ec9bb9f1d56726fee) tentacle (dev - None)", 2026-02-17T05:32:25.313 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_short": "20.3.0-5271-g32585015", 2026-02-17T05:32:25.314 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_when_created": "ceph version 20.3.0-5271-g32585015 (325850157d309f65985eea9ec9bb9f1d56726fee) tentacle (dev - None)", 2026-02-17T05:32:25.314 INFO:tasks.workunit.client.0.trial030.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T05:32:25.314 INFO:tasks.workunit.client.0.trial030.stdout: "created_at": "2026-02-17T05:30:43.871896Z", 2026-02-17T05:32:25.314 INFO:tasks.workunit.client.0.trial030.stdout: "default_device_class": "ssd", 2026-02-17T05:32:25.314 INFO:tasks.workunit.client.0.trial030.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6B65", 2026-02-17T05:32:25.314 INFO:tasks.workunit.client.0.trial030.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T05:32:25.314 INFO:tasks.workunit.client.0.trial030.stdout: "devices": "nvme0n1", 2026-02-17T05:32:25.314 INFO:tasks.workunit.client.0.trial030.stdout: "distro": "ubuntu", 2026-02-17T05:32:25.314 INFO:tasks.workunit.client.0.trial030.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T05:32:25.314 INFO:tasks.workunit.client.0.trial030.stdout: "distro_version": "22.04", 2026-02-17T05:32:25.314 INFO:tasks.workunit.client.0.trial030.stdout: "front_addr": "[v2:127.0.0.1:6800/3611726545,v1:127.0.0.1:6801/3611726545]", 2026-02-17T05:32:25.314 INFO:tasks.workunit.client.0.trial030.stdout: "front_iface": "", 2026-02-17T05:32:25.314 INFO:tasks.workunit.client.0.trial030.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/3611726545,v1:127.0.0.1:6807/3611726545]", 2026-02-17T05:32:25.314 INFO:tasks.workunit.client.0.trial030.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/3611726545,v1:127.0.0.1:6805/3611726545]", 2026-02-17T05:32:25.314 INFO:tasks.workunit.client.0.trial030.stdout: "hostname": "trial030", 2026-02-17T05:32:25.314 INFO:tasks.workunit.client.0.trial030.stdout: "journal_rotational": "0", 2026-02-17T05:32:25.314 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T05:32:25.314 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T05:32:25.314 INFO:tasks.workunit.client.0.trial030.stdout: "mem_swap_kb": "8388604", 2026-02-17T05:32:25.314 INFO:tasks.workunit.client.0.trial030.stdout: "mem_total_kb": "130961692", 2026-02-17T05:32:25.314 INFO:tasks.workunit.client.0.trial030.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T05:32:25.314 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_node": "0", 2026-02-17T05:32:25.315 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_nodes": "0", 2026-02-17T05:32:25.315 INFO:tasks.workunit.client.0.trial030.stdout: "os": "Linux", 2026-02-17T05:32:25.315 INFO:tasks.workunit.client.0.trial030.stdout: "osd_data": "td/divergent-priors/0", 2026-02-17T05:32:25.315 INFO:tasks.workunit.client.0.trial030.stdout: "osd_objectstore": "bluestore", 2026-02-17T05:32:25.315 INFO:tasks.workunit.client.0.trial030.stdout: "osdspec_affinity": "", 2026-02-17T05:32:25.315 INFO:tasks.workunit.client.0.trial030.stdout: "rotational": "0" 2026-02-17T05:32:25.315 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.315 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.315 INFO:tasks.workunit.client.0.trial030.stdout: "id": 1, 2026-02-17T05:32:25.315 INFO:tasks.workunit.client.0.trial030.stdout: "arch": "x86_64", 2026-02-17T05:32:25.315 INFO:tasks.workunit.client.0.trial030.stdout: "back_addr": "[v2:127.0.0.1:6812/3197791047,v1:127.0.0.1:6813/3197791047]", 2026-02-17T05:32:25.315 INFO:tasks.workunit.client.0.trial030.stdout: "back_iface": "", 2026-02-17T05:32:25.315 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs": "1", 2026-02-17T05:32:25.315 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_db": "0", 2026-02-17T05:32:25.315 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T05:32:25.315 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_single_shared_device": "1", 2026-02-17T05:32:25.315 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T05:32:25.315 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocator": "hybrid", 2026-02-17T05:32:25.315 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T05:32:25.315 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T05:32:25.315 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T05:32:25.315 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T05:32:25.316 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T05:32:25.316 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-17T05:32:25.316 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T05:32:25.316 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T05:32:25.316 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T05:32:25.316 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T05:32:25.316 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-17T05:32:25.316 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T05:32:25.316 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T05:32:25.316 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_write_mode": "classic", 2026-02-17T05:32:25.316 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_release": "tentacle", 2026-02-17T05:32:25.316 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version": "ceph version 20.3.0-5271-g32585015 (325850157d309f65985eea9ec9bb9f1d56726fee) tentacle (dev - None)", 2026-02-17T05:32:25.316 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_short": "20.3.0-5271-g32585015", 2026-02-17T05:32:25.316 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_when_created": "ceph version 20.3.0-5271-g32585015 (325850157d309f65985eea9ec9bb9f1d56726fee) tentacle (dev - None)", 2026-02-17T05:32:25.316 INFO:tasks.workunit.client.0.trial030.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T05:32:25.316 INFO:tasks.workunit.client.0.trial030.stdout: "created_at": "2026-02-17T05:30:47.657417Z", 2026-02-17T05:32:25.316 INFO:tasks.workunit.client.0.trial030.stdout: "default_device_class": "ssd", 2026-02-17T05:32:25.316 INFO:tasks.workunit.client.0.trial030.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6B65", 2026-02-17T05:32:25.316 INFO:tasks.workunit.client.0.trial030.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T05:32:25.316 INFO:tasks.workunit.client.0.trial030.stdout: "devices": "nvme0n1", 2026-02-17T05:32:25.316 INFO:tasks.workunit.client.0.trial030.stdout: "distro": "ubuntu", 2026-02-17T05:32:25.316 INFO:tasks.workunit.client.0.trial030.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T05:32:25.316 INFO:tasks.workunit.client.0.trial030.stdout: "distro_version": "22.04", 2026-02-17T05:32:25.316 INFO:tasks.workunit.client.0.trial030.stdout: "front_addr": "[v2:127.0.0.1:6810/3197791047,v1:127.0.0.1:6811/3197791047]", 2026-02-17T05:32:25.317 INFO:tasks.workunit.client.0.trial030.stdout: "front_iface": "", 2026-02-17T05:32:25.317 INFO:tasks.workunit.client.0.trial030.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/3197791047,v1:127.0.0.1:6817/3197791047]", 2026-02-17T05:32:25.317 INFO:tasks.workunit.client.0.trial030.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/3197791047,v1:127.0.0.1:6815/3197791047]", 2026-02-17T05:32:25.317 INFO:tasks.workunit.client.0.trial030.stdout: "hostname": "trial030", 2026-02-17T05:32:25.317 INFO:tasks.workunit.client.0.trial030.stdout: "journal_rotational": "0", 2026-02-17T05:32:25.317 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T05:32:25.317 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T05:32:25.317 INFO:tasks.workunit.client.0.trial030.stdout: "mem_swap_kb": "8388604", 2026-02-17T05:32:25.317 INFO:tasks.workunit.client.0.trial030.stdout: "mem_total_kb": "130961692", 2026-02-17T05:32:25.317 INFO:tasks.workunit.client.0.trial030.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T05:32:25.317 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_node": "0", 2026-02-17T05:32:25.317 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_nodes": "0", 2026-02-17T05:32:25.317 INFO:tasks.workunit.client.0.trial030.stdout: "os": "Linux", 2026-02-17T05:32:25.317 INFO:tasks.workunit.client.0.trial030.stdout: "osd_data": "td/divergent-priors/1", 2026-02-17T05:32:25.317 INFO:tasks.workunit.client.0.trial030.stdout: "osd_objectstore": "bluestore", 2026-02-17T05:32:25.317 INFO:tasks.workunit.client.0.trial030.stdout: "osdspec_affinity": "", 2026-02-17T05:32:25.317 INFO:tasks.workunit.client.0.trial030.stdout: "rotational": "0" 2026-02-17T05:32:25.317 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.317 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.317 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-17T05:32:25.317 INFO:tasks.workunit.client.0.trial030.stdout: "arch": "x86_64", 2026-02-17T05:32:25.317 INFO:tasks.workunit.client.0.trial030.stdout: "back_addr": "[v2:127.0.0.1:6812/3922362673,v1:127.0.0.1:6813/3922362673]", 2026-02-17T05:32:25.317 INFO:tasks.workunit.client.0.trial030.stdout: "back_iface": "", 2026-02-17T05:32:25.318 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs": "1", 2026-02-17T05:32:25.318 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_db": "0", 2026-02-17T05:32:25.318 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T05:32:25.318 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_single_shared_device": "1", 2026-02-17T05:32:25.318 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T05:32:25.318 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocator": "hybrid", 2026-02-17T05:32:25.318 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T05:32:25.318 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T05:32:25.318 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T05:32:25.318 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T05:32:25.318 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T05:32:25.318 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-17T05:32:25.318 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T05:32:25.318 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T05:32:25.318 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T05:32:25.318 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T05:32:25.318 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-17T05:32:25.318 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T05:32:25.318 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T05:32:25.318 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_write_mode": "classic", 2026-02-17T05:32:25.318 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_release": "tentacle", 2026-02-17T05:32:25.318 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version": "ceph version 20.3.0-5271-g32585015 (325850157d309f65985eea9ec9bb9f1d56726fee) tentacle (dev - None)", 2026-02-17T05:32:25.318 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_short": "20.3.0-5271-g32585015", 2026-02-17T05:32:25.318 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_when_created": "ceph version 20.3.0-5271-g32585015 (325850157d309f65985eea9ec9bb9f1d56726fee) tentacle (dev - None)", 2026-02-17T05:32:25.318 INFO:tasks.workunit.client.0.trial030.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T05:32:25.319 INFO:tasks.workunit.client.0.trial030.stdout: "created_at": "2026-02-17T05:30:50.725225Z", 2026-02-17T05:32:25.319 INFO:tasks.workunit.client.0.trial030.stdout: "default_device_class": "ssd", 2026-02-17T05:32:25.319 INFO:tasks.workunit.client.0.trial030.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6B65", 2026-02-17T05:32:25.319 INFO:tasks.workunit.client.0.trial030.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T05:32:25.319 INFO:tasks.workunit.client.0.trial030.stdout: "devices": "nvme0n1", 2026-02-17T05:32:25.319 INFO:tasks.workunit.client.0.trial030.stdout: "distro": "ubuntu", 2026-02-17T05:32:25.319 INFO:tasks.workunit.client.0.trial030.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T05:32:25.319 INFO:tasks.workunit.client.0.trial030.stdout: "distro_version": "22.04", 2026-02-17T05:32:25.319 INFO:tasks.workunit.client.0.trial030.stdout: "front_addr": "[v2:127.0.0.1:6810/3922362673,v1:127.0.0.1:6811/3922362673]", 2026-02-17T05:32:25.319 INFO:tasks.workunit.client.0.trial030.stdout: "front_iface": "", 2026-02-17T05:32:25.319 INFO:tasks.workunit.client.0.trial030.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/3922362673,v1:127.0.0.1:6817/3922362673]", 2026-02-17T05:32:25.319 INFO:tasks.workunit.client.0.trial030.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/3922362673,v1:127.0.0.1:6815/3922362673]", 2026-02-17T05:32:25.319 INFO:tasks.workunit.client.0.trial030.stdout: "hostname": "trial030", 2026-02-17T05:32:25.319 INFO:tasks.workunit.client.0.trial030.stdout: "journal_rotational": "0", 2026-02-17T05:32:25.319 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T05:32:25.319 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T05:32:25.319 INFO:tasks.workunit.client.0.trial030.stdout: "mem_swap_kb": "8388604", 2026-02-17T05:32:25.319 INFO:tasks.workunit.client.0.trial030.stdout: "mem_total_kb": "130961692", 2026-02-17T05:32:25.319 INFO:tasks.workunit.client.0.trial030.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T05:32:25.319 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_node": "0", 2026-02-17T05:32:25.319 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_nodes": "0", 2026-02-17T05:32:25.319 INFO:tasks.workunit.client.0.trial030.stdout: "os": "Linux", 2026-02-17T05:32:25.319 INFO:tasks.workunit.client.0.trial030.stdout: "osd_data": "td/divergent-priors/2", 2026-02-17T05:32:25.319 INFO:tasks.workunit.client.0.trial030.stdout: "osd_objectstore": "bluestore", 2026-02-17T05:32:25.320 INFO:tasks.workunit.client.0.trial030.stdout: "osdspec_affinity": "", 2026-02-17T05:32:25.320 INFO:tasks.workunit.client.0.trial030.stdout: "rotational": "0" 2026-02-17T05:32:25.320 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:32:25.320 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:32:25.320 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap_clean_epochs": { 2026-02-17T05:32:25.320 INFO:tasks.workunit.client.0.trial030.stdout: "min_last_epoch_clean": 0, 2026-02-17T05:32:25.320 INFO:tasks.workunit.client.0.trial030.stdout: "last_epoch_clean": { 2026-02-17T05:32:25.320 INFO:tasks.workunit.client.0.trial030.stdout: "per_pool": [] 2026-02-17T05:32:25.320 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.320 INFO:tasks.workunit.client.0.trial030.stdout: "osd_epochs": [ 2026-02-17T05:32:25.320 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.320 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-17T05:32:25.320 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 36 2026-02-17T05:32:25.320 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.320 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.320 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-17T05:32:25.320 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 40 2026-02-17T05:32:25.320 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:32:25.320 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:32:25.320 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.320 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap_first_committed": 1, 2026-02-17T05:32:25.320 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap_last_committed": 45, 2026-02-17T05:32:25.320 INFO:tasks.workunit.client.0.trial030.stdout: "crushmap": { 2026-02-17T05:32:25.320 INFO:tasks.workunit.client.0.trial030.stdout: "devices": [ 2026-02-17T05:32:25.321 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.321 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-17T05:32:25.321 INFO:tasks.workunit.client.0.trial030.stdout: "name": "osd.0", 2026-02-17T05:32:25.321 INFO:tasks.workunit.client.0.trial030.stdout: "class": "ssd" 2026-02-17T05:32:25.321 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.321 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.321 INFO:tasks.workunit.client.0.trial030.stdout: "id": 1, 2026-02-17T05:32:25.321 INFO:tasks.workunit.client.0.trial030.stdout: "name": "osd.1", 2026-02-17T05:32:25.321 INFO:tasks.workunit.client.0.trial030.stdout: "class": "ssd" 2026-02-17T05:32:25.321 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.321 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.321 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-17T05:32:25.321 INFO:tasks.workunit.client.0.trial030.stdout: "name": "osd.2", 2026-02-17T05:32:25.321 INFO:tasks.workunit.client.0.trial030.stdout: "class": "ssd" 2026-02-17T05:32:25.321 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:32:25.321 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:32:25.321 INFO:tasks.workunit.client.0.trial030.stdout: "types": [ 2026-02-17T05:32:25.321 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.321 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 0, 2026-02-17T05:32:25.321 INFO:tasks.workunit.client.0.trial030.stdout: "name": "osd" 2026-02-17T05:32:25.321 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.321 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.321 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 1, 2026-02-17T05:32:25.321 INFO:tasks.workunit.client.0.trial030.stdout: "name": "host" 2026-02-17T05:32:25.321 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.322 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.322 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 2, 2026-02-17T05:32:25.322 INFO:tasks.workunit.client.0.trial030.stdout: "name": "chassis" 2026-02-17T05:32:25.322 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.322 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.322 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 3, 2026-02-17T05:32:25.322 INFO:tasks.workunit.client.0.trial030.stdout: "name": "rack" 2026-02-17T05:32:25.322 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.322 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.322 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 4, 2026-02-17T05:32:25.322 INFO:tasks.workunit.client.0.trial030.stderr:report 2789297353 2026-02-17T05:32:25.322 INFO:tasks.workunit.client.0.trial030.stdout: "name": "row" 2026-02-17T05:32:25.323 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.323 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.323 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 5, 2026-02-17T05:32:25.323 INFO:tasks.workunit.client.0.trial030.stdout: "name": "pdu" 2026-02-17T05:32:25.323 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.323 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.323 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 6, 2026-02-17T05:32:25.323 INFO:tasks.workunit.client.0.trial030.stdout: "name": "pod" 2026-02-17T05:32:25.323 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.323 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.323 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 7, 2026-02-17T05:32:25.323 INFO:tasks.workunit.client.0.trial030.stdout: "name": "room" 2026-02-17T05:32:25.323 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.323 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.323 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 8, 2026-02-17T05:32:25.323 INFO:tasks.workunit.client.0.trial030.stdout: "name": "datacenter" 2026-02-17T05:32:25.323 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.323 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.323 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 9, 2026-02-17T05:32:25.323 INFO:tasks.workunit.client.0.trial030.stdout: "name": "zone" 2026-02-17T05:32:25.323 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.323 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.324 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 10, 2026-02-17T05:32:25.324 INFO:tasks.workunit.client.0.trial030.stdout: "name": "region" 2026-02-17T05:32:25.324 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.324 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.324 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 11, 2026-02-17T05:32:25.324 INFO:tasks.workunit.client.0.trial030.stdout: "name": "root" 2026-02-17T05:32:25.324 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:32:25.324 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:32:25.324 INFO:tasks.workunit.client.0.trial030.stdout: "buckets": [ 2026-02-17T05:32:25.324 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.324 INFO:tasks.workunit.client.0.trial030.stdout: "id": -1, 2026-02-17T05:32:25.324 INFO:tasks.workunit.client.0.trial030.stdout: "name": "default", 2026-02-17T05:32:25.324 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 11, 2026-02-17T05:32:25.324 INFO:tasks.workunit.client.0.trial030.stdout: "type_name": "root", 2026-02-17T05:32:25.324 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-17T05:32:25.324 INFO:tasks.workunit.client.0.trial030.stdout: "alg": "straw2", 2026-02-17T05:32:25.324 INFO:tasks.workunit.client.0.trial030.stdout: "hash": "rjenkins1", 2026-02-17T05:32:25.324 INFO:tasks.workunit.client.0.trial030.stdout: "items": [ 2026-02-17T05:32:25.324 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.324 INFO:tasks.workunit.client.0.trial030.stdout: "id": -3, 2026-02-17T05:32:25.324 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-17T05:32:25.324 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 0 2026-02-17T05:32:25.324 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:32:25.324 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:32:25.324 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.325 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.325 INFO:tasks.workunit.client.0.trial030.stdout: "id": -2, 2026-02-17T05:32:25.325 INFO:tasks.workunit.client.0.trial030.stdout: "name": "default~ssd", 2026-02-17T05:32:25.325 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 11, 2026-02-17T05:32:25.325 INFO:tasks.workunit.client.0.trial030.stdout: "type_name": "root", 2026-02-17T05:32:25.325 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-17T05:32:25.325 INFO:tasks.workunit.client.0.trial030.stdout: "alg": "straw2", 2026-02-17T05:32:25.325 INFO:tasks.workunit.client.0.trial030.stdout: "hash": "rjenkins1", 2026-02-17T05:32:25.325 INFO:tasks.workunit.client.0.trial030.stdout: "items": [ 2026-02-17T05:32:25.325 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.325 INFO:tasks.workunit.client.0.trial030.stdout: "id": -4, 2026-02-17T05:32:25.325 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-17T05:32:25.325 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 0 2026-02-17T05:32:25.325 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:32:25.325 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:32:25.325 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.325 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.325 INFO:tasks.workunit.client.0.trial030.stdout: "id": -3, 2026-02-17T05:32:25.325 INFO:tasks.workunit.client.0.trial030.stdout: "name": "trial030", 2026-02-17T05:32:25.325 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 1, 2026-02-17T05:32:25.325 INFO:tasks.workunit.client.0.trial030.stdout: "type_name": "host", 2026-02-17T05:32:25.325 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-17T05:32:25.325 INFO:tasks.workunit.client.0.trial030.stdout: "alg": "straw2", 2026-02-17T05:32:25.325 INFO:tasks.workunit.client.0.trial030.stdout: "hash": "rjenkins1", 2026-02-17T05:32:25.325 INFO:tasks.workunit.client.0.trial030.stdout: "items": [ 2026-02-17T05:32:25.325 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.325 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-17T05:32:25.326 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-17T05:32:25.326 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 0 2026-02-17T05:32:25.326 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.326 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.326 INFO:tasks.workunit.client.0.trial030.stdout: "id": 1, 2026-02-17T05:32:25.326 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-17T05:32:25.326 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 1 2026-02-17T05:32:25.326 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.326 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.326 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-17T05:32:25.326 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-17T05:32:25.326 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 2 2026-02-17T05:32:25.326 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:32:25.326 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:32:25.326 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.326 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.326 INFO:tasks.workunit.client.0.trial030.stdout: "id": -4, 2026-02-17T05:32:25.326 INFO:tasks.workunit.client.0.trial030.stdout: "name": "trial030~ssd", 2026-02-17T05:32:25.326 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 1, 2026-02-17T05:32:25.326 INFO:tasks.workunit.client.0.trial030.stdout: "type_name": "host", 2026-02-17T05:32:25.326 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-17T05:32:25.326 INFO:tasks.workunit.client.0.trial030.stdout: "alg": "straw2", 2026-02-17T05:32:25.326 INFO:tasks.workunit.client.0.trial030.stdout: "hash": "rjenkins1", 2026-02-17T05:32:25.326 INFO:tasks.workunit.client.0.trial030.stdout: "items": [ 2026-02-17T05:32:25.326 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.326 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-17T05:32:25.326 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-17T05:32:25.327 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 0 2026-02-17T05:32:25.327 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.327 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.327 INFO:tasks.workunit.client.0.trial030.stdout: "id": 1, 2026-02-17T05:32:25.327 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-17T05:32:25.327 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 1 2026-02-17T05:32:25.327 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.327 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.327 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-17T05:32:25.327 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-17T05:32:25.327 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 2 2026-02-17T05:32:25.327 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:32:25.327 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:32:25.327 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:32:25.327 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:32:25.327 INFO:tasks.workunit.client.0.trial030.stdout: "rules": [ 2026-02-17T05:32:25.327 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.327 INFO:tasks.workunit.client.0.trial030.stdout: "rule_id": 0, 2026-02-17T05:32:25.327 INFO:tasks.workunit.client.0.trial030.stdout: "rule_name": "replicated_rule", 2026-02-17T05:32:25.327 INFO:tasks.workunit.client.0.trial030.stdout: "type": 1, 2026-02-17T05:32:25.327 INFO:tasks.workunit.client.0.trial030.stdout: "steps": [ 2026-02-17T05:32:25.327 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.327 INFO:tasks.workunit.client.0.trial030.stdout: "op": "take", 2026-02-17T05:32:25.327 INFO:tasks.workunit.client.0.trial030.stdout: "item": -1, 2026-02-17T05:32:25.327 INFO:tasks.workunit.client.0.trial030.stdout: "item_name": "default" 2026-02-17T05:32:25.327 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.327 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.327 INFO:tasks.workunit.client.0.trial030.stdout: "op": "choose_firstn", 2026-02-17T05:32:25.327 INFO:tasks.workunit.client.0.trial030.stdout: "num": 0, 2026-02-17T05:32:25.328 INFO:tasks.workunit.client.0.trial030.stdout: "type": "osd" 2026-02-17T05:32:25.328 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.328 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.328 INFO:tasks.workunit.client.0.trial030.stdout: "op": "emit" 2026-02-17T05:32:25.328 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:32:25.328 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:32:25.328 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:32:25.328 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:32:25.328 INFO:tasks.workunit.client.0.trial030.stdout: "tunables": { 2026-02-17T05:32:25.328 INFO:tasks.workunit.client.0.trial030.stdout: "choose_local_tries": 0, 2026-02-17T05:32:25.328 INFO:tasks.workunit.client.0.trial030.stdout: "choose_local_fallback_tries": 0, 2026-02-17T05:32:25.328 INFO:tasks.workunit.client.0.trial030.stdout: "choose_total_tries": 50, 2026-02-17T05:32:25.328 INFO:tasks.workunit.client.0.trial030.stdout: "chooseleaf_descend_once": 1, 2026-02-17T05:32:25.328 INFO:tasks.workunit.client.0.trial030.stdout: "chooseleaf_vary_r": 1, 2026-02-17T05:32:25.328 INFO:tasks.workunit.client.0.trial030.stdout: "chooseleaf_stable": 1, 2026-02-17T05:32:25.328 INFO:tasks.workunit.client.0.trial030.stdout: "msr_descents": 100, 2026-02-17T05:32:25.328 INFO:tasks.workunit.client.0.trial030.stdout: "msr_collision_tries": 100, 2026-02-17T05:32:25.328 INFO:tasks.workunit.client.0.trial030.stdout: "straw_calc_version": 1, 2026-02-17T05:32:25.328 INFO:tasks.workunit.client.0.trial030.stdout: "allowed_bucket_algs": 54, 2026-02-17T05:32:25.328 INFO:tasks.workunit.client.0.trial030.stdout: "profile": "jewel", 2026-02-17T05:32:25.328 INFO:tasks.workunit.client.0.trial030.stdout: "optimal_tunables": 1, 2026-02-17T05:32:25.328 INFO:tasks.workunit.client.0.trial030.stdout: "legacy_tunables": 0, 2026-02-17T05:32:25.328 INFO:tasks.workunit.client.0.trial030.stdout: "minimum_required_version": "jewel", 2026-02-17T05:32:25.328 INFO:tasks.workunit.client.0.trial030.stdout: "require_feature_tunables": 1, 2026-02-17T05:32:25.328 INFO:tasks.workunit.client.0.trial030.stdout: "require_feature_tunables2": 1, 2026-02-17T05:32:25.328 INFO:tasks.workunit.client.0.trial030.stdout: "has_v2_rules": 0, 2026-02-17T05:32:25.328 INFO:tasks.workunit.client.0.trial030.stdout: "require_feature_tunables3": 1, 2026-02-17T05:32:25.328 INFO:tasks.workunit.client.0.trial030.stdout: "has_v3_rules": 0, 2026-02-17T05:32:25.328 INFO:tasks.workunit.client.0.trial030.stdout: "has_v4_buckets": 1, 2026-02-17T05:32:25.329 INFO:tasks.workunit.client.0.trial030.stdout: "require_feature_tunables5": 1, 2026-02-17T05:32:25.329 INFO:tasks.workunit.client.0.trial030.stdout: "has_v5_rules": 0, 2026-02-17T05:32:25.329 INFO:tasks.workunit.client.0.trial030.stdout: "has_msr_rules": 0 2026-02-17T05:32:25.329 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.329 INFO:tasks.workunit.client.0.trial030.stdout: "choose_args": {} 2026-02-17T05:32:25.329 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.329 INFO:tasks.workunit.client.0.trial030.stdout: "fsmap": { 2026-02-17T05:32:25.329 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 1, 2026-02-17T05:32:25.329 INFO:tasks.workunit.client.0.trial030.stdout: "btime": "2026-02-17T05:30:42:887561+0000", 2026-02-17T05:32:25.329 INFO:tasks.workunit.client.0.trial030.stdout: "default_fscid": -1, 2026-02-17T05:32:25.329 INFO:tasks.workunit.client.0.trial030.stdout: "compat": { 2026-02-17T05:32:25.329 INFO:tasks.workunit.client.0.trial030.stdout: "compat": {}, 2026-02-17T05:32:25.329 INFO:tasks.workunit.client.0.trial030.stdout: "ro_compat": {}, 2026-02-17T05:32:25.329 INFO:tasks.workunit.client.0.trial030.stdout: "incompat": { 2026-02-17T05:32:25.329 INFO:tasks.workunit.client.0.trial030.stdout: "feature_1": "base v0.20", 2026-02-17T05:32:25.329 INFO:tasks.workunit.client.0.trial030.stdout: "feature_2": "client writeable ranges", 2026-02-17T05:32:25.329 INFO:tasks.workunit.client.0.trial030.stdout: "feature_3": "default file layouts on dirs", 2026-02-17T05:32:25.329 INFO:tasks.workunit.client.0.trial030.stdout: "feature_4": "dir inode in separate object", 2026-02-17T05:32:25.329 INFO:tasks.workunit.client.0.trial030.stdout: "feature_5": "mds uses versioned encoding", 2026-02-17T05:32:25.329 INFO:tasks.workunit.client.0.trial030.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-17T05:32:25.329 INFO:tasks.workunit.client.0.trial030.stdout: "feature_8": "no anchor table", 2026-02-17T05:32:25.329 INFO:tasks.workunit.client.0.trial030.stdout: "feature_9": "file layout v2", 2026-02-17T05:32:25.329 INFO:tasks.workunit.client.0.trial030.stdout: "feature_10": "snaprealm v2", 2026-02-17T05:32:25.329 INFO:tasks.workunit.client.0.trial030.stdout: "feature_11": "minor log segments", 2026-02-17T05:32:25.329 INFO:tasks.workunit.client.0.trial030.stdout: "feature_12": "quiesce subvolumes" 2026-02-17T05:32:25.329 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:32:25.329 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.329 INFO:tasks.workunit.client.0.trial030.stdout: "feature_flags": { 2026-02-17T05:32:25.330 INFO:tasks.workunit.client.0.trial030.stdout: "enable_multiple": true, 2026-02-17T05:32:25.330 INFO:tasks.workunit.client.0.trial030.stdout: "ever_enabled_multiple": true 2026-02-17T05:32:25.330 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.330 INFO:tasks.workunit.client.0.trial030.stdout: "standbys": [], 2026-02-17T05:32:25.330 INFO:tasks.workunit.client.0.trial030.stdout: "filesystems": [] 2026-02-17T05:32:25.330 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.330 INFO:tasks.workunit.client.0.trial030.stdout: "mdsmap_first_committed": 1, 2026-02-17T05:32:25.330 INFO:tasks.workunit.client.0.trial030.stdout: "mdsmap_last_committed": 1, 2026-02-17T05:32:25.330 INFO:tasks.workunit.client.0.trial030.stdout: "auth": { 2026-02-17T05:32:25.330 INFO:tasks.workunit.client.0.trial030.stdout: "first_committed": 1, 2026-02-17T05:32:25.330 INFO:tasks.workunit.client.0.trial030.stdout: "last_committed": 5, 2026-02-17T05:32:25.330 INFO:tasks.workunit.client.0.trial030.stdout: "num_secrets": 3 2026-02-17T05:32:25.330 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.330 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg": 32, 2026-02-17T05:32:25.330 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg_active": 32, 2026-02-17T05:32:25.330 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg_unknown": 0, 2026-02-17T05:32:25.330 INFO:tasks.workunit.client.0.trial030.stdout: "num_osd": 3, 2026-02-17T05:32:25.330 INFO:tasks.workunit.client.0.trial030.stdout: "pool_sum": { 2026-02-17T05:32:25.330 INFO:tasks.workunit.client.0.trial030.stdout: "stat_sum": { 2026-02-17T05:32:25.330 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes": 51688, 2026-02-17T05:32:25.330 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects": 100, 2026-02-17T05:32:25.330 INFO:tasks.workunit.client.0.trial030.stdout: "num_object_clones": 0, 2026-02-17T05:32:25.330 INFO:tasks.workunit.client.0.trial030.stdout: "num_object_copies": 300, 2026-02-17T05:32:25.330 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T05:32:25.330 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_missing": 0, 2026-02-17T05:32:25.330 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_degraded": 100, 2026-02-17T05:32:25.330 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_misplaced": 0, 2026-02-17T05:32:25.330 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_unfound": 0, 2026-02-17T05:32:25.330 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_dirty": 100, 2026-02-17T05:32:25.330 INFO:tasks.workunit.client.0.trial030.stdout: "num_whiteouts": 0, 2026-02-17T05:32:25.330 INFO:tasks.workunit.client.0.trial030.stdout: "num_read": 0, 2026-02-17T05:32:25.331 INFO:tasks.workunit.client.0.trial030.stdout: "num_read_kb": 0, 2026-02-17T05:32:25.331 INFO:tasks.workunit.client.0.trial030.stdout: "num_write": 101, 2026-02-17T05:32:25.331 INFO:tasks.workunit.client.0.trial030.stdout: "num_write_kb": 101, 2026-02-17T05:32:25.331 INFO:tasks.workunit.client.0.trial030.stdout: "num_scrub_errors": 0, 2026-02-17T05:32:25.331 INFO:tasks.workunit.client.0.trial030.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T05:32:25.331 INFO:tasks.workunit.client.0.trial030.stdout: "num_deep_scrub_errors": 0, 2026-02-17T05:32:25.331 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_recovered": 0, 2026-02-17T05:32:25.331 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes_recovered": 0, 2026-02-17T05:32:25.331 INFO:tasks.workunit.client.0.trial030.stdout: "num_keys_recovered": 0, 2026-02-17T05:32:25.331 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_omap": 0, 2026-02-17T05:32:25.331 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T05:32:25.331 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T05:32:25.331 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush": 0, 2026-02-17T05:32:25.331 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_kb": 0, 2026-02-17T05:32:25.331 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict": 0, 2026-02-17T05:32:25.331 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_kb": 0, 2026-02-17T05:32:25.331 INFO:tasks.workunit.client.0.trial030.stdout: "num_promote": 0, 2026-02-17T05:32:25.331 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_mode_high": 0, 2026-02-17T05:32:25.331 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_mode_low": 0, 2026-02-17T05:32:25.331 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_mode_some": 0, 2026-02-17T05:32:25.331 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_mode_full": 0, 2026-02-17T05:32:25.331 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_pinned": 0, 2026-02-17T05:32:25.331 INFO:tasks.workunit.client.0.trial030.stdout: "num_legacy_snapsets": 0, 2026-02-17T05:32:25.331 INFO:tasks.workunit.client.0.trial030.stdout: "num_large_omap_objects": 0, 2026-02-17T05:32:25.331 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_manifest": 0, 2026-02-17T05:32:25.331 INFO:tasks.workunit.client.0.trial030.stdout: "num_omap_bytes": 0, 2026-02-17T05:32:25.331 INFO:tasks.workunit.client.0.trial030.stdout: "num_omap_keys": 0, 2026-02-17T05:32:25.331 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_repaired": 0 2026-02-17T05:32:25.331 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.331 INFO:tasks.workunit.client.0.trial030.stdout: "store_stats": { 2026-02-17T05:32:25.332 INFO:tasks.workunit.client.0.trial030.stdout: "total": 0, 2026-02-17T05:32:25.332 INFO:tasks.workunit.client.0.trial030.stdout: "available": 0, 2026-02-17T05:32:25.332 INFO:tasks.workunit.client.0.trial030.stdout: "internally_reserved": 0, 2026-02-17T05:32:25.332 INFO:tasks.workunit.client.0.trial030.stdout: "allocated": 0, 2026-02-17T05:32:25.332 INFO:tasks.workunit.client.0.trial030.stdout: "data_stored": 0, 2026-02-17T05:32:25.332 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed": 0, 2026-02-17T05:32:25.332 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_allocated": 0, 2026-02-17T05:32:25.332 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_original": 0, 2026-02-17T05:32:25.332 INFO:tasks.workunit.client.0.trial030.stdout: "omap_allocated": 0, 2026-02-17T05:32:25.332 INFO:tasks.workunit.client.0.trial030.stdout: "internal_metadata": 0 2026-02-17T05:32:25.332 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.332 INFO:tasks.workunit.client.0.trial030.stdout: "log_size": 513, 2026-02-17T05:32:25.332 INFO:tasks.workunit.client.0.trial030.stdout: "ondisk_log_size": 513, 2026-02-17T05:32:25.332 INFO:tasks.workunit.client.0.trial030.stdout: "up": 64, 2026-02-17T05:32:25.332 INFO:tasks.workunit.client.0.trial030.stdout: "acting": 64, 2026-02-17T05:32:25.332 INFO:tasks.workunit.client.0.trial030.stdout: "num_store_stats": 0 2026-02-17T05:32:25.332 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.332 INFO:tasks.workunit.client.0.trial030.stdout: "osd_sum": { 2026-02-17T05:32:25.332 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 0, 2026-02-17T05:32:25.332 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 0, 2026-02-17T05:32:25.332 INFO:tasks.workunit.client.0.trial030.stdout: "num_pgs": 65, 2026-02-17T05:32:25.332 INFO:tasks.workunit.client.0.trial030.stdout: "num_osds": 3, 2026-02-17T05:32:25.332 INFO:tasks.workunit.client.0.trial030.stdout: "num_per_pool_osds": 3, 2026-02-17T05:32:25.332 INFO:tasks.workunit.client.0.trial030.stdout: "num_per_pool_omap_osds": 3, 2026-02-17T05:32:25.332 INFO:tasks.workunit.client.0.trial030.stdout: "kb": 314572800, 2026-02-17T05:32:25.332 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used": 83952, 2026-02-17T05:32:25.332 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_data": 2168, 2026-02-17T05:32:25.332 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_omap": 29, 2026-02-17T05:32:25.332 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_meta": 81698, 2026-02-17T05:32:25.333 INFO:tasks.workunit.client.0.trial030.stdout: "kb_avail": 314488848, 2026-02-17T05:32:25.333 INFO:tasks.workunit.client.0.trial030.stdout: "statfs": { 2026-02-17T05:32:25.333 INFO:tasks.workunit.client.0.trial030.stdout: "total": 322122547200, 2026-02-17T05:32:25.333 INFO:tasks.workunit.client.0.trial030.stdout: "available": 322036580352, 2026-02-17T05:32:25.333 INFO:tasks.workunit.client.0.trial030.stdout: "internally_reserved": 0, 2026-02-17T05:32:25.333 INFO:tasks.workunit.client.0.trial030.stdout: "allocated": 2220032, 2026-02-17T05:32:25.333 INFO:tasks.workunit.client.0.trial030.stdout: "data_stored": 456860, 2026-02-17T05:32:25.333 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed": 0, 2026-02-17T05:32:25.333 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_allocated": 0, 2026-02-17T05:32:25.333 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_original": 0, 2026-02-17T05:32:25.333 INFO:tasks.workunit.client.0.trial030.stdout: "omap_allocated": 30616, 2026-02-17T05:32:25.333 INFO:tasks.workunit.client.0.trial030.stdout: "internal_metadata": 83658856 2026-02-17T05:32:25.333 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.333 INFO:tasks.workunit.client.0.trial030.stdout: "hb_peers": [], 2026-02-17T05:32:25.333 INFO:tasks.workunit.client.0.trial030.stdout: "snap_trim_queue_len": 0, 2026-02-17T05:32:25.333 INFO:tasks.workunit.client.0.trial030.stdout: "num_snap_trimming": 0, 2026-02-17T05:32:25.333 INFO:tasks.workunit.client.0.trial030.stdout: "num_shards_repaired": 0, 2026-02-17T05:32:25.333 INFO:tasks.workunit.client.0.trial030.stdout: "op_queue_age_hist": { 2026-02-17T05:32:25.333 INFO:tasks.workunit.client.0.trial030.stdout: "histogram": [], 2026-02-17T05:32:25.333 INFO:tasks.workunit.client.0.trial030.stdout: "upper_bound": 1 2026-02-17T05:32:25.333 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.333 INFO:tasks.workunit.client.0.trial030.stdout: "perf_stat": { 2026-02-17T05:32:25.333 INFO:tasks.workunit.client.0.trial030.stdout: "commit_latency_ms": 0, 2026-02-17T05:32:25.333 INFO:tasks.workunit.client.0.trial030.stdout: "apply_latency_ms": 0, 2026-02-17T05:32:25.333 INFO:tasks.workunit.client.0.trial030.stdout: "commit_latency_ns": 0, 2026-02-17T05:32:25.333 INFO:tasks.workunit.client.0.trial030.stdout: "apply_latency_ns": 0 2026-02-17T05:32:25.333 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.333 INFO:tasks.workunit.client.0.trial030.stdout: "alerts": [], 2026-02-17T05:32:25.333 INFO:tasks.workunit.client.0.trial030.stdout: "network_ping_times": [] 2026-02-17T05:32:25.333 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.334 INFO:tasks.workunit.client.0.trial030.stdout: "osd_sum_by_class": { 2026-02-17T05:32:25.334 INFO:tasks.workunit.client.0.trial030.stdout: "ssd": { 2026-02-17T05:32:25.334 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 0, 2026-02-17T05:32:25.334 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 0, 2026-02-17T05:32:25.334 INFO:tasks.workunit.client.0.trial030.stdout: "num_pgs": 65, 2026-02-17T05:32:25.334 INFO:tasks.workunit.client.0.trial030.stdout: "num_osds": 3, 2026-02-17T05:32:25.334 INFO:tasks.workunit.client.0.trial030.stdout: "num_per_pool_osds": 3, 2026-02-17T05:32:25.334 INFO:tasks.workunit.client.0.trial030.stdout: "num_per_pool_omap_osds": 3, 2026-02-17T05:32:25.334 INFO:tasks.workunit.client.0.trial030.stdout: "kb": 314572800, 2026-02-17T05:32:25.334 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used": 83952, 2026-02-17T05:32:25.334 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_data": 2168, 2026-02-17T05:32:25.334 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_omap": 29, 2026-02-17T05:32:25.334 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_meta": 81698, 2026-02-17T05:32:25.334 INFO:tasks.workunit.client.0.trial030.stdout: "kb_avail": 314488848, 2026-02-17T05:32:25.334 INFO:tasks.workunit.client.0.trial030.stdout: "statfs": { 2026-02-17T05:32:25.334 INFO:tasks.workunit.client.0.trial030.stdout: "total": 322122547200, 2026-02-17T05:32:25.334 INFO:tasks.workunit.client.0.trial030.stdout: "available": 322036580352, 2026-02-17T05:32:25.334 INFO:tasks.workunit.client.0.trial030.stdout: "internally_reserved": 0, 2026-02-17T05:32:25.334 INFO:tasks.workunit.client.0.trial030.stdout: "allocated": 2220032, 2026-02-17T05:32:25.334 INFO:tasks.workunit.client.0.trial030.stdout: "data_stored": 456860, 2026-02-17T05:32:25.334 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed": 0, 2026-02-17T05:32:25.334 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_allocated": 0, 2026-02-17T05:32:25.334 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_original": 0, 2026-02-17T05:32:25.334 INFO:tasks.workunit.client.0.trial030.stdout: "omap_allocated": 30616, 2026-02-17T05:32:25.334 INFO:tasks.workunit.client.0.trial030.stdout: "internal_metadata": 83658856 2026-02-17T05:32:25.334 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.334 INFO:tasks.workunit.client.0.trial030.stdout: "hb_peers": [], 2026-02-17T05:32:25.334 INFO:tasks.workunit.client.0.trial030.stdout: "snap_trim_queue_len": 0, 2026-02-17T05:32:25.334 INFO:tasks.workunit.client.0.trial030.stdout: "num_snap_trimming": 0, 2026-02-17T05:32:25.334 INFO:tasks.workunit.client.0.trial030.stdout: "num_shards_repaired": 0, 2026-02-17T05:32:25.334 INFO:tasks.workunit.client.0.trial030.stdout: "op_queue_age_hist": { 2026-02-17T05:32:25.334 INFO:tasks.workunit.client.0.trial030.stdout: "histogram": [], 2026-02-17T05:32:25.335 INFO:tasks.workunit.client.0.trial030.stdout: "upper_bound": 1 2026-02-17T05:32:25.335 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.335 INFO:tasks.workunit.client.0.trial030.stdout: "perf_stat": { 2026-02-17T05:32:25.335 INFO:tasks.workunit.client.0.trial030.stdout: "commit_latency_ms": 0, 2026-02-17T05:32:25.335 INFO:tasks.workunit.client.0.trial030.stdout: "apply_latency_ms": 0, 2026-02-17T05:32:25.335 INFO:tasks.workunit.client.0.trial030.stdout: "commit_latency_ns": 0, 2026-02-17T05:32:25.335 INFO:tasks.workunit.client.0.trial030.stdout: "apply_latency_ns": 0 2026-02-17T05:32:25.335 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.335 INFO:tasks.workunit.client.0.trial030.stdout: "alerts": [], 2026-02-17T05:32:25.335 INFO:tasks.workunit.client.0.trial030.stdout: "network_ping_times": [] 2026-02-17T05:32:25.335 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:32:25.335 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.335 INFO:tasks.workunit.client.0.trial030.stdout: "pool_stats": [ 2026-02-17T05:32:25.335 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.335 INFO:tasks.workunit.client.0.trial030.stdout: "poolid": 1, 2026-02-17T05:32:25.335 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg": 32, 2026-02-17T05:32:25.335 INFO:tasks.workunit.client.0.trial030.stdout: "stat_sum": { 2026-02-17T05:32:25.335 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes": 51688, 2026-02-17T05:32:25.335 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects": 100, 2026-02-17T05:32:25.335 INFO:tasks.workunit.client.0.trial030.stdout: "num_object_clones": 0, 2026-02-17T05:32:25.335 INFO:tasks.workunit.client.0.trial030.stdout: "num_object_copies": 300, 2026-02-17T05:32:25.335 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T05:32:25.335 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_missing": 0, 2026-02-17T05:32:25.335 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_degraded": 100, 2026-02-17T05:32:25.335 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_misplaced": 0, 2026-02-17T05:32:25.335 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_unfound": 0, 2026-02-17T05:32:25.335 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_dirty": 100, 2026-02-17T05:32:25.335 INFO:tasks.workunit.client.0.trial030.stdout: "num_whiteouts": 0, 2026-02-17T05:32:25.335 INFO:tasks.workunit.client.0.trial030.stdout: "num_read": 0, 2026-02-17T05:32:25.335 INFO:tasks.workunit.client.0.trial030.stdout: "num_read_kb": 0, 2026-02-17T05:32:25.335 INFO:tasks.workunit.client.0.trial030.stdout: "num_write": 101, 2026-02-17T05:32:25.335 INFO:tasks.workunit.client.0.trial030.stdout: "num_write_kb": 101, 2026-02-17T05:32:25.336 INFO:tasks.workunit.client.0.trial030.stdout: "num_scrub_errors": 0, 2026-02-17T05:32:25.336 INFO:tasks.workunit.client.0.trial030.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T05:32:25.336 INFO:tasks.workunit.client.0.trial030.stdout: "num_deep_scrub_errors": 0, 2026-02-17T05:32:25.336 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_recovered": 0, 2026-02-17T05:32:25.336 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes_recovered": 0, 2026-02-17T05:32:25.336 INFO:tasks.workunit.client.0.trial030.stdout: "num_keys_recovered": 0, 2026-02-17T05:32:25.336 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_omap": 0, 2026-02-17T05:32:25.336 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T05:32:25.336 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T05:32:25.336 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush": 0, 2026-02-17T05:32:25.336 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_kb": 0, 2026-02-17T05:32:25.336 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict": 0, 2026-02-17T05:32:25.336 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_kb": 0, 2026-02-17T05:32:25.336 INFO:tasks.workunit.client.0.trial030.stdout: "num_promote": 0, 2026-02-17T05:32:25.336 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_mode_high": 0, 2026-02-17T05:32:25.336 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_mode_low": 0, 2026-02-17T05:32:25.336 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_mode_some": 0, 2026-02-17T05:32:25.336 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_mode_full": 0, 2026-02-17T05:32:25.336 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_pinned": 0, 2026-02-17T05:32:25.336 INFO:tasks.workunit.client.0.trial030.stdout: "num_legacy_snapsets": 0, 2026-02-17T05:32:25.336 INFO:tasks.workunit.client.0.trial030.stdout: "num_large_omap_objects": 0, 2026-02-17T05:32:25.336 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_manifest": 0, 2026-02-17T05:32:25.336 INFO:tasks.workunit.client.0.trial030.stdout: "num_omap_bytes": 0, 2026-02-17T05:32:25.336 INFO:tasks.workunit.client.0.trial030.stdout: "num_omap_keys": 0, 2026-02-17T05:32:25.336 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_repaired": 0 2026-02-17T05:32:25.336 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.336 INFO:tasks.workunit.client.0.trial030.stdout: "store_stats": { 2026-02-17T05:32:25.336 INFO:tasks.workunit.client.0.trial030.stdout: "total": 0, 2026-02-17T05:32:25.336 INFO:tasks.workunit.client.0.trial030.stdout: "available": 0, 2026-02-17T05:32:25.336 INFO:tasks.workunit.client.0.trial030.stdout: "internally_reserved": 0, 2026-02-17T05:32:25.336 INFO:tasks.workunit.client.0.trial030.stdout: "allocated": 1220608, 2026-02-17T05:32:25.336 INFO:tasks.workunit.client.0.trial030.stdout: "data_stored": 154528, 2026-02-17T05:32:25.336 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed": 0, 2026-02-17T05:32:25.337 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_allocated": 0, 2026-02-17T05:32:25.337 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_original": 0, 2026-02-17T05:32:25.337 INFO:tasks.workunit.client.0.trial030.stdout: "omap_allocated": 0, 2026-02-17T05:32:25.337 INFO:tasks.workunit.client.0.trial030.stdout: "internal_metadata": 0 2026-02-17T05:32:25.337 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.337 INFO:tasks.workunit.client.0.trial030.stdout: "log_size": 513, 2026-02-17T05:32:25.337 INFO:tasks.workunit.client.0.trial030.stdout: "ondisk_log_size": 513, 2026-02-17T05:32:25.337 INFO:tasks.workunit.client.0.trial030.stdout: "up": 64, 2026-02-17T05:32:25.337 INFO:tasks.workunit.client.0.trial030.stdout: "acting": 64, 2026-02-17T05:32:25.337 INFO:tasks.workunit.client.0.trial030.stdout: "num_store_stats": 3 2026-02-17T05:32:25.337 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:32:25.337 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:32:25.337 INFO:tasks.workunit.client.0.trial030.stdout: "osd_stats": [ 2026-02-17T05:32:25.337 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.337 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 0, 2026-02-17T05:32:25.337 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 154618822673 2026-02-17T05:32:25.337 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.337 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.337 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 1, 2026-02-17T05:32:25.337 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 38654705676 2026-02-17T05:32:25.337 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.337 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.337 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2, 2026-02-17T05:32:25.337 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 167503724560 2026-02-17T05:32:25.337 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:32:25.337 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:32:25.337 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg_by_state": [ 2026-02-17T05:32:25.337 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.337 INFO:tasks.workunit.client.0.trial030.stdout: "state": "active+undersized+degraded", 2026-02-17T05:32:25.337 INFO:tasks.workunit.client.0.trial030.stdout: "num": 32 2026-02-17T05:32:25.337 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:32:25.337 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:32:25.337 INFO:tasks.workunit.client.0.trial030.stdout: "pool_pg_unavailable_map": [ 2026-02-17T05:32:25.338 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.338 INFO:tasks.workunit.client.0.trial030.stdout: "poolid": "1", 2026-02-17T05:32:25.338 INFO:tasks.workunit.client.0.trial030.stdout: "pgs": [] 2026-02-17T05:32:25.338 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:32:25.338 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:32:25.338 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg_by_osd": [ 2026-02-17T05:32:25.338 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.338 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2, 2026-02-17T05:32:25.338 INFO:tasks.workunit.client.0.trial030.stdout: "num_primary_pg": 0, 2026-02-17T05:32:25.338 INFO:tasks.workunit.client.0.trial030.stdout: "num_acting_pg": 32, 2026-02-17T05:32:25.338 INFO:tasks.workunit.client.0.trial030.stdout: "num_up_not_acting_pg": 0 2026-02-17T05:32:25.338 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.338 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.338 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 0, 2026-02-17T05:32:25.338 INFO:tasks.workunit.client.0.trial030.stdout: "num_primary_pg": 32, 2026-02-17T05:32:25.338 INFO:tasks.workunit.client.0.trial030.stdout: "num_acting_pg": 32, 2026-02-17T05:32:25.338 INFO:tasks.workunit.client.0.trial030.stdout: "num_up_not_acting_pg": 0 2026-02-17T05:32:25.338 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.338 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.338 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 1, 2026-02-17T05:32:25.338 INFO:tasks.workunit.client.0.trial030.stdout: "num_primary_pg": 0, 2026-02-17T05:32:25.338 INFO:tasks.workunit.client.0.trial030.stdout: "num_acting_pg": 0, 2026-02-17T05:32:25.338 INFO:tasks.workunit.client.0.trial030.stdout: "num_up_not_acting_pg": 0 2026-02-17T05:32:25.338 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:32:25.338 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:32:25.338 INFO:tasks.workunit.client.0.trial030.stdout: "purged_snaps": [ 2026-02-17T05:32:25.338 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:32:25.338 INFO:tasks.workunit.client.0.trial030.stdout: "pool": 1, 2026-02-17T05:32:25.338 INFO:tasks.workunit.client.0.trial030.stdout: "purged_snaps": {} 2026-02-17T05:32:25.338 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:32:25.338 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:32:25.338 INFO:tasks.workunit.client.0.trial030.stdout: "servicemap": { 2026-02-17T05:32:25.338 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 4, 2026-02-17T05:32:25.338 INFO:tasks.workunit.client.0.trial030.stdout: "modified": "2026-02-17T05:32:23.315879+0000", 2026-02-17T05:32:25.339 INFO:tasks.workunit.client.0.trial030.stdout: "services": { 2026-02-17T05:32:25.339 INFO:tasks.workunit.client.0.trial030.stdout: "osd": { 2026-02-17T05:32:25.339 INFO:tasks.workunit.client.0.trial030.stdout: "daemons": { 2026-02-17T05:32:25.339 INFO:tasks.workunit.client.0.trial030.stdout: "summary": "", 2026-02-17T05:32:25.339 INFO:tasks.workunit.client.0.trial030.stdout: "2": { 2026-02-17T05:32:25.339 INFO:tasks.workunit.client.0.trial030.stdout: "start_epoch": 0, 2026-02-17T05:32:25.339 INFO:tasks.workunit.client.0.trial030.stdout: "start_stamp": "0.000000", 2026-02-17T05:32:25.339 INFO:tasks.workunit.client.0.trial030.stdout: "gid": 0, 2026-02-17T05:32:25.339 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-17T05:32:25.339 INFO:tasks.workunit.client.0.trial030.stdout: "metadata": {}, 2026-02-17T05:32:25.339 INFO:tasks.workunit.client.0.trial030.stdout: "task_status": {} 2026-02-17T05:32:25.339 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:32:25.339 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:32:25.339 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:32:25.339 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:32:25.339 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:32:25.339 INFO:tasks.workunit.client.0.trial030.stdout: "mgrstat_first_committed": 1, 2026-02-17T05:32:25.339 INFO:tasks.workunit.client.0.trial030.stdout: "mgrstat_last_committed": 51, 2026-02-17T05:32:25.339 INFO:tasks.workunit.client.0.trial030.stdout: "logm_first_committed": 1, 2026-02-17T05:32:25.339 INFO:tasks.workunit.client.0.trial030.stdout: "logm_last_committed": 294, 2026-02-17T05:32:25.339 INFO:tasks.workunit.client.0.trial030.stdout: "paxos": { 2026-02-17T05:32:25.339 INFO:tasks.workunit.client.0.trial030.stdout: "first_committed": 1, 2026-02-17T05:32:25.339 INFO:tasks.workunit.client.0.trial030.stdout: "last_committed": 400, 2026-02-17T05:32:25.339 INFO:tasks.workunit.client.0.trial030.stdout: "last_pn": 0, 2026-02-17T05:32:25.339 INFO:tasks.workunit.client.0.trial030.stdout: "accepted_pn": 0 2026-02-17T05:32:25.339 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:32:25.339 INFO:tasks.workunit.client.0.trial030.stdout:} 2026-02-17T05:32:25.339 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-17T05:32:25.340 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:763: TEST_divergent_3: echo 'delay recovery' 2026-02-17T05:32:25.340 INFO:tasks.workunit.client.0.trial030.stdout:delay recovery 2026-02-17T05:32:25.340 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:764: TEST_divergent_3: ceph pg dump pgs 2026-02-17T05:32:25.477 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T05:32:25.477 INFO:tasks.workunit.client.0.trial030.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475386+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.477 INFO:tasks.workunit.client.0.trial030.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475735+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.477 INFO:tasks.workunit.client.0.trial030.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475384+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.477 INFO:tasks.workunit.client.0.trial030.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473236+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.477 INFO:tasks.workunit.client.0.trial030.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473301+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.477 INFO:tasks.workunit.client.0.trial030.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473278+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.477 INFO:tasks.workunit.client.0.trial030.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473183+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.477 INFO:tasks.workunit.client.0.trial030.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473574+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.478 INFO:tasks.workunit.client.0.trial030.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473683+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.478 INFO:tasks.workunit.client.0.trial030.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473242+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.478 INFO:tasks.workunit.client.0.trial030.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473269+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.478 INFO:tasks.workunit.client.0.trial030.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475754+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.478 INFO:tasks.workunit.client.0.trial030.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473125+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.478 INFO:tasks.workunit.client.0.trial030.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473523+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.478 INFO:tasks.workunit.client.0.trial030.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.472885+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.478 INFO:tasks.workunit.client.0.trial030.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475660+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.478 INFO:tasks.workunit.client.0.trial030.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:57.710342+0000 29'100 45:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 user requested scrub scheduled @ 2026-02-17T05:32:49.800913+0000 0 0 2026-02-17T05:32:25.478 INFO:tasks.workunit.client.0.trial030.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473488+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.478 INFO:tasks.workunit.client.0.trial030.stdout:1.e 3 0 3 0 0 2088 0 0 17 84 17 active+undersized+degraded 2026-02-17T05:31:47.473420+0000 45'101 45:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.478 INFO:tasks.workunit.client.0.trial030.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473513+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.478 INFO:tasks.workunit.client.0.trial030.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.474067+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.478 INFO:tasks.workunit.client.0.trial030.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.474512+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.478 INFO:tasks.workunit.client.0.trial030.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473926+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.478 INFO:tasks.workunit.client.0.trial030.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473600+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.478 INFO:tasks.workunit.client.0.trial030.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475615+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.478 INFO:tasks.workunit.client.0.trial030.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475686+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.478 INFO:tasks.workunit.client.0.trial030.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475643+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.478 INFO:tasks.workunit.client.0.trial030.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475538+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.478 INFO:tasks.workunit.client.0.trial030.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473932+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.478 INFO:tasks.workunit.client.0.trial030.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473622+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.478 INFO:tasks.workunit.client.0.trial030.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475784+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.479 INFO:tasks.workunit.client.0.trial030.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475304+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.479 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-17T05:32:25.479 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T05:32:25.479 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:32:25.486 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:765: TEST_divergent_3: for i in $non_divergent 2026-02-17T05:32:25.486 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: get_asok_path osd.0 2026-02-17T05:32:25.486 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-17T05:32:25.486 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-17T05:32:25.487 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T05:32:25.487 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:32:25.487 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:32:25.488 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19532/ceph-osd.0.asok 2026-02-17T05:32:25.488 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: CEPH_ARGS= 2026-02-17T05:32:25.488 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.19532/ceph-osd.0.asok set_recovery_delay 100000 2026-02-17T05:32:25.552 INFO:tasks.workunit.client.0.trial030.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-17T05:32:25.557 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:765: TEST_divergent_3: for i in $non_divergent 2026-02-17T05:32:25.558 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: get_asok_path osd.2 2026-02-17T05:32:25.558 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-17T05:32:25.558 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-17T05:32:25.558 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T05:32:25.558 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:32:25.558 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:32:25.559 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19532/ceph-osd.2.asok 2026-02-17T05:32:25.559 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: CEPH_ARGS= 2026-02-17T05:32:25.559 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.19532/ceph-osd.2.asok set_recovery_delay 100000 2026-02-17T05:32:25.614 INFO:tasks.workunit.client.0.trial030.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-17T05:32:25.620 INFO:tasks.workunit.client.0.trial030.stdout:revive divergent 1 2026-02-17T05:32:25.620 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:771: TEST_divergent_3: echo 'revive divergent 1' 2026-02-17T05:32:25.620 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:772: TEST_divergent_3: ceph pg dump pgs 2026-02-17T05:32:25.840 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T05:32:25.840 INFO:tasks.workunit.client.0.trial030.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475386+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.841 INFO:tasks.workunit.client.0.trial030.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475735+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.841 INFO:tasks.workunit.client.0.trial030.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475384+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.841 INFO:tasks.workunit.client.0.trial030.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473236+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.841 INFO:tasks.workunit.client.0.trial030.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473301+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.841 INFO:tasks.workunit.client.0.trial030.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473278+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.841 INFO:tasks.workunit.client.0.trial030.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473183+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.841 INFO:tasks.workunit.client.0.trial030.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473574+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.841 INFO:tasks.workunit.client.0.trial030.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473683+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.841 INFO:tasks.workunit.client.0.trial030.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473242+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.842 INFO:tasks.workunit.client.0.trial030.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473269+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.842 INFO:tasks.workunit.client.0.trial030.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475754+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.842 INFO:tasks.workunit.client.0.trial030.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473125+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.842 INFO:tasks.workunit.client.0.trial030.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473523+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.842 INFO:tasks.workunit.client.0.trial030.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.472885+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.842 INFO:tasks.workunit.client.0.trial030.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475660+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.842 INFO:tasks.workunit.client.0.trial030.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:57.710342+0000 29'100 45:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 user requested scrub scheduled @ 2026-02-17T05:32:49.800913+0000 0 0 2026-02-17T05:32:25.842 INFO:tasks.workunit.client.0.trial030.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473488+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.842 INFO:tasks.workunit.client.0.trial030.stdout:1.e 3 0 3 0 0 2088 0 0 17 84 17 active+undersized+degraded 2026-02-17T05:31:47.473420+0000 45'101 45:146 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.842 INFO:tasks.workunit.client.0.trial030.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473513+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.843 INFO:tasks.workunit.client.0.trial030.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.474067+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.843 INFO:tasks.workunit.client.0.trial030.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.474512+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.843 INFO:tasks.workunit.client.0.trial030.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473926+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.843 INFO:tasks.workunit.client.0.trial030.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473600+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.843 INFO:tasks.workunit.client.0.trial030.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475615+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.843 INFO:tasks.workunit.client.0.trial030.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475686+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.843 INFO:tasks.workunit.client.0.trial030.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475643+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.843 INFO:tasks.workunit.client.0.trial030.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475538+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.843 INFO:tasks.workunit.client.0.trial030.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473932+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.843 INFO:tasks.workunit.client.0.trial030.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473622+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.844 INFO:tasks.workunit.client.0.trial030.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475784+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.844 INFO:tasks.workunit.client.0.trial030.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475304+0000 29'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:25.844 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-17T05:32:25.844 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T05:32:25.844 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:32:25.851 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:773: TEST_divergent_3: ceph osd set noup 2026-02-17T05:32:26.165 INFO:tasks.workunit.client.0.trial030.stderr:noup is set 2026-02-17T05:32:26.179 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:774: TEST_divergent_3: activate_osd td/divergent-priors 1 2026-02-17T05:32:26.179 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-17T05:32:26.179 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T05:32:26.179 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T05:32:26.179 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T05:32:26.179 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-17T05:32:26.180 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T05:32:26.180 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:32:26.180 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:32:26.180 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:32:26.180 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-17T05:32:26.180 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-17T05:32:26.180 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T05:32:26.180 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T05:32:26.180 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T05:32:26.180 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T05:32:26.180 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:32:26.180 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:32:26.181 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:32:26.181 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:32:26.181 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:32:26.181 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:32:26.181 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:32:26.181 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:32:26.181 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T05:32:26.181 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T05:32:26.181 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:32:26.181 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:32:26.181 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:32:26.181 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:32:26.182 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T05:32:26.182 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T05:32:26.182 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-17T05:32:26.182 INFO:tasks.workunit.client.0.trial030.stdout:start osd.1 2026-02-17T05:32:26.183 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T05:32:26.183 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T05:32:26.184 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-17T05:32:26.184 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T05:32:26.184 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T05:32:26.184 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T05:32:26.184 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T05:32:26.198 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:32:26.194+0000 7fafd5f8ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:32:26.199 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:32:26.198+0000 7fafd5f8ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:32:26.200 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:32:26.198+0000 7fafd5f8ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:32:26.405 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: return 0 2026-02-17T05:32:26.405 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:775: TEST_divergent_3: sleep 5 2026-02-17T05:32:26.565 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:32:26.561+0000 7fafd5f8ba40 -1 Falling back to public interface 2026-02-17T05:32:27.125 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:32:27.121+0000 7fafd5f8ba40 -1 osd.1 29 log_to_monitors true 2026-02-17T05:32:31.407 INFO:tasks.workunit.client.0.trial030.stdout:delay recovery divergent 2026-02-17T05:32:31.408 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:777: TEST_divergent_3: echo 'delay recovery divergent' 2026-02-17T05:32:31.408 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:778: TEST_divergent_3: ceph pg dump pgs 2026-02-17T05:32:31.606 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T05:32:31.606 INFO:tasks.workunit.client.0.trial030.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475386+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:31.606 INFO:tasks.workunit.client.0.trial030.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475735+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:31.606 INFO:tasks.workunit.client.0.trial030.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475384+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:31.606 INFO:tasks.workunit.client.0.trial030.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473236+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 user requested scrub scheduled @ 2026-02-17T05:32:51.809672+0000 0 0 2026-02-17T05:32:31.606 INFO:tasks.workunit.client.0.trial030.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473301+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 user requested scrub scheduled @ 2026-02-17T05:33:23.756220+0000 0 0 2026-02-17T05:32:31.606 INFO:tasks.workunit.client.0.trial030.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473278+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 user requested scrub scheduled @ 2026-02-17T05:33:25.749719+0000 0 0 2026-02-17T05:32:31.606 INFO:tasks.workunit.client.0.trial030.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473183+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 user requested scrub scheduled @ 2026-02-17T05:33:20.788033+0000 0 0 2026-02-17T05:32:31.606 INFO:tasks.workunit.client.0.trial030.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473574+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 user requested scrub scheduled @ 2026-02-17T05:33:17.854908+0000 0 0 2026-02-17T05:32:31.607 INFO:tasks.workunit.client.0.trial030.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473683+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 user requested scrub scheduled @ 2026-02-17T05:33:15.809432+0000 0 0 2026-02-17T05:32:31.607 INFO:tasks.workunit.client.0.trial030.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473242+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 user requested scrub scheduled @ 2026-02-17T05:32:54.797640+0000 0 0 2026-02-17T05:32:31.607 INFO:tasks.workunit.client.0.trial030.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473269+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 user requested scrub scheduled @ 2026-02-17T05:32:50.779352+0000 0 0 2026-02-17T05:32:31.607 INFO:tasks.workunit.client.0.trial030.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475754+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:31.607 INFO:tasks.workunit.client.0.trial030.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473125+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 user requested scrub scheduled @ 2026-02-17T05:33:04.774761+0000 0 0 2026-02-17T05:32:31.607 INFO:tasks.workunit.client.0.trial030.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473523+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 user requested scrub scheduled @ 2026-02-17T05:33:12.827040+0000 0 0 2026-02-17T05:32:31.607 INFO:tasks.workunit.client.0.trial030.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.472885+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 user requested scrub scheduled @ 2026-02-17T05:33:11.873439+0000 0 0 2026-02-17T05:32:31.607 INFO:tasks.workunit.client.0.trial030.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475660+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:31.607 INFO:tasks.workunit.client.0.trial030.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:57.710342+0000 29'100 48:152 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 user requested scrub scheduled @ 2026-02-17T05:32:49.800913+0000 0 0 2026-02-17T05:32:31.607 INFO:tasks.workunit.client.0.trial030.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473488+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 user requested scrub scheduled @ 2026-02-17T05:33:13.840986+0000 0 0 2026-02-17T05:32:31.607 INFO:tasks.workunit.client.0.trial030.stdout:1.e 3 0 3 0 0 2088 0 0 17 84 17 active+undersized+degraded 2026-02-17T05:31:47.473420+0000 45'101 48:152 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 user requested scrub scheduled @ 2026-02-17T05:33:09.873101+0000 0 0 2026-02-17T05:32:31.608 INFO:tasks.workunit.client.0.trial030.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473513+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 user requested scrub scheduled @ 2026-02-17T05:33:05.787772+0000 0 0 2026-02-17T05:32:31.608 INFO:tasks.workunit.client.0.trial030.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.474067+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:31.608 INFO:tasks.workunit.client.0.trial030.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.474512+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:31.608 INFO:tasks.workunit.client.0.trial030.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473926+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:31.608 INFO:tasks.workunit.client.0.trial030.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473600+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 user requested scrub scheduled @ 2026-02-17T05:33:18.835536+0000 0 0 2026-02-17T05:32:31.608 INFO:tasks.workunit.client.0.trial030.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475615+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:31.608 INFO:tasks.workunit.client.0.trial030.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475686+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:31.608 INFO:tasks.workunit.client.0.trial030.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475643+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:31.608 INFO:tasks.workunit.client.0.trial030.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475538+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:31.608 INFO:tasks.workunit.client.0.trial030.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473932+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 user requested scrub scheduled @ 2026-02-17T05:33:19.795379+0000 0 0 2026-02-17T05:32:31.608 INFO:tasks.workunit.client.0.trial030.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473622+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:31.608 INFO:tasks.workunit.client.0.trial030.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475784+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:31.609 INFO:tasks.workunit.client.0.trial030.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475304+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:31.609 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-17T05:32:31.609 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T05:32:31.609 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:32:31.616 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:779: TEST_divergent_3: get_asok_path osd.1 2026-02-17T05:32:31.617 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-17T05:32:31.617 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-17T05:32:31.618 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T05:32:31.618 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:32:31.618 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:32:31.618 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19532/ceph-osd.1.asok 2026-02-17T05:32:31.618 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:779: TEST_divergent_3: CEPH_ARGS= 2026-02-17T05:32:31.618 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:779: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.19532/ceph-osd.1.asok set_recovery_delay 100000 2026-02-17T05:32:31.683 INFO:tasks.workunit.client.0.trial030.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-17T05:32:31.689 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:781: TEST_divergent_3: ceph osd unset noup 2026-02-17T05:32:32.017 INFO:tasks.workunit.client.0.trial030.stderr:noup is unset 2026-02-17T05:32:32.032 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:783: TEST_divergent_3: wait_for_osd up 0 2026-02-17T05:32:32.032 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:32:32.032 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T05:32:32.032 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:32:32.032 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:32:32.032 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:32:32.032 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:32:32.033 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:32:32.033 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:32:32.033 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T05:32:32.255 INFO:tasks.workunit.client.0.trial030.stdout:osd.0 up in weight 1 up_from 36 up_thru 44 down_at 30 last_clean_interval [5,29) [v2:127.0.0.1:6800/3611726545,v1:127.0.0.1:6801/3611726545] [v2:127.0.0.1:6802/3611726545,v1:127.0.0.1:6803/3611726545] exists,up 16e58abc-e2b0-4883-ba0a-c391c8cc9f6d 2026-02-17T05:32:32.255 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:32:32.255 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:32:32.255 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:32:32.255 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:784: TEST_divergent_3: wait_for_osd up 1 2026-02-17T05:32:32.255 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:32:32.255 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T05:32:32.255 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:32:32.255 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:32:32.255 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:32:32.255 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:32:32.256 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:32:32.256 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:32:32.256 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T05:32:32.475 INFO:tasks.workunit.client.0.trial030.stdout:osd.1 up in weight 1 up_from 50 up_thru 50 down_at 31 last_clean_interval [9,29) [v2:127.0.0.1:6818/2946396808,v1:127.0.0.1:6819/2946396808] [v2:127.0.0.1:6820/2946396808,v1:127.0.0.1:6821/2946396808] exists,up ba7ef7d8-8279-40c2-9fe4-6d18fe327556 2026-02-17T05:32:32.476 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:32:32.476 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:32:32.476 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:32:32.477 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:785: TEST_divergent_3: wait_for_osd up 2 2026-02-17T05:32:32.477 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:32:32.477 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T05:32:32.477 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:32:32.477 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:32:32.477 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:32:32.477 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:32:32.478 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:32:32.478 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:32:32.478 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T05:32:32.693 INFO:tasks.workunit.client.0.trial030.stdout:osd.2 up in weight 1 up_from 39 up_thru 0 down_at 32 last_clean_interval [14,29) [v2:127.0.0.1:6810/3922362673,v1:127.0.0.1:6811/3922362673] [v2:127.0.0.1:6812/3922362673,v1:127.0.0.1:6813/3922362673] exists,up d26fa46f-e265-43ba-83d2-985666052fe3 2026-02-17T05:32:32.693 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:32:32.693 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:32:32.693 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:32:32.693 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:787: TEST_divergent_3: ceph pg dump pgs 2026-02-17T05:32:32.898 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T05:32:32.898 INFO:tasks.workunit.client.0.trial030.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475386+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:32.898 INFO:tasks.workunit.client.0.trial030.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475735+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:32.898 INFO:tasks.workunit.client.0.trial030.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475384+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:32.898 INFO:tasks.workunit.client.0.trial030.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473236+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 user requested scrub scheduled @ 2026-02-17T05:32:51.809672+0000 0 0 2026-02-17T05:32:32.899 INFO:tasks.workunit.client.0.trial030.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473301+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 user requested scrub scheduled @ 2026-02-17T05:33:23.756220+0000 0 0 2026-02-17T05:32:32.899 INFO:tasks.workunit.client.0.trial030.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473278+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 user requested scrub scheduled @ 2026-02-17T05:33:25.749719+0000 0 0 2026-02-17T05:32:32.899 INFO:tasks.workunit.client.0.trial030.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473183+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 user requested scrub scheduled @ 2026-02-17T05:33:20.788033+0000 0 0 2026-02-17T05:32:32.899 INFO:tasks.workunit.client.0.trial030.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473574+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 user requested scrub scheduled @ 2026-02-17T05:33:17.854908+0000 0 0 2026-02-17T05:32:32.899 INFO:tasks.workunit.client.0.trial030.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473683+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 user requested scrub scheduled @ 2026-02-17T05:33:15.809432+0000 0 0 2026-02-17T05:32:32.899 INFO:tasks.workunit.client.0.trial030.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473242+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 user requested scrub scheduled @ 2026-02-17T05:32:54.797640+0000 0 0 2026-02-17T05:32:32.899 INFO:tasks.workunit.client.0.trial030.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473269+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 user requested scrub scheduled @ 2026-02-17T05:32:50.779352+0000 0 0 2026-02-17T05:32:32.899 INFO:tasks.workunit.client.0.trial030.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475754+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:32.899 INFO:tasks.workunit.client.0.trial030.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473125+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 user requested scrub scheduled @ 2026-02-17T05:33:04.774761+0000 0 0 2026-02-17T05:32:32.899 INFO:tasks.workunit.client.0.trial030.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473523+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 user requested scrub scheduled @ 2026-02-17T05:33:12.827040+0000 0 0 2026-02-17T05:32:32.899 INFO:tasks.workunit.client.0.trial030.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.472885+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 user requested scrub scheduled @ 2026-02-17T05:33:11.873439+0000 0 0 2026-02-17T05:32:32.900 INFO:tasks.workunit.client.0.trial030.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475660+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:32.900 INFO:tasks.workunit.client.0.trial030.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:57.710342+0000 29'100 48:152 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 user requested scrub scheduled @ 2026-02-17T05:32:49.800913+0000 0 0 2026-02-17T05:32:32.900 INFO:tasks.workunit.client.0.trial030.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473488+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 user requested scrub scheduled @ 2026-02-17T05:33:13.840986+0000 0 0 2026-02-17T05:32:32.900 INFO:tasks.workunit.client.0.trial030.stdout:1.e 3 0 3 0 0 2088 0 0 17 84 17 active+undersized+degraded 2026-02-17T05:31:47.473420+0000 45'101 48:152 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 user requested scrub scheduled @ 2026-02-17T05:33:09.873101+0000 0 0 2026-02-17T05:32:32.900 INFO:tasks.workunit.client.0.trial030.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473513+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 user requested scrub scheduled @ 2026-02-17T05:33:05.787772+0000 0 0 2026-02-17T05:32:32.900 INFO:tasks.workunit.client.0.trial030.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.474067+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:32.900 INFO:tasks.workunit.client.0.trial030.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.474512+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:32.900 INFO:tasks.workunit.client.0.trial030.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473926+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:32.900 INFO:tasks.workunit.client.0.trial030.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473600+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 user requested scrub scheduled @ 2026-02-17T05:33:18.835536+0000 0 0 2026-02-17T05:32:32.900 INFO:tasks.workunit.client.0.trial030.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475615+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:32.900 INFO:tasks.workunit.client.0.trial030.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475686+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:32.900 INFO:tasks.workunit.client.0.trial030.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475643+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:32.901 INFO:tasks.workunit.client.0.trial030.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475538+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:32.901 INFO:tasks.workunit.client.0.trial030.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473932+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 user requested scrub scheduled @ 2026-02-17T05:33:19.795379+0000 0 0 2026-02-17T05:32:32.901 INFO:tasks.workunit.client.0.trial030.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473622+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:32.901 INFO:tasks.workunit.client.0.trial030.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475784+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:32.901 INFO:tasks.workunit.client.0.trial030.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475304+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:32.901 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-17T05:32:32.901 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T05:32:32.901 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:32:32.908 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:788: TEST_divergent_3: echo 'wait for peering' 2026-02-17T05:32:32.908 INFO:tasks.workunit.client.0.trial030.stdout:wait for peering 2026-02-17T05:32:32.909 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:789: TEST_divergent_3: ceph pg dump pgs 2026-02-17T05:32:33.112 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T05:32:33.112 INFO:tasks.workunit.client.0.trial030.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475386+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:33.113 INFO:tasks.workunit.client.0.trial030.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475735+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:33.113 INFO:tasks.workunit.client.0.trial030.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475384+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:33.113 INFO:tasks.workunit.client.0.trial030.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473236+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 user requested scrub scheduled @ 2026-02-17T05:32:51.809672+0000 0 0 2026-02-17T05:32:33.113 INFO:tasks.workunit.client.0.trial030.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473301+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 user requested scrub scheduled @ 2026-02-17T05:33:23.756220+0000 0 0 2026-02-17T05:32:33.113 INFO:tasks.workunit.client.0.trial030.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473278+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 user requested scrub scheduled @ 2026-02-17T05:33:25.749719+0000 0 0 2026-02-17T05:32:33.113 INFO:tasks.workunit.client.0.trial030.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473183+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 user requested scrub scheduled @ 2026-02-17T05:33:20.788033+0000 0 0 2026-02-17T05:32:33.114 INFO:tasks.workunit.client.0.trial030.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473574+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 user requested scrub scheduled @ 2026-02-17T05:33:17.854908+0000 0 0 2026-02-17T05:32:33.114 INFO:tasks.workunit.client.0.trial030.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473683+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 user requested scrub scheduled @ 2026-02-17T05:33:15.809432+0000 0 0 2026-02-17T05:32:33.114 INFO:tasks.workunit.client.0.trial030.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473242+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 user requested scrub scheduled @ 2026-02-17T05:32:54.797640+0000 0 0 2026-02-17T05:32:33.114 INFO:tasks.workunit.client.0.trial030.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473269+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 user requested scrub scheduled @ 2026-02-17T05:32:50.779352+0000 0 0 2026-02-17T05:32:33.114 INFO:tasks.workunit.client.0.trial030.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475754+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:33.114 INFO:tasks.workunit.client.0.trial030.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473125+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 user requested scrub scheduled @ 2026-02-17T05:33:04.774761+0000 0 0 2026-02-17T05:32:33.114 INFO:tasks.workunit.client.0.trial030.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473523+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 user requested scrub scheduled @ 2026-02-17T05:33:12.827040+0000 0 0 2026-02-17T05:32:33.114 INFO:tasks.workunit.client.0.trial030.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.472885+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 user requested scrub scheduled @ 2026-02-17T05:33:11.873439+0000 0 0 2026-02-17T05:32:33.114 INFO:tasks.workunit.client.0.trial030.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475660+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:33.115 INFO:tasks.workunit.client.0.trial030.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:57.710342+0000 29'100 48:152 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 user requested scrub scheduled @ 2026-02-17T05:32:49.800913+0000 0 0 2026-02-17T05:32:33.115 INFO:tasks.workunit.client.0.trial030.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473488+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 user requested scrub scheduled @ 2026-02-17T05:33:13.840986+0000 0 0 2026-02-17T05:32:33.115 INFO:tasks.workunit.client.0.trial030.stdout:1.e 3 0 3 0 0 2088 0 0 17 84 17 active+undersized+degraded 2026-02-17T05:31:47.473420+0000 45'101 48:152 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 user requested scrub scheduled @ 2026-02-17T05:33:09.873101+0000 0 0 2026-02-17T05:32:33.115 INFO:tasks.workunit.client.0.trial030.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473513+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 user requested scrub scheduled @ 2026-02-17T05:33:05.787772+0000 0 0 2026-02-17T05:32:33.115 INFO:tasks.workunit.client.0.trial030.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.474067+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:33.115 INFO:tasks.workunit.client.0.trial030.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.474512+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:33.116 INFO:tasks.workunit.client.0.trial030.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473926+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:33.116 INFO:tasks.workunit.client.0.trial030.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473600+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 user requested scrub scheduled @ 2026-02-17T05:33:18.835536+0000 0 0 2026-02-17T05:32:33.116 INFO:tasks.workunit.client.0.trial030.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475615+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:33.116 INFO:tasks.workunit.client.0.trial030.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475686+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:33.116 INFO:tasks.workunit.client.0.trial030.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475643+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:33.116 INFO:tasks.workunit.client.0.trial030.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475538+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:33.116 INFO:tasks.workunit.client.0.trial030.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473932+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 user requested scrub scheduled @ 2026-02-17T05:33:19.795379+0000 0 0 2026-02-17T05:32:33.116 INFO:tasks.workunit.client.0.trial030.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.473622+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:33.116 INFO:tasks.workunit.client.0.trial030.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475784+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:33.116 INFO:tasks.workunit.client.0.trial030.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:31:47.475304+0000 29'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:33.116 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-17T05:32:33.117 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T05:32:33.117 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:32:33.122 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:790: TEST_divergent_3: rados -p test put foo /tmp/tmp.XGHM5brWzT 2026-02-17T05:32:33.145 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:791: TEST_divergent_3: rm -f /tmp/tmp.XGHM5brWzT 2026-02-17T05:32:33.145 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:792: TEST_divergent_3: rm -f /tmp/tmp.vcKO1qtdwa 2026-02-17T05:32:33.146 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:796: TEST_divergent_3: echo 'killing divergent 1' 2026-02-17T05:32:33.147 INFO:tasks.workunit.client.0.trial030.stdout:killing divergent 1 2026-02-17T05:32:33.147 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:797: TEST_divergent_3: ceph pg dump pgs 2026-02-17T05:32:33.355 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T05:32:33.355 INFO:tasks.workunit.client.0.trial030.stdout:1.1f 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T05:32:32.020600+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:33.355 INFO:tasks.workunit.client.0.trial030.stdout:1.1e 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T05:32:32.019661+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:33.355 INFO:tasks.workunit.client.0.trial030.stdout:1.1d 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T05:32:32.019115+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:33.356 INFO:tasks.workunit.client.0.trial030.stdout:1.b 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T05:32:32.025493+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:33.356 INFO:tasks.workunit.client.0.trial030.stdout:1.a 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T05:32:32.025355+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:33.356 INFO:tasks.workunit.client.0.trial030.stdout:1.9 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T05:32:32.020639+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:33.356 INFO:tasks.workunit.client.0.trial030.stdout:1.8 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T05:32:32.020497+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:33.356 INFO:tasks.workunit.client.0.trial030.stdout:1.7 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T05:32:32.025326+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:33.356 INFO:tasks.workunit.client.0.trial030.stdout:1.6 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T05:32:32.025442+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:33.356 INFO:tasks.workunit.client.0.trial030.stdout:1.5 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T05:32:32.025476+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:33.356 INFO:tasks.workunit.client.0.trial030.stdout:1.4 4 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T05:32:32.025404+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:33.356 INFO:tasks.workunit.client.0.trial030.stdout:1.3 4 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T05:32:32.025476+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:33.356 INFO:tasks.workunit.client.0.trial030.stdout:1.2 4 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T05:32:32.025315+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:33.357 INFO:tasks.workunit.client.0.trial030.stdout:1.c 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T05:32:32.025374+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:33.357 INFO:tasks.workunit.client.0.trial030.stdout:1.1 4 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T05:32:32.020696+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:33.357 INFO:tasks.workunit.client.0.trial030.stdout:1.1c 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T05:32:32.019520+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:33.357 INFO:tasks.workunit.client.0.trial030.stdout:1.0 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T05:32:32.020728+0000 29'106 51:133 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:33.357 INFO:tasks.workunit.client.0.trial030.stdout:1.d 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T05:32:32.025300+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:33.357 INFO:tasks.workunit.client.0.trial030.stdout:1.e 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T05:32:32.025487+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:33.357 INFO:tasks.workunit.client.0.trial030.stdout:1.f 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T05:32:32.025506+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:33.357 INFO:tasks.workunit.client.0.trial030.stdout:1.10 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T05:32:32.018380+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:33.357 INFO:tasks.workunit.client.0.trial030.stdout:1.11 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T05:32:32.018447+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:33.357 INFO:tasks.workunit.client.0.trial030.stdout:1.12 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T05:32:32.018769+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:33.357 INFO:tasks.workunit.client.0.trial030.stdout:1.13 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T05:32:32.019075+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:33.358 INFO:tasks.workunit.client.0.trial030.stdout:1.14 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T05:32:32.019095+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:33.358 INFO:tasks.workunit.client.0.trial030.stdout:1.15 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T05:32:32.019269+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:33.358 INFO:tasks.workunit.client.0.trial030.stdout:1.16 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T05:32:32.019546+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:33.358 INFO:tasks.workunit.client.0.trial030.stdout:1.17 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T05:32:32.020704+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:33.358 INFO:tasks.workunit.client.0.trial030.stdout:1.18 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T05:32:32.018140+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:33.358 INFO:tasks.workunit.client.0.trial030.stdout:1.19 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T05:32:32.018362+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:33.358 INFO:tasks.workunit.client.0.trial030.stdout:1.1a 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T05:32:32.018973+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:33.358 INFO:tasks.workunit.client.0.trial030.stdout:1.1b 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T05:32:32.018914+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:33.358 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-17T05:32:33.358 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T05:32:33.359 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:32:33.365 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:798: TEST_divergent_3: kill_daemons td/divergent-priors KILL osd.1 2026-02-17T05:32:33.367 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:32:33.367 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:32:33.367 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:32:33.367 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:32:33.367 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:32:33.474 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:32:33.474 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:801: TEST_divergent_3: expfile=td/divergent-priors/exp.19532.out 2026-02-17T05:32:33.474 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:802: TEST_divergent_3: _objectstore_tool_nodown td/divergent-priors 1 --op export-remove --pgid 1.0 --file td/divergent-priors/exp.19532.out 2026-02-17T05:32:33.474 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-17T05:32:33.474 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T05:32:33.474 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T05:32:33.475 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T05:32:33.475 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2026-02-17T05:32:33.475 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op export-remove --pgid 1.0 --file td/divergent-priors/exp.19532.out 2026-02-17T05:32:33.644 INFO:tasks.workunit.client.0.trial030.stderr:Exporting 1.0 info 1.0( v 29'100 (29'90,29'100] local-lis/les=50/51 n=3 ec=22/22 lis/c=50/50 les/c/f=51/51/0 sis=50) 2026-02-17T05:32:33.644 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:023dd3d2:::existing_12:head# 2026-02-17T05:32:33.644 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:04c40a0c:::existing_93:head# 2026-02-17T05:32:33.644 INFO:tasks.workunit.client.0.trial030.stderr:Read #1:064ff5fb:::existing_36:head# 2026-02-17T05:32:33.645 INFO:tasks.workunit.client.0.trial030.stderr:Export successful 2026-02-17T05:32:33.645 INFO:tasks.workunit.client.0.trial030.stdout: marking collection for removal 2026-02-17T05:32:33.645 INFO:tasks.workunit.client.0.trial030.stdout:setting '_remove' omap key 2026-02-17T05:32:33.645 INFO:tasks.workunit.client.0.trial030.stdout:finish_remove_pgs 1.0_head removing 1.0 2026-02-17T05:32:33.645 INFO:tasks.workunit.client.0.trial030.stderr:Remove successful 2026-02-17T05:32:33.740 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:803: TEST_divergent_3: _objectstore_tool_nodown td/divergent-priors 1 --op import --file td/divergent-priors/exp.19532.out 2026-02-17T05:32:33.740 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-17T05:32:33.740 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T05:32:33.741 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T05:32:33.741 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T05:32:33.741 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2026-02-17T05:32:33.741 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op import --file td/divergent-priors/exp.19532.out 2026-02-17T05:32:33.923 INFO:tasks.workunit.client.0.trial030.stdout:get_pg_num_history pg_num_history pg_num_history(e51 pg_nums {1={22=1,44=32}} deleted_pools ) 2026-02-17T05:32:33.923 INFO:tasks.workunit.client.0.trial030.stdout:Importing pgid 1.0 2026-02-17T05:32:33.923 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:023dd3d2:::existing_12:head# 2026-02-17T05:32:33.923 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:32:33.923 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:04c40a0c:::existing_93:head# 2026-02-17T05:32:33.923 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:32:33.923 INFO:tasks.workunit.client.0.trial030.stdout:Write #1:064ff5fb:::existing_36:head# 2026-02-17T05:32:33.923 INFO:tasks.workunit.client.0.trial030.stdout:snapset 0={} 2026-02-17T05:32:33.924 INFO:tasks.workunit.client.0.trial030.stdout:write_pg epoch 51 info 1.0( v 29'100 (29'90,29'100] local-lis/les=50/51 n=3 ec=22/22 lis/c=50/50 les/c/f=51/51/0 sis=50) 2026-02-17T05:32:33.924 INFO:tasks.workunit.client.0.trial030.stdout:Import successful 2026-02-17T05:32:34.020 INFO:tasks.workunit.client.0.trial030.stdout:reviving divergent 1 2026-02-17T05:32:34.020 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:805: TEST_divergent_3: echo 'reviving divergent 1' 2026-02-17T05:32:34.021 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:806: TEST_divergent_3: ceph pg dump pgs 2026-02-17T05:32:34.219 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T05:32:34.219 INFO:tasks.workunit.client.0.trial030.stdout:1.1f 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T05:32:32.020600+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:34.219 INFO:tasks.workunit.client.0.trial030.stdout:1.1e 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T05:32:32.019661+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:34.219 INFO:tasks.workunit.client.0.trial030.stdout:1.1d 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T05:32:32.019115+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:34.220 INFO:tasks.workunit.client.0.trial030.stdout:1.b 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T05:32:32.025493+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:34.220 INFO:tasks.workunit.client.0.trial030.stdout:1.a 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T05:32:32.025355+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:34.220 INFO:tasks.workunit.client.0.trial030.stdout:1.9 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T05:32:32.020639+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:34.220 INFO:tasks.workunit.client.0.trial030.stdout:1.8 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T05:32:32.020497+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:34.220 INFO:tasks.workunit.client.0.trial030.stdout:1.7 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T05:32:32.025326+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:34.220 INFO:tasks.workunit.client.0.trial030.stdout:1.6 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T05:32:32.025442+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:34.220 INFO:tasks.workunit.client.0.trial030.stdout:1.5 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T05:32:32.025476+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:34.220 INFO:tasks.workunit.client.0.trial030.stdout:1.4 4 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T05:32:32.025404+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:34.220 INFO:tasks.workunit.client.0.trial030.stdout:1.3 4 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T05:32:32.025476+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:34.220 INFO:tasks.workunit.client.0.trial030.stdout:1.2 4 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T05:32:32.025315+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:34.220 INFO:tasks.workunit.client.0.trial030.stdout:1.c 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T05:32:32.025374+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:34.220 INFO:tasks.workunit.client.0.trial030.stdout:1.1 4 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T05:32:32.020696+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:34.220 INFO:tasks.workunit.client.0.trial030.stdout:1.1c 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T05:32:32.019520+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:34.220 INFO:tasks.workunit.client.0.trial030.stdout:1.0 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T05:32:32.020728+0000 29'106 51:133 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:34.220 INFO:tasks.workunit.client.0.trial030.stdout:1.d 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T05:32:32.025300+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:34.220 INFO:tasks.workunit.client.0.trial030.stdout:1.e 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T05:32:32.025487+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:34.220 INFO:tasks.workunit.client.0.trial030.stdout:1.f 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T05:32:32.025506+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:34.220 INFO:tasks.workunit.client.0.trial030.stdout:1.10 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-17T05:32:32.018380+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:34.220 INFO:tasks.workunit.client.0.trial030.stdout:1.11 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T05:32:32.018447+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:34.220 INFO:tasks.workunit.client.0.trial030.stdout:1.12 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T05:32:32.018769+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:34.220 INFO:tasks.workunit.client.0.trial030.stdout:1.13 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T05:32:32.019075+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:34.220 INFO:tasks.workunit.client.0.trial030.stdout:1.14 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T05:32:32.019095+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:34.220 INFO:tasks.workunit.client.0.trial030.stdout:1.15 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T05:32:32.019269+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:34.220 INFO:tasks.workunit.client.0.trial030.stdout:1.16 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T05:32:32.019546+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:34.220 INFO:tasks.workunit.client.0.trial030.stdout:1.17 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T05:32:32.020704+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:34.220 INFO:tasks.workunit.client.0.trial030.stdout:1.18 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T05:32:32.018140+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:34.220 INFO:tasks.workunit.client.0.trial030.stdout:1.19 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T05:32:32.018362+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:34.220 INFO:tasks.workunit.client.0.trial030.stdout:1.1a 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T05:32:32.018973+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:34.220 INFO:tasks.workunit.client.0.trial030.stdout:1.1b 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-17T05:32:32.018914+0000 29'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:34.220 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-17T05:32:34.220 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T05:32:34.220 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:32:34.228 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:807: TEST_divergent_3: activate_osd td/divergent-priors 1 2026-02-17T05:32:34.228 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-17T05:32:34.228 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T05:32:34.228 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T05:32:34.228 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T05:32:34.228 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-17T05:32:34.228 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T05:32:34.229 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:32:34.229 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:32:34.229 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:32:34.229 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-17T05:32:34.229 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-17T05:32:34.229 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T05:32:34.229 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T05:32:34.229 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T05:32:34.229 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T05:32:34.229 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:32:34.229 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:32:34.229 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:32:34.229 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:32:34.229 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:32:34.229 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:32:34.230 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:32:34.230 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:32:34.230 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T05:32:34.230 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T05:32:34.230 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:32:34.230 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:32:34.230 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:32:34.230 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:32:34.231 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T05:32:34.231 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T05:32:34.231 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-17T05:32:34.231 INFO:tasks.workunit.client.0.trial030.stdout:start osd.1 2026-02-17T05:32:34.231 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T05:32:34.231 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T05:32:34.232 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-17T05:32:34.233 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T05:32:34.233 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T05:32:34.233 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T05:32:34.233 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T05:32:34.250 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:32:34.245+0000 7f41b7dd7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:32:34.252 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:32:34.249+0000 7f41b7dd7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:32:34.253 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:32:34.249+0000 7f41b7dd7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:32:34.455 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T05:32:34.455 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:32:34.455 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T05:32:34.455 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:32:34.455 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:32:34.455 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:32:34.455 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:32:34.455 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:32:34.455 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:32:34.455 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T05:32:34.613 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:32:34.609+0000 7f41b7dd7a40 -1 Falling back to public interface 2026-02-17T05:32:34.678 INFO:tasks.workunit.client.0.trial030.stdout:osd.1 up in weight 1 up_from 50 up_thru 50 down_at 31 last_clean_interval [9,29) [v2:127.0.0.1:6818/2946396808,v1:127.0.0.1:6819/2946396808] [v2:127.0.0.1:6820/2946396808,v1:127.0.0.1:6821/2946396808] exists,up ba7ef7d8-8279-40c2-9fe4-6d18fe327556 2026-02-17T05:32:34.679 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:32:34.680 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:32:34.680 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:32:34.680 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:808: TEST_divergent_3: wait_for_osd up 1 2026-02-17T05:32:34.680 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:32:34.680 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T05:32:34.680 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:32:34.680 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:32:34.680 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:32:34.681 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:32:34.681 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:32:34.681 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:32:34.681 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T05:32:34.893 INFO:tasks.workunit.client.0.trial030.stdout:osd.1 up in weight 1 up_from 50 up_thru 50 down_at 31 last_clean_interval [9,29) [v2:127.0.0.1:6818/2946396808,v1:127.0.0.1:6819/2946396808] [v2:127.0.0.1:6820/2946396808,v1:127.0.0.1:6821/2946396808] exists,up ba7ef7d8-8279-40c2-9fe4-6d18fe327556 2026-02-17T05:32:34.893 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:32:34.893 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:32:34.893 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:32:34.893 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:810: TEST_divergent_3: sleep 20 2026-02-17T05:32:35.327 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:32:35.321+0000 7f41b7dd7a40 -1 osd.1 51 log_to_monitors true 2026-02-17T05:32:54.896 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:811: TEST_divergent_3: get_asok_path osd.1 2026-02-17T05:32:54.896 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-17T05:32:54.896 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-17T05:32:54.897 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T05:32:54.897 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:32:54.897 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:32:54.897 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19532/ceph-osd.1.asok 2026-02-17T05:32:54.898 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:811: TEST_divergent_3: CEPH_ARGS= 2026-02-17T05:32:54.898 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:811: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.19532/ceph-osd.1.asok dump_ops_in_flight 2026-02-17T05:32:54.960 INFO:tasks.workunit.client.0.trial030.stdout:{ 2026-02-17T05:32:54.960 INFO:tasks.workunit.client.0.trial030.stdout: "ops": [], 2026-02-17T05:32:54.960 INFO:tasks.workunit.client.0.trial030.stdout: "num_ops": 0 2026-02-17T05:32:54.960 INFO:tasks.workunit.client.0.trial030.stdout:} 2026-02-17T05:32:54.965 INFO:tasks.workunit.client.0.trial030.stdout:allowing recovery 2026-02-17T05:32:54.966 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:813: TEST_divergent_3: echo 'allowing recovery' 2026-02-17T05:32:54.966 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:814: TEST_divergent_3: ceph pg dump pgs 2026-02-17T05:32:55.183 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T05:32:55.184 INFO:tasks.workunit.client.0.trial030.stdout:1.1f 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T05:32:45.476003+0000 29'100 61:166 [1,2,0] 1 [1,2,0] 1 29'100 2026-02-17T05:32:42.773273+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:55.184 INFO:tasks.workunit.client.0.trial030.stdout:1.1e 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T05:32:43.476420+0000 29'100 62:173 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:55.184 INFO:tasks.workunit.client.0.trial030.stdout:1.1d 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T05:32:41.476183+0000 29'100 61:145 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:55.184 INFO:tasks.workunit.client.0.trial030.stdout:1.b 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-17T05:32:45.475650+0000 29'100 61:168 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:55.184 INFO:tasks.workunit.client.0.trial030.stdout:1.a 3 0 0 0 0 1536 0 0 16 84 16 active+clean 2026-02-17T05:32:51.045135+0000 29'100 62:181 [0,1,2] 0 [0,1,2] 0 29'100 2026-02-17T05:32:51.045097+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 periodic scrub scheduled @ 2026-02-18T17:28:24.335741+0000 3 0 2026-02-17T05:32:55.184 INFO:tasks.workunit.client.0.trial030.stdout:1.9 5 0 0 0 0 2560 0 0 16 84 16 active+clean 2026-02-17T05:32:46.736930+0000 29'100 61:153 [2,0,1] 2 [2,0,1] 2 29'100 2026-02-17T05:32:46.736886+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 periodic scrub scheduled @ 2026-02-18T11:10:55.251774+0000 5 0 2026-02-17T05:32:55.184 INFO:tasks.workunit.client.0.trial030.stdout:1.8 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-17T05:32:44.268905+0000 29'100 61:179 [1,0,2] 1 [1,0,2] 1 29'100 2026-02-17T05:32:44.268859+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 periodic scrub scheduled @ 2026-02-18T08:46:53.395842+0000 3 0 2026-02-17T05:32:55.184 INFO:tasks.workunit.client.0.trial030.stdout:1.7 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T05:32:45.476144+0000 29'100 61:166 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:55.184 INFO:tasks.workunit.client.0.trial030.stdout:1.6 4 0 0 0 0 2112 0 0 17 84 17 active+clean 2026-02-17T05:32:43.476667+0000 51'101 62:164 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:55.185 INFO:tasks.workunit.client.0.trial030.stdout:1.5 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T05:32:41.477352+0000 29'100 61:145 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:55.185 INFO:tasks.workunit.client.0.trial030.stdout:1.4 4 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T05:32:35.694165+0000 29'100 61:170 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:55.185 INFO:tasks.workunit.client.0.trial030.stdout:1.3 4 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-17T05:32:45.475458+0000 29'100 61:168 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:55.185 INFO:tasks.workunit.client.0.trial030.stdout:1.2 1 0 0 0 0 512 0 0 16 84 16 active+clean 2026-02-17T05:32:52.019890+0000 29'100 62:181 [0,1,2] 0 [0,1,2] 0 29'100 2026-02-17T05:32:52.019855+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 periodic scrub scheduled @ 2026-02-18T11:08:57.562909+0000 1 0 2026-02-17T05:32:55.185 INFO:tasks.workunit.client.0.trial030.stdout:1.c 3 0 0 0 0 1536 0 0 14 86 14 active+clean 2026-02-17T05:32:50.284157+0000 29'100 61:179 [1,0,2] 1 [1,0,2] 1 29'100 2026-02-17T05:32:50.284119+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 periodic scrub scheduled @ 2026-02-18T08:03:45.740055+0000 3 0 2026-02-17T05:32:55.185 INFO:tasks.workunit.client.0.trial030.stdout:1.1 4 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T05:32:41.476831+0000 29'100 61:145 [2,0,1] 2 [2,0,1] 2 29'100 2026-02-17T05:32:38.354846+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:55.185 INFO:tasks.workunit.client.0.trial030.stdout:1.1c 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T05:32:35.696434+0000 29'100 61:170 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:55.185 INFO:tasks.workunit.client.0.trial030.stdout:1.0 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-17T05:32:42.259251+0000 29'100 61:178 [1,0,2] 1 [1,0,2] 1 29'100 2026-02-17T05:32:42.259205+0000 0'0 2026-02-17T05:30:55.108504+0000 0 1 periodic scrub scheduled @ 2026-02-18T14:04:00.388817+0000 3 0 2026-02-17T05:32:55.185 INFO:tasks.workunit.client.0.trial030.stdout:1.d 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T05:32:41.476588+0000 29'100 61:145 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:55.185 INFO:tasks.workunit.client.0.trial030.stdout:1.e 3 0 0 0 0 2088 0 0 17 84 17 active+clean 2026-02-17T05:32:43.475902+0000 45'101 62:174 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:55.185 INFO:tasks.workunit.client.0.trial030.stdout:1.f 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T05:32:45.475779+0000 29'100 61:166 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:55.186 INFO:tasks.workunit.client.0.trial030.stdout:1.10 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-17T05:32:45.263827+0000 29'100 61:179 [1,0,2] 1 [1,0,2] 1 29'100 2026-02-17T05:32:45.263788+0000 0'0 2026-02-17T05:30:55.108504+0000 0 1 periodic scrub scheduled @ 2026-02-18T14:29:10.387760+0000 3 0 2026-02-17T05:32:55.186 INFO:tasks.workunit.client.0.trial030.stdout:1.11 3 0 0 0 0 1536 0 0 16 84 16 active+clean 2026-02-17T05:32:45.742793+0000 29'100 61:153 [2,0,1] 2 [2,0,1] 2 29'100 2026-02-17T05:32:45.742748+0000 0'0 2026-02-17T05:30:55.108504+0000 0 1 periodic scrub scheduled @ 2026-02-18T16:50:01.690350+0000 3 0 2026-02-17T05:32:55.186 INFO:tasks.workunit.client.0.trial030.stdout:1.12 1 0 0 0 0 512 0 0 16 84 16 active+clean 2026-02-17T05:32:49.045914+0000 29'100 62:181 [0,1,2] 0 [0,1,2] 0 29'100 2026-02-17T05:32:49.045875+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 periodic scrub scheduled @ 2026-02-18T12:50:24.248338+0000 1 0 2026-02-17T05:32:55.186 INFO:tasks.workunit.client.0.trial030.stdout:1.13 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-17T05:32:45.475272+0000 29'100 61:168 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:55.186 INFO:tasks.workunit.client.0.trial030.stdout:1.14 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-17T05:32:35.693184+0000 29'100 61:171 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:55.186 INFO:tasks.workunit.client.0.trial030.stdout:1.15 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T05:32:41.476893+0000 29'100 61:145 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:55.186 INFO:tasks.workunit.client.0.trial030.stdout:1.16 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T05:32:43.476180+0000 29'100 62:173 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:55.186 INFO:tasks.workunit.client.0.trial030.stdout:1.17 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T05:32:45.475833+0000 29'100 61:166 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:55.186 INFO:tasks.workunit.client.0.trial030.stdout:1.18 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-17T05:32:40.267340+0000 29'100 61:179 [1,0,2] 1 [1,0,2] 1 29'100 2026-02-17T05:32:40.267294+0000 0'0 2026-02-17T05:30:55.108504+0000 0 1 periodic scrub scheduled @ 2026-02-18T10:25:46.195009+0000 3 0 2026-02-17T05:32:55.186 INFO:tasks.workunit.client.0.trial030.stdout:1.19 2 0 0 0 0 1024 0 0 16 84 16 active+clean 2026-02-17T05:32:44.792164+0000 29'100 61:153 [2,0,1] 2 [2,0,1] 2 29'100 2026-02-17T05:32:44.792119+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 periodic scrub scheduled @ 2026-02-18T08:56:05.778612+0000 2 0 2026-02-17T05:32:55.186 INFO:tasks.workunit.client.0.trial030.stdout:1.1a 4 0 0 0 0 2048 0 0 16 84 16 active+clean 2026-02-17T05:32:48.004356+0000 29'100 62:181 [0,1,2] 0 [0,1,2] 0 29'100 2026-02-17T05:32:48.004318+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 periodic scrub scheduled @ 2026-02-18T12:36:09.939189+0000 4 0 2026-02-17T05:32:55.186 INFO:tasks.workunit.client.0.trial030.stdout:1.1b 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-17T05:32:45.475830+0000 29'100 61:169 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:55.186 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-17T05:32:55.187 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T05:32:55.187 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:32:55.194 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:816: TEST_divergent_3: for i in $osds 2026-02-17T05:32:55.194 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:818: TEST_divergent_3: ceph tell osd.0 debug kick_recovery_wq 0 2026-02-17T05:32:55.268 INFO:tasks.workunit.client.0.trial030.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-17T05:32:55.276 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:816: TEST_divergent_3: for i in $osds 2026-02-17T05:32:55.276 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:818: TEST_divergent_3: ceph tell osd.1 debug kick_recovery_wq 0 2026-02-17T05:32:55.356 INFO:tasks.workunit.client.0.trial030.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-17T05:32:55.364 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:816: TEST_divergent_3: for i in $osds 2026-02-17T05:32:55.364 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:818: TEST_divergent_3: ceph tell osd.2 debug kick_recovery_wq 0 2026-02-17T05:32:55.435 INFO:tasks.workunit.client.0.trial030.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-17T05:32:55.443 INFO:tasks.workunit.client.0.trial030.stdout:reading divergent objects 2026-02-17T05:32:55.443 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:821: TEST_divergent_3: echo 'reading divergent objects' 2026-02-17T05:32:55.444 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:822: TEST_divergent_3: ceph pg dump pgs 2026-02-17T05:32:55.659 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T05:32:55.660 INFO:tasks.workunit.client.0.trial030.stdout:1.1f 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T05:32:45.476003+0000 29'100 64:175 [1,2,0] 1 [1,2,0] 1 29'100 2026-02-17T05:32:42.773273+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:55.660 INFO:tasks.workunit.client.0.trial030.stdout:1.1e 3 0 0 0 0 1600 0 0 10 90 10 peering 2026-02-17T05:32:55.376600+0000 29'100 64:163 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:55.660 INFO:tasks.workunit.client.0.trial030.stdout:1.1d 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T05:32:41.476183+0000 29'100 63:151 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:55.660 INFO:tasks.workunit.client.0.trial030.stdout:1.b 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-17T05:32:54.227542+0000 29'100 64:185 [1,2,0] 1 [1,2,0] 1 29'100 2026-02-17T05:32:54.227493+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 periodic scrub scheduled @ 2026-02-18T13:05:23.576968+0000 3 0 2026-02-17T05:32:55.660 INFO:tasks.workunit.client.0.trial030.stdout:1.a 3 0 0 0 0 1536 0 0 16 84 16 active+clean 2026-02-17T05:32:51.045135+0000 29'100 62:181 [0,1,2] 0 [0,1,2] 0 29'100 2026-02-17T05:32:51.045097+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 periodic scrub scheduled @ 2026-02-18T17:28:24.335741+0000 3 0 2026-02-17T05:32:55.660 INFO:tasks.workunit.client.0.trial030.stdout:1.9 5 0 0 0 0 2560 0 0 16 84 16 active+clean 2026-02-17T05:32:46.736930+0000 29'100 63:159 [2,0,1] 2 [2,0,1] 2 29'100 2026-02-17T05:32:46.736886+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 periodic scrub scheduled @ 2026-02-18T17:04:36.194778+0000 5 0 2026-02-17T05:32:55.660 INFO:tasks.workunit.client.0.trial030.stdout:1.8 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-17T05:32:44.268905+0000 29'100 64:188 [1,0,2] 1 [1,0,2] 1 29'100 2026-02-17T05:32:44.268859+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 periodic scrub scheduled @ 2026-02-18T07:20:12.929901+0000 3 0 2026-02-17T05:32:55.660 INFO:tasks.workunit.client.0.trial030.stdout:1.7 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T05:32:45.476144+0000 29'100 64:175 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:55.660 INFO:tasks.workunit.client.0.trial030.stdout:1.6 4 0 0 0 0 2112 0 0 17 84 17 active+clean 2026-02-17T05:32:43.476667+0000 51'101 62:164 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:55.660 INFO:tasks.workunit.client.0.trial030.stdout:1.5 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T05:32:41.477352+0000 29'100 63:151 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:55.661 INFO:tasks.workunit.client.0.trial030.stdout:1.4 4 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T05:32:35.694165+0000 29'100 64:179 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:55.661 INFO:tasks.workunit.client.0.trial030.stdout:1.3 4 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-17T05:32:45.475458+0000 29'100 64:177 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:55.661 INFO:tasks.workunit.client.0.trial030.stdout:1.2 1 0 0 0 0 512 0 0 16 84 16 active+clean 2026-02-17T05:32:52.019890+0000 29'100 62:181 [0,1,2] 0 [0,1,2] 0 29'100 2026-02-17T05:32:52.019855+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 periodic scrub scheduled @ 2026-02-18T11:08:57.562909+0000 1 0 2026-02-17T05:32:55.661 INFO:tasks.workunit.client.0.trial030.stdout:1.c 3 0 0 0 0 1536 0 0 14 86 14 active+clean 2026-02-17T05:32:50.284157+0000 29'100 64:188 [1,0,2] 1 [1,0,2] 1 29'100 2026-02-17T05:32:50.284119+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 periodic scrub scheduled @ 2026-02-18T06:52:51.575037+0000 3 0 2026-02-17T05:32:55.661 INFO:tasks.workunit.client.0.trial030.stdout:1.1 4 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T05:32:41.476831+0000 29'100 63:151 [2,0,1] 2 [2,0,1] 2 29'100 2026-02-17T05:32:38.354846+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:55.661 INFO:tasks.workunit.client.0.trial030.stdout:1.1c 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T05:32:35.696434+0000 29'100 64:179 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:55.661 INFO:tasks.workunit.client.0.trial030.stdout:1.0 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-17T05:32:42.259251+0000 29'100 64:187 [1,0,2] 1 [1,0,2] 1 29'100 2026-02-17T05:32:42.259205+0000 0'0 2026-02-17T05:30:55.108504+0000 0 1 periodic scrub scheduled @ 2026-02-18T09:40:51.658516+0000 3 0 2026-02-17T05:32:55.661 INFO:tasks.workunit.client.0.trial030.stdout:1.d 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T05:32:41.476588+0000 29'100 63:151 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:55.661 INFO:tasks.workunit.client.0.trial030.stdout:1.e 3 0 0 0 0 2088 0 0 14 87 14 peering 2026-02-17T05:32:55.375731+0000 45'101 64:164 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:32:55.661 INFO:tasks.workunit.client.0.trial030.stdout:1.f 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T05:32:45.475779+0000 29'100 64:175 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:55.661 INFO:tasks.workunit.client.0.trial030.stdout:1.10 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-17T05:32:45.263827+0000 29'100 64:188 [1,0,2] 1 [1,0,2] 1 29'100 2026-02-17T05:32:45.263788+0000 0'0 2026-02-17T05:30:55.108504+0000 0 1 periodic scrub scheduled @ 2026-02-18T15:20:52.045551+0000 3 0 2026-02-17T05:32:55.662 INFO:tasks.workunit.client.0.trial030.stdout:1.11 3 0 0 0 0 1536 0 0 16 84 16 active+clean 2026-02-17T05:32:45.742793+0000 29'100 63:159 [2,0,1] 2 [2,0,1] 2 29'100 2026-02-17T05:32:45.742748+0000 0'0 2026-02-17T05:30:55.108504+0000 0 1 periodic scrub scheduled @ 2026-02-18T12:31:46.235525+0000 3 0 2026-02-17T05:32:55.662 INFO:tasks.workunit.client.0.trial030.stdout:1.12 1 0 0 0 0 512 0 0 16 84 16 active+clean 2026-02-17T05:32:49.045914+0000 29'100 62:181 [0,1,2] 0 [0,1,2] 0 29'100 2026-02-17T05:32:49.045875+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 periodic scrub scheduled @ 2026-02-18T12:50:24.248338+0000 1 0 2026-02-17T05:32:55.662 INFO:tasks.workunit.client.0.trial030.stdout:1.13 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-17T05:32:55.185816+0000 29'100 64:185 [1,2,0] 1 [1,2,0] 1 29'100 2026-02-17T05:32:55.185772+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 periodic scrub scheduled @ 2026-02-18T14:03:22.321071+0000 3 0 2026-02-17T05:32:55.662 INFO:tasks.workunit.client.0.trial030.stdout:1.14 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-17T05:32:35.693184+0000 29'100 64:180 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:55.662 INFO:tasks.workunit.client.0.trial030.stdout:1.15 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T05:32:41.476893+0000 29'100 63:151 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:55.662 INFO:tasks.workunit.client.0.trial030.stdout:1.16 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T05:32:43.476180+0000 29'100 62:173 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:55.662 INFO:tasks.workunit.client.0.trial030.stdout:1.17 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T05:32:45.475833+0000 29'100 64:175 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:55.662 INFO:tasks.workunit.client.0.trial030.stdout:1.18 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-17T05:32:40.267340+0000 29'100 64:188 [1,0,2] 1 [1,0,2] 1 29'100 2026-02-17T05:32:40.267294+0000 0'0 2026-02-17T05:30:55.108504+0000 0 1 periodic scrub scheduled @ 2026-02-18T05:45:18.620997+0000 3 0 2026-02-17T05:32:55.662 INFO:tasks.workunit.client.0.trial030.stdout:1.19 2 0 0 0 0 1024 0 0 16 84 16 active+clean 2026-02-17T05:32:44.792164+0000 29'100 63:159 [2,0,1] 2 [2,0,1] 2 29'100 2026-02-17T05:32:44.792119+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 periodic scrub scheduled @ 2026-02-18T06:40:22.187012+0000 2 0 2026-02-17T05:32:55.662 INFO:tasks.workunit.client.0.trial030.stdout:1.1a 4 0 0 0 0 2048 0 0 16 84 16 active+clean 2026-02-17T05:32:48.004356+0000 29'100 62:181 [0,1,2] 0 [0,1,2] 0 29'100 2026-02-17T05:32:48.004318+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 periodic scrub scheduled @ 2026-02-18T12:36:09.939189+0000 4 0 2026-02-17T05:32:55.662 INFO:tasks.workunit.client.0.trial030.stdout:1.1b 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-17T05:32:45.475830+0000 29'100 64:178 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T05:30:55.108504+0000 0'0 2026-02-17T05:30:55.108504+0000 0 0 queued for scrub 0 0 2026-02-17T05:32:55.662 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-17T05:32:55.663 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T05:32:55.663 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:32:55.669 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: expr 2 + 2 2026-02-17T05:32:55.670 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: seq 1 4 2026-02-17T05:32:55.671 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T05:32:55.671 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:825: TEST_divergent_3: rados -p test get existing_1 td/divergent-priors/existing 2026-02-17T05:32:55.692 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T05:32:55.692 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:825: TEST_divergent_3: rados -p test get existing_2 td/divergent-priors/existing 2026-02-17T05:32:55.720 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T05:32:55.720 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:825: TEST_divergent_3: rados -p test get existing_3 td/divergent-priors/existing 2026-02-17T05:32:55.746 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T05:32:55.747 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:825: TEST_divergent_3: rados -p test get existing_4 td/divergent-priors/existing 2026-02-17T05:32:55.775 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:827: TEST_divergent_3: seq 1 2 2026-02-17T05:32:55.776 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:827: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-17T05:32:55.777 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:829: TEST_divergent_3: rados -p test get newobject_1 td/divergent-priors/existing 2026-02-17T05:32:55.797 INFO:tasks.workunit.client.0.trial030.stderr:error getting test/newobject_1: (2) No such file or directory 2026-02-17T05:32:55.799 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:827: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-17T05:32:55.799 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:829: TEST_divergent_3: rados -p test get newobject_2 td/divergent-priors/existing 2026-02-17T05:32:55.818 INFO:tasks.workunit.client.0.trial030.stderr:error getting test/newobject_2: (2) No such file or directory 2026-02-17T05:32:55.819 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:831: TEST_divergent_3: rm -f td/divergent-priors/existing 2026-02-17T05:32:55.820 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:833: TEST_divergent_3: find td/divergent-priors -name '*osd*log' 2026-02-17T05:32:55.821 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:833: TEST_divergent_3: grep _merge_object_divergent_entries td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-17T05:32:55.825 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:32:32.717+0000 7fafb7710640 20 _merge_object_divergent_entries: merging hoid 1:97db2a0f:::existing_2:head entries: 29'104 (29'2) modify 1:97db2a0f:::existing_2:head by client.4544.0:1 2026-02-17T05:31:09.770358+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-17T05:32:55.825 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:32:32.717+0000 7fafb7710640 20 _merge_object_divergent_entries: keeping 29'104 (29'2) modify 1:97db2a0f:::existing_2:head by client.4544.0:1 2026-02-17T05:31:09.770358+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-17T05:32:55.825 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:32:32.717+0000 7fafb7710640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-17T05:32:55.826 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:32:32.717+0000 7fafb7710640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head prior_version: 29'2 first_divergent_update: 29'104 last_divergent_update: 29'104 2026-02-17T05:32:55.826 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:32:32.717+0000 7fafb7710640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head has no more recent entries in log 2026-02-17T05:32:55.826 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:32:32.717+0000 7fafb7710640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head must be rolled back or recovered, attempting to rollback 2026-02-17T05:32:55.826 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:32:32.717+0000 7fafb7710640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head olog_can_rollback_to: 29'106 2026-02-17T05:32:55.826 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:32:32.717+0000 7fafb7710640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head cannot rollback 29'104 (29'2) modify 1:97db2a0f:::existing_2:head by client.4544.0:1 2026-02-17T05:31:09.770358+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-17T05:32:55.826 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:32:32.717+0000 7fafb7710640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head cannot roll back, removing and adding to missing 2026-02-17T05:32:55.826 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:32:32.717+0000 7fafb7710640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head prior_version 29'2 <= info.log_tail 29'89 2026-02-17T05:32:55.826 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:32:32.721+0000 7fafb2706640 20 _merge_object_divergent_entries: merging hoid 1:d858c035:::existing_1:head entries: 29'103 (29'1) modify 1:d858c035:::existing_1:head by client.4541.0:1 2026-02-17T05:31:09.768506+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-17T05:32:55.826 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:32:32.721+0000 7fafb2706640 20 _merge_object_divergent_entries: keeping 29'103 (29'1) modify 1:d858c035:::existing_1:head by client.4541.0:1 2026-02-17T05:31:09.768506+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-17T05:32:55.826 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:32:32.721+0000 7fafb2706640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-17T05:32:55.826 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:32:32.721+0000 7fafb2706640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head prior_version: 29'1 first_divergent_update: 29'103 last_divergent_update: 29'103 2026-02-17T05:32:55.827 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:32:32.721+0000 7fafb2706640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head has no more recent entries in log 2026-02-17T05:32:55.827 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:32:32.721+0000 7fafb2706640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head must be rolled back or recovered, attempting to rollback 2026-02-17T05:32:55.827 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:32:32.721+0000 7fafb2706640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head olog_can_rollback_to: 29'106 2026-02-17T05:32:55.827 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:32:32.721+0000 7fafb2706640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head cannot rollback 29'103 (29'1) modify 1:d858c035:::existing_1:head by client.4541.0:1 2026-02-17T05:31:09.768506+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-17T05:32:55.827 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:32:32.721+0000 7fafb2706640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head cannot roll back, removing and adding to missing 2026-02-17T05:32:55.827 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:32:32.721+0000 7fafb2706640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head prior_version 29'1 <= info.log_tail 29'90 2026-02-17T05:32:55.827 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:32:32.721+0000 7fafb2706640 20 _merge_object_divergent_entries: merging hoid 1:da59f6e7:::newobject_1:head entries: 29'102 (0'0) modify 1:da59f6e7:::newobject_1:head by client.4539.0:1 2026-02-17T05:31:09.767788+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-17T05:32:55.827 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:32:32.721+0000 7fafb2706640 20 _merge_object_divergent_entries: keeping 29'102 (0'0) modify 1:da59f6e7:::newobject_1:head by client.4539.0:1 2026-02-17T05:31:09.767788+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-17T05:32:55.827 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:32:32.721+0000 7fafb2706640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-17T05:32:55.827 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:32:32.721+0000 7fafb2706640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head prior_version: 0'0 first_divergent_update: 29'102 last_divergent_update: 29'102 2026-02-17T05:32:55.827 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:32:32.721+0000 7fafb2706640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head has no more recent entries in log 2026-02-17T05:32:55.828 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:32:32.721+0000 7fafb2706640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head prior_version or op type indicates creation, deleting 2026-02-17T05:32:55.828 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:32:32.729+0000 7fafb7710640 20 _merge_object_divergent_entries: merging hoid 1:8881e6d8:::existing_3:head entries: 29'105 (29'3) delete 1:8881e6d8:::existing_3:head by client.4546.0:1 2026-02-17T05:31:09.772263+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-17T05:32:55.828 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:32:32.729+0000 7fafb7710640 20 _merge_object_divergent_entries: keeping 29'105 (29'3) delete 1:8881e6d8:::existing_3:head by client.4546.0:1 2026-02-17T05:31:09.772263+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-17T05:32:55.828 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:32:32.729+0000 7fafb7710640 10 _merge_object_divergent_entries: hoid object_not_in_store: 1 2026-02-17T05:32:55.828 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:32:32.729+0000 7fafb7710640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head prior_version: 29'3 first_divergent_update: 29'105 last_divergent_update: 29'105 2026-02-17T05:32:55.828 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:32:32.729+0000 7fafb7710640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head has no more recent entries in log 2026-02-17T05:32:55.828 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:32:32.729+0000 7fafb7710640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head must be rolled back or recovered, attempting to rollback 2026-02-17T05:32:55.828 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:32:32.729+0000 7fafb7710640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head olog_can_rollback_to: 29'106 2026-02-17T05:32:55.828 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:32:32.729+0000 7fafb7710640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head cannot rollback 29'105 (29'3) delete 1:8881e6d8:::existing_3:head by client.4546.0:1 2026-02-17T05:31:09.772263+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-17T05:32:55.833 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:32:32.729+0000 7fafb7710640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head cannot roll back, removing and adding to missing 2026-02-17T05:32:55.833 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:32:32.729+0000 7fafb7710640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head prior_version 29'3 <= info.log_tail 29'84 2026-02-17T05:32:55.833 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:32:32.729+0000 7fafb4f0b640 20 _merge_object_divergent_entries: merging hoid 1:70b3bf12:::existing_4:head entries: 29'106 (29'4) delete 1:70b3bf12:::existing_4:head by client.4549.0:1 2026-02-17T05:31:09.775539+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-17T05:32:55.833 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:32:32.729+0000 7fafb4f0b640 20 _merge_object_divergent_entries: keeping 29'106 (29'4) delete 1:70b3bf12:::existing_4:head by client.4549.0:1 2026-02-17T05:31:09.775539+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-17T05:32:55.833 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:32:32.729+0000 7fafb4f0b640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-17T05:32:55.833 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:32:32.729+0000 7fafb4f0b640 10 _merge_object_divergent_entries: hoid 1:70b3bf12:::existing_4:head prior_version: 29'4 first_divergent_update: 29'106 last_divergent_update: 29'106 2026-02-17T05:32:55.833 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:32:32.729+0000 7fafb4f0b640 10 _merge_object_divergent_entries: more recent entry found: 45'101 (29'4) modify 1:70b3bf12:::existing_4:head by client.4658.0:1 2026-02-17T05:31:55.528868+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false, already merged 2026-02-17T05:32:55.833 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:32:32.729+0000 7fafb4f0b640 20 _merge_object_divergent_entries: merging hoid 1:75ac5091:::newobject_2:head entries: 29'101 (0'0) modify 1:75ac5091:::newobject_2:head by client.4537.0:1 2026-02-17T05:31:09.767350+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-17T05:32:55.834 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:32:32.729+0000 7fafb4f0b640 20 _merge_object_divergent_entries: keeping 29'101 (0'0) modify 1:75ac5091:::newobject_2:head by client.4537.0:1 2026-02-17T05:31:09.767350+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-17T05:32:55.834 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:32:32.729+0000 7fafb4f0b640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-17T05:32:55.834 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:32:32.729+0000 7fafb4f0b640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head prior_version: 0'0 first_divergent_update: 29'101 last_divergent_update: 29'101 2026-02-17T05:32:55.834 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:32:32.729+0000 7fafb4f0b640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head has no more recent entries in log 2026-02-17T05:32:55.834 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:32:32.729+0000 7fafb4f0b640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head prior_version or op type indicates creation, deleting 2026-02-17T05:32:55.834 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:835: TEST_divergent_3: find td/divergent-priors -name '*osd*log' 2026-02-17T05:32:55.835 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:835: TEST_divergent_3: grep -q '_merge_object_divergent_entries: more recent entry found:' td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-17T05:32:55.838 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:841: TEST_divergent_3: find td/divergent-priors -name '*osd*log' 2026-02-17T05:32:55.839 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:841: TEST_divergent_3: grep -q '_merge_object_divergent_entries.*prior_version or op type indicates creation' td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-17T05:32:55.842 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:846: TEST_divergent_3: echo success 2026-02-17T05:32:55.842 INFO:tasks.workunit.client.0.trial030.stdout:success 2026-02-17T05:32:55.843 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:848: TEST_divergent_3: rm td/divergent-priors/td/divergent-priors/exp.19532.out 2026-02-17T05:32:55.843 INFO:tasks.workunit.client.0.trial030.stderr:rm: cannot remove 'td/divergent-priors/td/divergent-priors/exp.19532.out': No such file or directory 2026-02-17T05:32:55.843 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:849: TEST_divergent_3: delete_pool test 2026-02-17T05:32:55.843 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test 2026-02-17T05:32:55.844 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2026-02-17T05:32:56.101 INFO:tasks.workunit.client.0.trial030.stderr:pool 'test' does not exist 2026-02-17T05:32:56.111 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:850: TEST_divergent_3: kill_daemons td/divergent-priors 2026-02-17T05:32:56.111 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:32:56.112 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:32:56.112 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:32:56.113 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:32:56.113 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:33:01.428 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:33:01.428 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:47: run: teardown td/divergent-priors 2026-02-17T05:33:01.428 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-17T05:33:01.428 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T05:33:01.428 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-17T05:33:01.429 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:33:01.429 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:33:01.429 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:33:01.430 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:33:01.430 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:33:01.436 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:33:01.436 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T05:33:01.437 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T05:33:01.438 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T05:33:01.439 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T05:33:01.439 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T05:33:01.439 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T05:33:01.440 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:33:01.440 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T05:33:01.441 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T05:33:01.441 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:33:01.442 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T05:33:01.443 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T05:33:01.443 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-17T05:33:01.473 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T05:33:01.473 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:33:01.473 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:33:01.474 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.19532 2026-02-17T05:33:01.476 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T05:33:01.476 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T05:33:01.476 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:44: run: for func in $funcs 2026-02-17T05:33:01.477 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:45: run: setup td/divergent-priors 2026-02-17T05:33:01.477 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/divergent-priors 2026-02-17T05:33:01.477 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/divergent-priors 2026-02-17T05:33:01.477 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-17T05:33:01.477 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T05:33:01.477 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-17T05:33:01.477 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:33:01.477 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:33:01.477 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:33:01.477 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:33:01.477 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:33:01.478 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:33:01.478 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T05:33:01.479 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T05:33:01.479 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T05:33:01.480 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T05:33:01.480 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T05:33:01.481 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T05:33:01.482 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:33:01.482 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T05:33:01.482 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T05:33:01.483 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:33:01.483 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T05:33:01.484 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T05:33:01.485 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-17T05:33:01.486 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T05:33:01.486 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:33:01.486 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:33:01.486 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.19532 2026-02-17T05:33:01.487 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T05:33:01.487 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T05:33:01.487 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/divergent-priors 2026-02-17T05:33:01.489 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T05:33:01.489 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:33:01.489 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:33:01.489 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.19532 2026-02-17T05:33:01.491 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T05:33:01.492 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-17T05:33:01.492 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T05:33:01.492 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/divergent-priors 1' TERM HUP INT 2026-02-17T05:33:01.492 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:46: run: TEST_divergent_ec td/divergent-priors 2026-02-17T05:33:01.492 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:227: TEST_divergent_ec: local dir=td/divergent-priors 2026-02-17T05:33:01.493 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:229: TEST_divergent_ec: file_with_random_data 2026-02-17T05:33:01.493 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=512 2026-02-17T05:33:01.493 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-17T05:33:01.494 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:01.494 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.v5UuUmEqXn bs=512 count=1 2026-02-17T05:33:01.495 INFO:tasks.workunit.client.0.trial030.stderr:1+0 records in 2026-02-17T05:33:01.495 INFO:tasks.workunit.client.0.trial030.stderr:1+0 records out 2026-02-17T05:33:01.495 INFO:tasks.workunit.client.0.trial030.stderr:512 bytes copied, 0.000271622 s, 1.9 MB/s 2026-02-17T05:33:01.495 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:01.496 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:229: TEST_divergent_ec: local dummyfile=/tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:01.496 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:231: TEST_divergent_ec: file_with_random_data 1000 2026-02-17T05:33:01.496 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=1000 2026-02-17T05:33:01.497 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-17T05:33:01.497 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.4Jez8x74Q7 2026-02-17T05:33:01.498 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.4Jez8x74Q7 bs=1000 count=1 2026-02-17T05:33:01.499 INFO:tasks.workunit.client.0.trial030.stderr:1+0 records in 2026-02-17T05:33:01.499 INFO:tasks.workunit.client.0.trial030.stderr:1+0 records out 2026-02-17T05:33:01.499 INFO:tasks.workunit.client.0.trial030.stderr:1000 bytes (1.0 kB) copied, 0.000114021 s, 8.8 MB/s 2026-02-17T05:33:01.499 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.4Jez8x74Q7 2026-02-17T05:33:01.500 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:231: TEST_divergent_ec: local dummyfile2=/tmp/tmp.4Jez8x74Q7 2026-02-17T05:33:01.500 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:233: TEST_divergent_ec: local num_osds=3 2026-02-17T05:33:01.500 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:234: TEST_divergent_ec: expr 3 - 1 2026-02-17T05:33:01.501 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:234: TEST_divergent_ec: seq 0 2 2026-02-17T05:33:01.503 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:234: TEST_divergent_ec: local 'osds=0 2026-02-17T05:33:01.503 INFO:tasks.workunit.client.0.trial030.stderr:1 2026-02-17T05:33:01.503 INFO:tasks.workunit.client.0.trial030.stderr:2' 2026-02-17T05:33:01.503 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:235: TEST_divergent_ec: run_mon td/divergent-priors a 2026-02-17T05:33:01.503 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/divergent-priors 2026-02-17T05:33:01.503 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T05:33:01.503 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T05:33:01.503 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T05:33:01.503 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/divergent-priors/a 2026-02-17T05:33:01.503 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/divergent-priors/a --run-dir=td/divergent-priors 2026-02-17T05:33:01.532 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T05:33:01.532 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:33:01.532 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:33:01.533 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:33:01.533 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:33:01.533 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:33:01.533 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:33:01.533 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/divergent-priors/a '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' --mon-cluster-log-file=td/divergent-priors/log --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T05:33:01.571 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T05:33:01.571 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T05:33:01.571 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T05:33:01.571 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T05:33:01.571 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T05:33:01.572 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T05:33:01.572 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T05:33:01.572 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T05:33:01.572 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T05:33:01.573 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T05:33:01.573 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:33:01.573 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:33:01.573 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19532/ceph-mon.a.asok 2026-02-17T05:33:01.573 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T05:33:01.573 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.19532/ceph-mon.a.asok config get fsid 2026-02-17T05:33:01.640 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T05:33:01.640 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T05:33:01.640 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T05:33:01.641 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T05:33:01.641 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T05:33:01.641 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T05:33:01.641 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T05:33:01.641 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T05:33:01.641 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T05:33:01.641 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:33:01.641 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:33:01.641 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19532/ceph-mon.a.asok 2026-02-17T05:33:01.641 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T05:33:01.641 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.19532/ceph-mon.a.asok config get mon_host 2026-02-17T05:33:01.694 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:236: TEST_divergent_ec: run_mgr td/divergent-priors x 2026-02-17T05:33:01.695 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/divergent-priors 2026-02-17T05:33:01.695 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T05:33:01.695 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T05:33:01.695 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T05:33:01.695 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/divergent-priors/x 2026-02-17T05:33:01.695 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T05:33:01.812 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T05:33:01.812 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:33:01.812 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:33:01.812 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:33:01.812 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:33:01.812 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:33:01.812 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:33:01.813 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T05:33:01.813 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/divergent-priors/x '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T05:33:01.836 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:237: TEST_divergent_ec: for i in $osds 2026-02-17T05:33:01.836 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:239: TEST_divergent_ec: run_osd td/divergent-priors 0 2026-02-17T05:33:01.836 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-17T05:33:01.836 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T05:33:01.836 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T05:33:01.837 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T05:33:01.837 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/0 2026-02-17T05:33:01.837 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T05:33:01.837 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:33:01.837 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:33:01.837 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:33:01.837 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-17T05:33:01.837 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-17T05:33:01.837 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T05:33:01.837 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T05:33:01.837 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T05:33:01.838 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T05:33:01.838 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:33:01.838 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:33:01.838 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:33:01.838 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:33:01.838 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:33:01.838 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:33:01.838 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:33:01.838 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:33:01.838 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T05:33:01.838 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T05:33:01.838 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T05:33:01.838 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T05:33:01.839 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:33:01.839 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:33:01.839 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:33:01.839 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:33:01.839 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T05:33:01.839 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T05:33:01.839 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/0 2026-02-17T05:33:01.839 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T05:33:01.840 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=ffd61780-fdee-492a-b89a-f0298d033d42 2026-02-17T05:33:01.840 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 ffd61780-fdee-492a-b89a-f0298d033d42' 2026-02-17T05:33:01.840 INFO:tasks.workunit.client.0.trial030.stdout:add osd0 ffd61780-fdee-492a-b89a-f0298d033d42 2026-02-17T05:33:01.840 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T05:33:01.851 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCN/ZNpRzWbMhAA/vTNN/WdTiW4rmnB2d+HNQ== 2026-02-17T05:33:01.851 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCN/ZNpRzWbMhAA/vTNN/WdTiW4rmnB2d+HNQ=="}' 2026-02-17T05:33:01.851 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new ffd61780-fdee-492a-b89a-f0298d033d42 -i td/divergent-priors/0/new.json 2026-02-17T05:33:01.968 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:33:01.976 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/0/new.json 2026-02-17T05:33:01.977 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCN/ZNpRzWbMhAA/vTNN/WdTiW4rmnB2d+HNQ== --osd-uuid ffd61780-fdee-492a-b89a-f0298d033d42 2026-02-17T05:33:01.997 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:33:01.992+0000 7f8a3808aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:33:01.998 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:33:01.992+0000 7f8a3808aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:33:01.999 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:33:01.992+0000 7f8a3808aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:33:01.999 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:33:01.996+0000 7f8a3808aa40 -1 bdev(0x55b2496b0400 td/divergent-priors/0/block) open stat got: (1) Operation not permitted 2026-02-17T05:33:01.999 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:33:01.996+0000 7f8a3808aa40 -1 bluestore(td/divergent-priors/0) _read_fsid unparsable uuid 2026-02-17T05:33:02.707 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/0/keyring 2026-02-17T05:33:02.707 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T05:33:02.708 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T05:33:02.709 INFO:tasks.workunit.client.0.trial030.stdout:adding osd0 key to auth repository 2026-02-17T05:33:02.709 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T05:33:02.833 INFO:tasks.workunit.client.0.trial030.stdout:start osd.0 2026-02-17T05:33:02.834 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T05:33:02.834 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T05:33:02.834 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T05:33:02.834 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T05:33:02.834 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T05:33:02.863 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:33:02.856+0000 7f70b711ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:33:02.865 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:33:02.860+0000 7f70b711ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:33:02.866 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:33:02.860+0000 7f70b711ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:33:02.945 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T05:33:02.946 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:33:02.946 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T05:33:02.946 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:33:02.946 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:33:02.946 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:33:02.946 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:33:02.947 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:33:02.947 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:33:02.947 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T05:33:03.056 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:33:03.409 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:33:03.404+0000 7f70b711ea40 -1 Falling back to public interface 2026-02-17T05:33:04.057 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:33:04.058 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:33:04.058 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-17T05:33:04.059 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T05:33:04.059 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:33:04.059 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T05:33:04.168 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:33:04.369 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:33:04.364+0000 7f70b711ea40 -1 osd.0 0 log_to_monitors true 2026-02-17T05:33:05.169 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:33:05.169 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:33:05.170 INFO:tasks.workunit.client.0.trial030.stdout:2 2026-02-17T05:33:05.170 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T05:33:05.170 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:33:05.170 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T05:33:05.392 INFO:tasks.workunit.client.0.trial030.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1544032301,v1:127.0.0.1:6801/1544032301] [v2:127.0.0.1:6802/1544032301,v1:127.0.0.1:6803/1544032301] exists,up ffd61780-fdee-492a-b89a-f0298d033d42 2026-02-17T05:33:05.395 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:33:05.396 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:33:05.396 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:33:05.396 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:237: TEST_divergent_ec: for i in $osds 2026-02-17T05:33:05.396 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:239: TEST_divergent_ec: run_osd td/divergent-priors 1 2026-02-17T05:33:05.396 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-17T05:33:05.396 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T05:33:05.396 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-17T05:33:05.396 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T05:33:05.397 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/1 2026-02-17T05:33:05.397 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T05:33:05.397 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:33:05.397 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:33:05.397 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:33:05.397 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-17T05:33:05.397 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-17T05:33:05.397 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T05:33:05.397 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T05:33:05.397 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T05:33:05.397 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T05:33:05.398 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:33:05.398 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:33:05.398 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:33:05.398 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:33:05.398 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:33:05.398 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:33:05.398 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:33:05.398 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:33:05.398 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T05:33:05.399 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T05:33:05.399 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T05:33:05.399 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T05:33:05.399 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:33:05.399 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:33:05.399 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:33:05.399 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:33:05.399 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T05:33:05.399 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T05:33:05.399 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/1 2026-02-17T05:33:05.399 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T05:33:05.400 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=66e43dc5-03ed-42cb-985e-85686a5152c5 2026-02-17T05:33:05.400 INFO:tasks.workunit.client.0.trial030.stdout:add osd1 66e43dc5-03ed-42cb-985e-85686a5152c5 2026-02-17T05:33:05.401 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 66e43dc5-03ed-42cb-985e-85686a5152c5' 2026-02-17T05:33:05.401 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T05:33:05.411 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCR/ZNp6YphGBAAa7Fo3yYkqla+ftCzbhmJPA== 2026-02-17T05:33:05.412 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCR/ZNp6YphGBAAa7Fo3yYkqla+ftCzbhmJPA=="}' 2026-02-17T05:33:05.412 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 66e43dc5-03ed-42cb-985e-85686a5152c5 -i td/divergent-priors/1/new.json 2026-02-17T05:33:05.634 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-17T05:33:05.643 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/1/new.json 2026-02-17T05:33:05.644 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCR/ZNp6YphGBAAa7Fo3yYkqla+ftCzbhmJPA== --osd-uuid 66e43dc5-03ed-42cb-985e-85686a5152c5 2026-02-17T05:33:05.663 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:33:05.660+0000 7f2a68d1ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:33:05.665 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:33:05.660+0000 7f2a68d1ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:33:05.666 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:33:05.660+0000 7f2a68d1ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:33:05.666 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:33:05.660+0000 7f2a68d1ea40 -1 bdev(0x555d2e08e400 td/divergent-priors/1/block) open stat got: (1) Operation not permitted 2026-02-17T05:33:05.667 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:33:05.660+0000 7f2a68d1ea40 -1 bluestore(td/divergent-priors/1) _read_fsid unparsable uuid 2026-02-17T05:33:06.371 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/1/keyring 2026-02-17T05:33:06.371 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T05:33:06.372 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-17T05:33:06.373 INFO:tasks.workunit.client.0.trial030.stdout:adding osd1 key to auth repository 2026-02-17T05:33:06.373 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T05:33:06.668 INFO:tasks.workunit.client.0.trial030.stdout:start osd.1 2026-02-17T05:33:06.668 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-17T05:33:06.669 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T05:33:06.669 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T05:33:06.669 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T05:33:06.669 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T05:33:06.696 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:33:06.692+0000 7f9a5d478a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:33:06.698 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:33:06.692+0000 7f9a5d478a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:33:06.699 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:33:06.692+0000 7f9a5d478a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:33:06.889 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-17T05:33:06.889 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:33:06.889 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T05:33:06.890 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:33:06.890 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:33:06.890 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:33:06.890 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:33:06.891 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:33:06.891 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:33:06.891 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T05:33:07.018 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:33:07.012+0000 7f9a5d478a40 -1 Falling back to public interface 2026-02-17T05:33:07.102 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:33:07.688 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:33:07.684+0000 7f9a5d478a40 -1 osd.1 0 log_to_monitors true 2026-02-17T05:33:08.104 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:33:08.104 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:33:08.104 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-17T05:33:08.104 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T05:33:08.104 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:33:08.104 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T05:33:08.329 INFO:tasks.workunit.client.0.trial030.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2668219398,v1:127.0.0.1:6811/2668219398] [v2:127.0.0.1:6812/2668219398,v1:127.0.0.1:6813/2668219398] exists,up 66e43dc5-03ed-42cb-985e-85686a5152c5 2026-02-17T05:33:08.333 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:33:08.333 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:33:08.333 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:33:08.333 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:237: TEST_divergent_ec: for i in $osds 2026-02-17T05:33:08.334 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:239: TEST_divergent_ec: run_osd td/divergent-priors 2 2026-02-17T05:33:08.334 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-17T05:33:08.334 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T05:33:08.334 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-17T05:33:08.334 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T05:33:08.334 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/2 2026-02-17T05:33:08.334 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T05:33:08.334 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:33:08.334 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:33:08.334 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:33:08.334 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-17T05:33:08.335 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-17T05:33:08.335 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T05:33:08.335 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T05:33:08.335 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T05:33:08.335 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T05:33:08.335 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:33:08.335 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:33:08.335 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:33:08.335 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:33:08.335 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:33:08.335 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:33:08.335 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:33:08.336 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:33:08.336 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T05:33:08.336 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T05:33:08.336 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T05:33:08.336 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T05:33:08.336 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:33:08.336 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:33:08.336 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:33:08.336 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:33:08.336 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T05:33:08.336 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T05:33:08.336 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/2 2026-02-17T05:33:08.337 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T05:33:08.337 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=09dea4cc-8ddf-4609-83f3-70b490de0aa5 2026-02-17T05:33:08.337 INFO:tasks.workunit.client.0.trial030.stdout:add osd2 09dea4cc-8ddf-4609-83f3-70b490de0aa5 2026-02-17T05:33:08.338 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 09dea4cc-8ddf-4609-83f3-70b490de0aa5' 2026-02-17T05:33:08.338 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T05:33:08.347 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCU/ZNpzMCNFBAAwNfpBvlU7ae95SIMSYBcAw== 2026-02-17T05:33:08.347 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCU/ZNpzMCNFBAAwNfpBvlU7ae95SIMSYBcAw=="}' 2026-02-17T05:33:08.347 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 09dea4cc-8ddf-4609-83f3-70b490de0aa5 -i td/divergent-priors/2/new.json 2026-02-17T05:33:08.559 INFO:tasks.workunit.client.0.trial030.stdout:2 2026-02-17T05:33:08.568 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/2/new.json 2026-02-17T05:33:08.569 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCU/ZNpzMCNFBAAwNfpBvlU7ae95SIMSYBcAw== --osd-uuid 09dea4cc-8ddf-4609-83f3-70b490de0aa5 2026-02-17T05:33:08.587 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:33:08.580+0000 7fb8477c5a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:33:08.588 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:33:08.584+0000 7fb8477c5a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:33:08.589 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:33:08.584+0000 7fb8477c5a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:33:08.590 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:33:08.584+0000 7fb8477c5a40 -1 bdev(0x55f8d40ce400 td/divergent-priors/2/block) open stat got: (1) Operation not permitted 2026-02-17T05:33:08.590 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:33:08.584+0000 7fb8477c5a40 -1 bluestore(td/divergent-priors/2) _read_fsid unparsable uuid 2026-02-17T05:33:09.261 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/2/keyring 2026-02-17T05:33:09.261 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T05:33:09.262 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-17T05:33:09.262 INFO:tasks.workunit.client.0.trial030.stdout:adding osd2 key to auth repository 2026-02-17T05:33:09.263 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T05:33:09.563 INFO:tasks.workunit.client.0.trial030.stdout:start osd.2 2026-02-17T05:33:09.564 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-17T05:33:09.564 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T05:33:09.564 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T05:33:09.564 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T05:33:09.565 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T05:33:09.582 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:33:09.576+0000 7f6db29b3a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:33:09.583 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:33:09.580+0000 7f6db29b3a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:33:09.584 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:33:09.580+0000 7f6db29b3a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:33:09.784 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-17T05:33:09.784 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:33:09.784 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T05:33:09.784 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:33:09.784 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:33:09.784 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:33:09.785 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:33:09.785 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:33:09.786 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:33:09.786 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T05:33:09.949 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:33:09.944+0000 7f6db29b3a40 -1 Falling back to public interface 2026-02-17T05:33:09.998 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:33:10.637 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:33:10.632+0000 7f6db29b3a40 -1 osd.2 0 log_to_monitors true 2026-02-17T05:33:10.999 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:33:10.999 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:33:10.999 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T05:33:10.999 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-17T05:33:11.000 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:33:11.000 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T05:33:11.210 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:33:12.211 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:33:12.211 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:33:12.211 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T05:33:12.211 INFO:tasks.workunit.client.0.trial030.stdout:2 2026-02-17T05:33:12.211 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:33:12.212 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T05:33:12.422 INFO:tasks.workunit.client.0.trial030.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/3997455342,v1:127.0.0.1:6819/3997455342] [v2:127.0.0.1:6820/3997455342,v1:127.0.0.1:6821/3997455342] exists,up 09dea4cc-8ddf-4609-83f3-70b490de0aa5 2026-02-17T05:33:12.423 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:33:12.423 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:33:12.423 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:33:12.423 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:242: TEST_divergent_ec: ceph osd set noout 2026-02-17T05:33:12.717 INFO:tasks.workunit.client.0.trial030.stderr:noout is set 2026-02-17T05:33:12.728 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:243: TEST_divergent_ec: ceph osd set noin 2026-02-17T05:33:13.022 INFO:tasks.workunit.client.0.trial030.stderr:noin is set 2026-02-17T05:33:13.032 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:244: TEST_divergent_ec: ceph osd set nodown 2026-02-17T05:33:13.326 INFO:tasks.workunit.client.0.trial030.stderr:nodown is set 2026-02-17T05:33:13.337 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:245: TEST_divergent_ec: create_ec_pool test true k=2 m=1 2026-02-17T05:33:13.337 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2521: create_ec_pool: local pool_name=test 2026-02-17T05:33:13.337 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2522: create_ec_pool: shift 2026-02-17T05:33:13.338 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2523: create_ec_pool: local allow_overwrites=true 2026-02-17T05:33:13.338 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2524: create_ec_pool: shift 2026-02-17T05:33:13.338 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2526: create_ec_pool: ceph osd erasure-code-profile set myprofile crush-failure-domain=osd k=2 m=1 2026-02-17T05:33:13.593 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2528: create_ec_pool: create_pool test 1 1 erasure myprofile 2026-02-17T05:33:13.593 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 erasure myprofile 2026-02-17T05:33:13.983 INFO:tasks.workunit.client.0.trial030.stderr:pool 'test' already exists 2026-02-17T05:33:13.993 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T05:33:14.994 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2530: create_ec_pool: '[' true = true ']' 2026-02-17T05:33:14.994 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2531: create_ec_pool: ceph osd pool set test allow_ec_overwrites true 2026-02-17T05:33:15.303 INFO:tasks.workunit.client.0.trial030.stderr:set pool 1 allow_ec_overwrites to true 2026-02-17T05:33:15.315 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2534: create_ec_pool: wait_for_clean 2026-02-17T05:33:15.315 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T05:33:15.315 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T05:33:15.315 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T05:33:15.316 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T05:33:15.317 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T05:33:15.317 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T05:33:15.317 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T05:33:15.317 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T05:33:15.317 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T05:33:15.431 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T05:33:15.431 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T05:33:15.431 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T05:33:15.431 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T05:33:15.431 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T05:33:15.431 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:33:15.651 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:33:15.651 INFO:tasks.workunit.client.0.trial030.stderr:1 2026-02-17T05:33:15.651 INFO:tasks.workunit.client.0.trial030.stderr:2' 2026-02-17T05:33:15.651 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:33:15.651 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:33:15.651 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T05:33:15.732 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836485 2026-02-17T05:33:15.732 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836485 2026-02-17T05:33:15.732 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485' 2026-02-17T05:33:15.732 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:33:15.732 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T05:33:15.815 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705668 2026-02-17T05:33:15.815 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705668 2026-02-17T05:33:15.815 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-38654705668' 2026-02-17T05:33:15.815 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:33:15.816 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T05:33:15.897 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542147 2026-02-17T05:33:15.897 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542147 2026-02-17T05:33:15.897 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-38654705668 2-60129542147' 2026-02-17T05:33:15.897 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:33:15.897 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836485 2026-02-17T05:33:15.897 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:33:15.898 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:33:15.898 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836485 2026-02-17T05:33:15.899 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:33:15.900 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836485 2026-02-17T05:33:15.900 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2026-02-17T05:33:15.901 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.0 seq 21474836485 2026-02-17T05:33:15.901 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:33:16.126 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836485 2026-02-17T05:33:16.126 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:33:17.127 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T05:33:17.127 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:33:17.346 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836485 -lt 21474836485 2026-02-17T05:33:17.346 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:33:17.347 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705668 2026-02-17T05:33:17.347 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:33:17.348 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:33:17.348 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705668 2026-02-17T05:33:17.348 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:33:17.350 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705668 2026-02-17T05:33:17.350 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.1 seq 38654705668 2026-02-17T05:33:17.351 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705668' 2026-02-17T05:33:17.351 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:33:17.573 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705668 -lt 38654705668 2026-02-17T05:33:17.574 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:33:17.574 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542147 2026-02-17T05:33:17.574 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:33:17.575 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:33:17.576 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542147 2026-02-17T05:33:17.576 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:33:17.578 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542147 2026-02-17T05:33:17.578 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542147' 2026-02-17T05:33:17.578 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.2 seq 60129542147 2026-02-17T05:33:17.578 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:33:17.804 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542147 -lt 60129542147 2026-02-17T05:33:17.804 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T05:33:17.805 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:33:17.805 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:33:18.087 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T05:33:18.087 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:33:18.087 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:33:18.087 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:33:18.087 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:33:18.087 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:33:18.088 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:33:18.088 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:33:18.304 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T05:33:18.305 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:33:18.305 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:33:18.305 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:33:18.599 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T05:33:18.600 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T05:33:18.600 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T05:33:18.600 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2535: create_ec_pool: return 0 2026-02-17T05:33:18.600 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:247: TEST_divergent_ec: flush_pg_stats 2026-02-17T05:33:18.600 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T05:33:18.600 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:33:18.815 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:33:18.815 INFO:tasks.workunit.client.0.trial030.stderr:1 2026-02-17T05:33:18.816 INFO:tasks.workunit.client.0.trial030.stderr:2' 2026-02-17T05:33:18.816 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:33:18.816 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:33:18.816 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T05:33:18.901 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-17T05:33:18.902 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-17T05:33:18.902 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487' 2026-02-17T05:33:18.902 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:33:18.902 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T05:33:18.988 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705671 2026-02-17T05:33:18.988 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705671 2026-02-17T05:33:18.988 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-38654705671' 2026-02-17T05:33:18.988 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:33:18.988 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T05:33:19.071 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542150 2026-02-17T05:33:19.071 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542150 2026-02-17T05:33:19.072 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-38654705671 2-60129542150' 2026-02-17T05:33:19.072 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:33:19.073 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836487 2026-02-17T05:33:19.073 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:33:19.073 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:33:19.074 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-17T05:33:19.074 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:33:19.075 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836487 2026-02-17T05:33:19.075 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-17T05:33:19.076 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.0 seq 21474836487 2026-02-17T05:33:19.076 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:33:19.303 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836485 -lt 21474836487 2026-02-17T05:33:19.303 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:33:20.304 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T05:33:20.305 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:33:20.520 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-17T05:33:20.520 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:33:20.521 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705671 2026-02-17T05:33:20.521 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:33:20.522 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:33:20.522 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705671 2026-02-17T05:33:20.523 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:33:20.524 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705671 2026-02-17T05:33:20.524 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705671' 2026-02-17T05:33:20.525 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.1 seq 38654705671 2026-02-17T05:33:20.525 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:33:20.750 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705671 -lt 38654705671 2026-02-17T05:33:20.750 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:33:20.751 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542150 2026-02-17T05:33:20.751 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:33:20.752 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:33:20.753 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542150 2026-02-17T05:33:20.753 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:33:20.754 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542150 2026-02-17T05:33:20.754 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.2 seq 60129542150 2026-02-17T05:33:20.755 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542150' 2026-02-17T05:33:20.755 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:33:20.976 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542150 -lt 60129542150 2026-02-17T05:33:20.976 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:248: TEST_divergent_ec: wait_for_clean 2026-02-17T05:33:20.977 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T05:33:20.977 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T05:33:20.977 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T05:33:20.977 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T05:33:20.978 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T05:33:20.978 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T05:33:20.978 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T05:33:20.978 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T05:33:20.978 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T05:33:21.083 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T05:33:21.083 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T05:33:21.083 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T05:33:21.083 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T05:33:21.084 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T05:33:21.084 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:33:21.312 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:33:21.313 INFO:tasks.workunit.client.0.trial030.stderr:1 2026-02-17T05:33:21.313 INFO:tasks.workunit.client.0.trial030.stderr:2' 2026-02-17T05:33:21.313 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:33:21.313 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:33:21.313 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T05:33:21.393 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836490 2026-02-17T05:33:21.394 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836490 2026-02-17T05:33:21.394 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490' 2026-02-17T05:33:21.394 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:33:21.394 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T05:33:21.479 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705673 2026-02-17T05:33:21.480 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705673 2026-02-17T05:33:21.480 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490 1-38654705673' 2026-02-17T05:33:21.480 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:33:21.480 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T05:33:21.560 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542152 2026-02-17T05:33:21.561 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542152 2026-02-17T05:33:21.561 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490 1-38654705673 2-60129542152' 2026-02-17T05:33:21.561 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:33:21.561 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836490 2026-02-17T05:33:21.562 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:33:21.562 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:33:21.562 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836490 2026-02-17T05:33:21.563 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:33:21.564 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836490 2026-02-17T05:33:21.564 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.0 seq 21474836490 2026-02-17T05:33:21.565 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836490' 2026-02-17T05:33:21.565 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:33:21.775 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836490 2026-02-17T05:33:21.776 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:33:22.776 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T05:33:22.777 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:33:23.003 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836490 -lt 21474836490 2026-02-17T05:33:23.003 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:33:23.004 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705673 2026-02-17T05:33:23.004 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:33:23.005 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:33:23.006 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705673 2026-02-17T05:33:23.006 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:33:23.007 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705673 2026-02-17T05:33:23.008 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705673' 2026-02-17T05:33:23.008 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.1 seq 38654705673 2026-02-17T05:33:23.008 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:33:23.234 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705673 -lt 38654705673 2026-02-17T05:33:23.234 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:33:23.235 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542152 2026-02-17T05:33:23.235 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:33:23.236 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:33:23.237 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542152 2026-02-17T05:33:23.237 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:33:23.238 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542152 2026-02-17T05:33:23.238 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.2 seq 60129542152 2026-02-17T05:33:23.239 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542152' 2026-02-17T05:33:23.239 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:33:23.460 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542153 -lt 60129542152 2026-02-17T05:33:23.461 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T05:33:23.462 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:33:23.462 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:33:23.738 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T05:33:23.739 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:33:23.739 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:33:23.739 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:33:23.739 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:33:23.739 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:33:23.739 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:33:23.739 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:33:23.951 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T05:33:23.951 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:33:23.952 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:33:23.952 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:33:24.247 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T05:33:24.247 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T05:33:24.247 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T05:33:24.248 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:251: TEST_divergent_ec: ceph pg dump pgs --format=json 2026-02-17T05:33:24.248 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:251: TEST_divergent_ec: jq '.pg_stats[0].up_primary' 2026-02-17T05:33:24.451 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:33:24.462 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:251: TEST_divergent_ec: local divergent=1 2026-02-17T05:33:24.462 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:252: TEST_divergent_ec: echo 'primary and soon to be divergent is 1' 2026-02-17T05:33:24.463 INFO:tasks.workunit.client.0.trial030.stdout:primary and soon to be divergent is 1 2026-02-17T05:33:24.464 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:253: TEST_divergent_ec: ceph pg dump pgs 2026-02-17T05:33:24.673 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T05:33:24.674 INFO:tasks.workunit.client.0.trial030.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T05:33:14.294835+0000 0'0 28:18 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:33:13.930101+0000 0'0 2026-02-17T05:33:13.930101+0000 0 0 periodic scrub scheduled @ 2026-02-18T14:43:40.667171+0000 0 0 2026-02-17T05:33:24.674 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-17T05:33:24.674 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T05:33:24.674 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:33:24.683 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:254: TEST_divergent_ec: local non_divergent= 2026-02-17T05:33:24.684 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:255: TEST_divergent_ec: for i in $osds 2026-02-17T05:33:24.684 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:257: TEST_divergent_ec: '[' 0 = 1 ']' 2026-02-17T05:33:24.684 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:260: TEST_divergent_ec: non_divergent=' 0' 2026-02-17T05:33:24.684 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:255: TEST_divergent_ec: for i in $osds 2026-02-17T05:33:24.684 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:257: TEST_divergent_ec: '[' 1 = 1 ']' 2026-02-17T05:33:24.684 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:258: TEST_divergent_ec: continue 2026-02-17T05:33:24.684 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:255: TEST_divergent_ec: for i in $osds 2026-02-17T05:33:24.684 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:257: TEST_divergent_ec: '[' 2 = 1 ']' 2026-02-17T05:33:24.685 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:260: TEST_divergent_ec: non_divergent=' 0 2' 2026-02-17T05:33:24.685 INFO:tasks.workunit.client.0.trial030.stdout:writing initial objects 2026-02-17T05:33:24.686 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:263: TEST_divergent_ec: echo 'writing initial objects' 2026-02-17T05:33:24.686 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: seq 1 100 2026-02-17T05:33:24.686 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:24.686 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_1 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:24.708 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:24.708 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_2 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:24.738 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:24.739 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_3 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:24.767 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:24.767 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_4 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:24.796 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:24.796 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_5 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:24.825 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:24.825 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_6 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:24.854 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:24.854 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_7 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:24.882 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:24.882 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_8 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:24.911 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:24.911 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_9 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:24.942 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:24.942 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_10 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:24.970 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:24.970 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_11 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:24.999 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:24.999 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_12 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:25.027 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:25.027 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_13 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:25.054 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:25.054 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_14 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:25.082 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:25.083 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_15 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:25.110 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:25.110 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_16 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:25.138 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:25.138 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_17 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:25.168 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:25.168 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_18 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:25.189 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:25.189 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_19 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:25.216 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:25.216 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_20 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:25.243 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:25.243 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_21 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:25.271 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:25.271 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_22 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:25.299 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:25.299 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_23 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:25.327 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:25.327 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_24 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:25.350 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:25.351 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_25 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:25.378 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:25.378 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_26 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:25.403 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:25.403 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_27 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:25.429 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:25.429 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_28 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:25.456 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:25.456 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_29 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:25.478 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:25.479 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_30 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:25.507 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:25.507 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_31 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:25.534 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:25.534 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_32 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:25.561 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:25.561 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_33 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:25.589 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:25.589 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_34 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:25.617 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:25.617 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_35 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:25.645 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:25.645 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_36 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:25.673 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:25.674 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_37 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:25.694 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:25.694 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_38 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:25.722 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:25.722 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_39 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:25.747 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:25.747 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_40 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:25.772 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:25.773 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_41 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:25.801 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:25.801 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_42 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:25.830 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:25.830 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_43 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:25.858 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:25.859 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_44 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:25.886 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:25.886 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_45 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:25.915 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:25.915 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_46 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:25.943 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:25.943 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_47 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:25.971 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:25.972 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_48 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:25.999 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:25.999 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_49 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:26.029 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:26.029 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_50 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:26.058 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:26.058 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_51 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:26.087 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:26.087 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_52 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:26.108 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:26.108 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_53 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:26.138 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:26.138 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_54 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:26.164 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:26.164 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_55 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:26.191 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:26.191 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_56 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:26.218 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:26.219 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_57 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:26.246 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:26.246 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_58 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:26.274 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:26.275 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_59 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:26.302 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:26.303 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_60 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:26.330 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:26.331 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_61 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:26.359 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:26.359 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_62 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:26.387 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:26.387 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_63 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:26.414 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:26.414 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_64 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:26.442 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:26.443 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_65 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:26.471 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:26.471 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_66 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:26.499 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:26.499 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_67 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:26.526 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:26.526 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_68 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:26.554 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:26.555 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_69 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:26.582 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:26.582 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_70 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:26.610 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:26.611 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_71 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:26.638 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:26.638 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_72 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:26.666 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:26.666 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_73 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:26.694 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:26.694 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_74 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:26.721 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:26.721 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_75 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:26.749 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:26.749 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_76 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:26.776 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:26.776 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_77 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:26.805 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:26.805 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_78 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:26.834 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:26.834 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_79 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:26.862 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:26.862 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_80 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:26.890 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:26.891 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_81 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:26.918 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:26.918 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_82 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:26.946 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:26.946 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_83 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:26.975 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:26.975 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_84 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:26.996 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:26.996 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_85 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:27.017 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:27.018 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_86 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:27.044 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:27.044 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_87 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:27.071 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:27.071 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_88 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:27.098 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:27.098 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_89 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:27.126 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:27.126 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_90 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:27.155 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:27.155 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_91 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:27.185 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:27.185 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_92 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:27.213 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:27.214 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_93 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:27.242 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:27.242 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_94 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:27.269 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:27.269 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_95 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:27.297 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:27.298 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_96 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:27.326 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:27.326 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_97 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:27.355 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:27.355 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_98 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:27.382 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:27.383 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_99 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:27.411 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T05:33:27.411 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_100 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:27.441 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:270: TEST_divergent_ec: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-17T05:33:27.441 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:270: TEST_divergent_ec: wait_for_clean 2026-02-17T05:33:27.441 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T05:33:27.441 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T05:33:27.441 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T05:33:27.441 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-17T05:33:27.442 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T05:33:27.442 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T05:33:27.442 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T05:33:27.443 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T05:33:27.443 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T05:33:27.513 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-17T05:33:27.513 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T05:33:27.513 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T05:33:27.513 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T05:33:27.513 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T05:33:27.513 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:33:27.727 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:33:27.727 INFO:tasks.workunit.client.0.trial030.stderr:1 2026-02-17T05:33:27.727 INFO:tasks.workunit.client.0.trial030.stderr:2' 2026-02-17T05:33:27.727 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:33:27.727 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:33:27.728 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T05:33:27.812 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836493 2026-02-17T05:33:27.813 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836493 2026-02-17T05:33:27.813 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836493' 2026-02-17T05:33:27.813 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:33:27.813 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T05:33:27.898 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705676 2026-02-17T05:33:27.898 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705676 2026-02-17T05:33:27.898 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836493 1-38654705676' 2026-02-17T05:33:27.898 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:33:27.899 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T05:33:27.983 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542156 2026-02-17T05:33:27.983 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542156 2026-02-17T05:33:27.984 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836493 1-38654705676 2-60129542156' 2026-02-17T05:33:27.984 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:33:27.984 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836493 2026-02-17T05:33:27.984 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:33:27.985 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:33:27.986 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836493 2026-02-17T05:33:27.986 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:33:27.987 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836493 2026-02-17T05:33:27.987 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.0 seq 21474836493 2026-02-17T05:33:27.988 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836493' 2026-02-17T05:33:27.988 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:33:28.212 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836493 -lt 21474836493 2026-02-17T05:33:28.212 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:33:28.213 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705676 2026-02-17T05:33:28.213 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:33:28.214 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:33:28.215 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705676 2026-02-17T05:33:28.215 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:33:28.216 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705676 2026-02-17T05:33:28.217 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.1 seq 38654705676 2026-02-17T05:33:28.217 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705676' 2026-02-17T05:33:28.217 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:33:28.439 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705676 -lt 38654705676 2026-02-17T05:33:28.439 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:33:28.440 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542156 2026-02-17T05:33:28.440 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:33:28.441 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:33:28.442 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542156 2026-02-17T05:33:28.442 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:33:28.443 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542156 2026-02-17T05:33:28.444 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.2 seq 60129542156 2026-02-17T05:33:28.444 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542156' 2026-02-17T05:33:28.444 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:33:28.681 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542156 -lt 60129542156 2026-02-17T05:33:28.682 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T05:33:28.682 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:33:28.682 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:33:28.975 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T05:33:28.975 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:33:28.975 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:33:28.975 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:33:28.975 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:33:28.975 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:33:28.975 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:33:28.976 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:33:29.192 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T05:33:29.193 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:33:29.193 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:33:29.193 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:33:29.479 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T05:33:29.479 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T05:33:29.480 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T05:33:29.480 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:272: TEST_divergent_ec: get_pg test existing_1 2026-02-17T05:33:29.480 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=test 2026-02-17T05:33:29.480 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=existing_1 2026-02-17T05:33:29.480 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map test existing_1 2026-02-17T05:33:29.480 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-17T05:33:29.691 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:272: TEST_divergent_ec: local pgid=1.0 2026-02-17T05:33:29.692 INFO:tasks.workunit.client.0.trial030.stdout:blackholing osds 0 2 2026-02-17T05:33:29.692 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:275: TEST_divergent_ec: echo 'blackholing osds 0 2' 2026-02-17T05:33:29.692 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:276: TEST_divergent_ec: ceph pg dump pgs 2026-02-17T05:33:29.902 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T05:33:29.902 INFO:tasks.workunit.client.0.trial030.stdout:1.0 100 0 0 0 0 51200 0 0 16 84 16 active+clean 2026-02-17T05:33:14.294835+0000 28'100 28:118 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:33:13.930101+0000 0'0 2026-02-17T05:33:13.930101+0000 0 0 periodic scrub scheduled @ 2026-02-18T14:43:40.667171+0000 0 0 2026-02-17T05:33:29.902 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-17T05:33:29.902 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T05:33:29.902 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:33:29.911 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:277: TEST_divergent_ec: for i in $non_divergent 2026-02-17T05:33:29.912 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: get_asok_path osd.0 2026-02-17T05:33:29.912 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-17T05:33:29.912 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-17T05:33:29.912 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T05:33:29.912 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:33:29.912 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:33:29.913 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19532/ceph-osd.0.asok 2026-02-17T05:33:29.913 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: CEPH_ARGS= 2026-02-17T05:33:29.913 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.19532/ceph-osd.0.asok config set objectstore_blackhole 1 2026-02-17T05:33:29.968 INFO:tasks.workunit.client.0.trial030.stdout:{ 2026-02-17T05:33:29.968 INFO:tasks.workunit.client.0.trial030.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-17T05:33:29.968 INFO:tasks.workunit.client.0.trial030.stdout:} 2026-02-17T05:33:29.974 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:277: TEST_divergent_ec: for i in $non_divergent 2026-02-17T05:33:29.974 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: get_asok_path osd.2 2026-02-17T05:33:29.975 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-17T05:33:29.975 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-17T05:33:29.975 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T05:33:29.975 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:33:29.975 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:33:29.975 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19532/ceph-osd.2.asok 2026-02-17T05:33:29.976 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: CEPH_ARGS= 2026-02-17T05:33:29.976 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.19532/ceph-osd.2.asok config set objectstore_blackhole 1 2026-02-17T05:33:30.031 INFO:tasks.workunit.client.0.trial030.stdout:{ 2026-02-17T05:33:30.031 INFO:tasks.workunit.client.0.trial030.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-17T05:33:30.031 INFO:tasks.workunit.client.0.trial030.stdout:} 2026-02-17T05:33:30.037 INFO:tasks.workunit.client.0.trial030.stdout:writing divergent object 2026-02-17T05:33:30.037 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:283: TEST_divergent_ec: echo 'writing divergent object' 2026-02-17T05:33:30.037 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:285: TEST_divergent_ec: sleep 1 2026-02-17T05:33:30.037 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:284: TEST_divergent_ec: rados -p test put existing_100 /tmp/tmp.4Jez8x74Q7 2026-02-17T05:33:31.039 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:287: TEST_divergent_ec: rados -p test mksnap snap1 2026-02-17T05:33:31.039 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:286: TEST_divergent_ec: rados -p test put existing_100 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:31.111 INFO:tasks.workunit.client.0.trial030.stdout:created pool test snap snap1 2026-02-17T05:33:31.113 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:289: TEST_divergent_ec: sleep 10 2026-02-17T05:33:31.114 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:288: TEST_divergent_ec: expr 100 - 1 2026-02-17T05:33:31.115 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:288: TEST_divergent_ec: rados -p test put existing_99 /tmp/tmp.v5UuUmEqXn 2026-02-17T05:33:41.115 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:290: TEST_divergent_ec: killall -9 rados 2026-02-17T05:33:41.159 INFO:tasks.workunit.client.0.trial030.stderr:rados: no process found 2026-02-17T05:33:41.159 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:293: TEST_divergent_ec: echo 'killing all the osds' 2026-02-17T05:33:41.159 INFO:tasks.workunit.client.0.trial030.stdout:killing all the osds 2026-02-17T05:33:41.159 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:294: TEST_divergent_ec: ceph pg dump pgs 2026-02-17T05:33:41.375 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T05:33:41.375 INFO:tasks.workunit.client.0.trial030.stdout:1.0 101 0 0 0 0 51712 0 0 14 90 14 active+clean 2026-02-17T05:33:14.294835+0000 29'104 29:124 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:33:13.930101+0000 0'0 2026-02-17T05:33:13.930101+0000 0 0 periodic scrub scheduled @ 2026-02-18T14:10:51.398109+0000 0 0 2026-02-17T05:33:41.375 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-17T05:33:41.375 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T05:33:41.375 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:33:41.385 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:295: TEST_divergent_ec: kill_daemons td/divergent-priors KILL osd 2026-02-17T05:33:41.386 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:33:41.386 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:33:41.386 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:33:41.386 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:33:41.386 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:33:41.495 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:33:41.495 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:296: TEST_divergent_ec: for i in $osds 2026-02-17T05:33:41.495 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:298: TEST_divergent_ec: ceph osd down osd.0 2026-02-17T05:33:41.754 INFO:tasks.workunit.client.0.trial030.stderr:osd.0 is already down. 2026-02-17T05:33:41.764 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:296: TEST_divergent_ec: for i in $osds 2026-02-17T05:33:41.764 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:298: TEST_divergent_ec: ceph osd down osd.1 2026-02-17T05:33:42.058 INFO:tasks.workunit.client.0.trial030.stderr:osd.1 is already down. 2026-02-17T05:33:42.068 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:296: TEST_divergent_ec: for i in $osds 2026-02-17T05:33:42.068 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:298: TEST_divergent_ec: ceph osd down osd.2 2026-02-17T05:33:42.327 INFO:tasks.workunit.client.0.trial030.stderr:osd.2 is already down. 2026-02-17T05:33:42.337 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:300: TEST_divergent_ec: for i in $non_divergent 2026-02-17T05:33:42.337 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:302: TEST_divergent_ec: ceph osd out osd.0 2026-02-17T05:33:42.621 INFO:tasks.workunit.client.0.trial030.stderr:osd.0 is already out. 2026-02-17T05:33:42.632 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:300: TEST_divergent_ec: for i in $non_divergent 2026-02-17T05:33:42.632 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:302: TEST_divergent_ec: ceph osd out osd.2 2026-02-17T05:33:42.900 INFO:tasks.workunit.client.0.trial030.stderr:osd.2 is already out. 2026-02-17T05:33:42.910 INFO:tasks.workunit.client.0.trial030.stdout:bringing up non_divergent 0 2 2026-02-17T05:33:42.910 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:306: TEST_divergent_ec: echo 'bringing up non_divergent 0 2' 2026-02-17T05:33:42.910 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:307: TEST_divergent_ec: ceph pg dump pgs 2026-02-17T05:33:43.128 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T05:33:43.128 INFO:tasks.workunit.client.0.trial030.stdout:1.0 101 0 0 0 0 51712 0 0 14 90 14 stale+active+clean 2026-02-17T05:33:14.294835+0000 29'104 29:124 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:33:13.930101+0000 0'0 2026-02-17T05:33:13.930101+0000 0 0 periodic scrub scheduled @ 2026-02-18T14:10:51.398109+0000 0 0 2026-02-17T05:33:43.128 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-17T05:33:43.129 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T05:33:43.129 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:33:43.142 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:308: TEST_divergent_ec: for i in $non_divergent 2026-02-17T05:33:43.142 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:310: TEST_divergent_ec: activate_osd td/divergent-priors 0 2026-02-17T05:33:43.142 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-17T05:33:43.143 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T05:33:43.143 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T05:33:43.143 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T05:33:43.143 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/0 2026-02-17T05:33:43.143 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T05:33:43.143 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:33:43.143 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:33:43.143 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:33:43.143 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-17T05:33:43.143 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-17T05:33:43.143 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T05:33:43.143 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T05:33:43.144 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T05:33:43.144 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T05:33:43.144 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:33:43.144 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:33:43.144 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:33:43.144 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:33:43.144 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:33:43.144 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:33:43.144 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:33:43.144 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:33:43.144 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T05:33:43.144 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T05:33:43.145 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:33:43.145 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:33:43.145 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:33:43.145 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:33:43.145 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T05:33:43.145 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T05:33:43.145 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/0 2026-02-17T05:33:43.145 INFO:tasks.workunit.client.0.trial030.stdout:start osd.0 2026-02-17T05:33:43.146 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T05:33:43.147 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T05:33:43.147 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/0/whoami 2026-02-17T05:33:43.147 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T05:33:43.147 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T05:33:43.147 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T05:33:43.147 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T05:33:43.164 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:33:43.159+0000 7f1ca36e1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:33:43.166 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:33:43.159+0000 7f1ca36e1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:33:43.167 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:33:43.159+0000 7f1ca36e1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:33:43.360 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T05:33:43.361 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:33:43.361 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T05:33:43.361 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:33:43.361 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:33:43.361 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:33:43.361 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:33:43.362 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:33:43.362 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:33:43.362 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T05:33:43.542 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:33:43.535+0000 7f1ca36e1a40 -1 Falling back to public interface 2026-02-17T05:33:43.587 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:33:44.217 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:33:44.211+0000 7f1ca36e1a40 -1 osd.0 28 log_to_monitors true 2026-02-17T05:33:44.589 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:33:44.590 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:33:44.590 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-17T05:33:44.591 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T05:33:44.591 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:33:44.592 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T05:33:44.814 INFO:tasks.workunit.client.0.trial030.stdout:osd.0 up out weight 0 up_from 36 up_thru 0 down_at 30 last_clean_interval [5,28) [v2:127.0.0.1:6800/860338477,v1:127.0.0.1:6801/860338477] [v2:127.0.0.1:6802/860338477,v1:127.0.0.1:6803/860338477] exists,up ffd61780-fdee-492a-b89a-f0298d033d42 2026-02-17T05:33:44.817 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:33:44.817 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:33:44.817 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:33:44.817 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:308: TEST_divergent_ec: for i in $non_divergent 2026-02-17T05:33:44.817 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:310: TEST_divergent_ec: activate_osd td/divergent-priors 2 2026-02-17T05:33:44.818 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-17T05:33:44.818 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T05:33:44.818 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-17T05:33:44.818 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T05:33:44.818 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/2 2026-02-17T05:33:44.818 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T05:33:44.818 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:33:44.818 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:33:44.818 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:33:44.818 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-17T05:33:44.818 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-17T05:33:44.819 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T05:33:44.819 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T05:33:44.819 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T05:33:44.819 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T05:33:44.819 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:33:44.819 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:33:44.819 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:33:44.819 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:33:44.819 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:33:44.819 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:33:44.819 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:33:44.819 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:33:44.820 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T05:33:44.820 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T05:33:44.820 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:33:44.820 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:33:44.820 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:33:44.820 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:33:44.820 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T05:33:44.820 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T05:33:44.820 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/2 2026-02-17T05:33:44.821 INFO:tasks.workunit.client.0.trial030.stdout:start osd.2 2026-02-17T05:33:44.822 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-17T05:33:44.822 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T05:33:44.822 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/2/whoami 2026-02-17T05:33:44.822 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-17T05:33:44.822 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T05:33:44.822 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T05:33:44.822 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T05:33:44.840 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:33:44.835+0000 7f4c75e50a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:33:44.841 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:33:44.835+0000 7f4c75e50a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:33:44.843 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:33:44.835+0000 7f4c75e50a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:33:45.039 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-17T05:33:45.040 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:33:45.040 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T05:33:45.040 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:33:45.040 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:33:45.040 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:33:45.040 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:33:45.041 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:33:45.041 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:33:45.041 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T05:33:45.230 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:33:45.223+0000 7f4c75e50a40 -1 Falling back to public interface 2026-02-17T05:33:45.260 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:33:45.918 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:33:45.911+0000 7f4c75e50a40 -1 osd.2 28 log_to_monitors true 2026-02-17T05:33:46.261 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:33:46.261 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:33:46.262 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-17T05:33:46.262 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T05:33:46.262 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:33:46.262 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T05:33:46.476 INFO:tasks.workunit.client.0.trial030.stdout:osd.2 up out weight 0 up_from 39 up_thru 0 down_at 32 last_clean_interval [14,28) [v2:127.0.0.1:6810/2154342846,v1:127.0.0.1:6811/2154342846] [v2:127.0.0.1:6812/2154342846,v1:127.0.0.1:6813/2154342846] exists,up 09dea4cc-8ddf-4609-83f3-70b490de0aa5 2026-02-17T05:33:46.477 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:33:46.477 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:33:46.477 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:33:46.477 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:312: TEST_divergent_ec: for i in $non_divergent 2026-02-17T05:33:46.477 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:314: TEST_divergent_ec: ceph osd in osd.0 2026-02-17T05:33:46.724 INFO:tasks.workunit.client.0.trial030.stderr:osd.0 is already in. 2026-02-17T05:33:46.733 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:312: TEST_divergent_ec: for i in $non_divergent 2026-02-17T05:33:46.733 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:314: TEST_divergent_ec: ceph osd in osd.2 2026-02-17T05:33:47.028 INFO:tasks.workunit.client.0.trial030.stderr:osd.2 is already in. 2026-02-17T05:33:47.039 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:317: TEST_divergent_ec: sleep 5 2026-02-17T05:33:52.041 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:321: TEST_divergent_ec: expr 2 + 2 2026-02-17T05:33:52.042 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:321: TEST_divergent_ec: objname=existing_4 2026-02-17T05:33:52.042 INFO:tasks.workunit.client.0.trial030.stdout:writing non-divergent object existing_4 2026-02-17T05:33:52.043 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:322: TEST_divergent_ec: echo 'writing non-divergent object existing_4' 2026-02-17T05:33:52.043 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:323: TEST_divergent_ec: ceph pg dump pgs 2026-02-17T05:33:52.249 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T05:33:52.250 INFO:tasks.workunit.client.0.trial030.stdout:1.0 100 0 100 0 0 51200 0 0 16 84 16 active+undersized+degraded 2026-02-17T05:33:47.072675+0000 28'100 42:128 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-17T05:33:13.930101+0000 0'0 2026-02-17T05:33:13.930101+0000 0 0 periodic scrub scheduled @ 2026-02-18T14:45:08.260038+0000 0 0 2026-02-17T05:33:52.250 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-17T05:33:52.250 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T05:33:52.250 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:33:52.260 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:324: TEST_divergent_ec: rados -p test put existing_4 /tmp/tmp.4Jez8x74Q7 2026-02-17T05:33:52.284 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:325: TEST_divergent_ec: rm -f /tmp/tmp.4Jez8x74Q7 2026-02-17T05:33:52.285 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:327: TEST_divergent_ec: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-17T05:33:52.285 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:327: TEST_divergent_ec: wait_for_clean 2026-02-17T05:33:52.285 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T05:33:52.285 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T05:33:52.285 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T05:33:52.286 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-17T05:33:52.286 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T05:33:52.286 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T05:33:52.287 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T05:33:52.287 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T05:33:52.287 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T05:33:52.358 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-17T05:33:52.358 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T05:33:52.358 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T05:33:52.358 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T05:33:52.358 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T05:33:52.358 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:33:52.583 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:33:52.583 INFO:tasks.workunit.client.0.trial030.stderr:1 2026-02-17T05:33:52.583 INFO:tasks.workunit.client.0.trial030.stderr:2' 2026-02-17T05:33:52.583 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:33:52.583 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:33:52.584 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T05:33:52.663 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=154618822660 2026-02-17T05:33:52.663 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 154618822660 2026-02-17T05:33:52.664 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-154618822660' 2026-02-17T05:33:52.664 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:33:52.664 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T05:33:52.726 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-17T05:33:52.727 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: true 2026-02-17T05:33:52.727 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-17T05:33:52.727 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: continue 2026-02-17T05:33:52.727 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:33:52.727 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T05:33:52.804 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=167503724548 2026-02-17T05:33:52.805 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 167503724548 2026-02-17T05:33:52.805 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-154618822660 2-167503724548' 2026-02-17T05:33:52.805 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:33:52.805 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-154618822660 2026-02-17T05:33:52.805 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:33:52.807 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:33:52.807 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-154618822660 2026-02-17T05:33:52.807 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:33:52.809 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=154618822660 2026-02-17T05:33:52.809 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.0 seq 154618822660 2026-02-17T05:33:52.809 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 154618822660' 2026-02-17T05:33:52.809 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:33:53.032 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 154618822658 -lt 154618822660 2026-02-17T05:33:53.032 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:33:54.033 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T05:33:54.034 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:33:54.250 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 154618822660 -lt 154618822660 2026-02-17T05:33:54.251 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:33:54.251 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-167503724548 2026-02-17T05:33:54.251 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:33:54.252 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:33:54.253 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-167503724548 2026-02-17T05:33:54.253 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:33:54.254 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=167503724548 2026-02-17T05:33:54.254 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 167503724548' 2026-02-17T05:33:54.255 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.2 seq 167503724548 2026-02-17T05:33:54.256 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:33:54.475 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 167503724548 -lt 167503724548 2026-02-17T05:33:54.476 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T05:33:54.476 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:33:54.476 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:33:54.770 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T05:33:54.770 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:33:54.770 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:33:54.771 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:33:54.771 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:33:54.771 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:33:54.771 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:33:54.771 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:33:54.991 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:33:54.992 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:33:54.992 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:33:54.992 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:33:55.285 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T05:33:55.285 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-17T05:33:55.286 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-17T05:33:55.286 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-17T05:33:55.286 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T05:33:55.286 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-17T05:33:55.386 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T05:33:55.386 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:33:55.387 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:33:55.387 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:33:55.387 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:33:55.387 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:33:55.387 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:33:55.387 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:33:55.607 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:33:55.607 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:33:55.608 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:33:55.608 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:33:55.905 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T05:33:55.905 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T05:33:55.905 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T05:33:55.905 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T05:33:55.905 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T05:33:55.905 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T05:33:55.905 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T05:33:55.906 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T05:33:55.906 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T05:33:56.197 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T05:33:56.197 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T05:33:56.197 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-17T05:33:56.197 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T05:33:56.197 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-17T05:33:56.397 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T05:33:56.398 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:33:56.399 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:33:56.399 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:33:56.399 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:33:56.399 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:33:56.399 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:33:56.399 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:33:56.615 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:33:56.616 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:33:56.616 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:33:56.616 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:33:56.902 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T05:33:56.902 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T05:33:56.902 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T05:33:56.902 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T05:33:56.902 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T05:33:56.902 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T05:33:56.902 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T05:33:56.902 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T05:33:56.902 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T05:33:57.198 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T05:33:57.198 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T05:33:57.198 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-17T05:33:57.198 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T05:33:57.198 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-17T05:33:57.599 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T05:33:57.599 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:33:57.600 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:33:57.600 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:33:57.600 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:33:57.600 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:33:57.600 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:33:57.600 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:33:57.821 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:33:57.822 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:33:57.822 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:33:57.822 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:33:58.110 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T05:33:58.110 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T05:33:58.110 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T05:33:58.111 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T05:33:58.111 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T05:33:58.111 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T05:33:58.111 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T05:33:58.111 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T05:33:58.111 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T05:33:58.391 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T05:33:58.391 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T05:33:58.391 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-17T05:33:58.391 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T05:33:58.391 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-17T05:33:59.193 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T05:33:59.193 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:33:59.193 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:33:59.194 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:33:59.194 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:33:59.194 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:33:59.194 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:33:59.194 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:33:59.412 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:33:59.413 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:33:59.413 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:33:59.413 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:33:59.709 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T05:33:59.709 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T05:33:59.710 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T05:33:59.710 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T05:33:59.710 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T05:33:59.710 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T05:33:59.710 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T05:33:59.710 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T05:33:59.710 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T05:34:00.005 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T05:34:00.005 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T05:34:00.005 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-17T05:34:00.005 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T05:34:00.006 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-17T05:34:01.606 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T05:34:01.606 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:34:01.607 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:34:01.607 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:34:01.607 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:34:01.607 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:34:01.607 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:34:01.608 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:34:01.828 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:34:01.828 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:34:01.828 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:34:01.829 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:34:02.111 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T05:34:02.111 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T05:34:02.111 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T05:34:02.111 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T05:34:02.111 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T05:34:02.111 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T05:34:02.111 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T05:34:02.111 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T05:34:02.111 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T05:34:02.395 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T05:34:02.395 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T05:34:02.395 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-17T05:34:02.395 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T05:34:02.396 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-17T05:34:05.596 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T05:34:05.596 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:34:05.597 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:34:05.597 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:34:05.597 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:34:05.597 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:34:05.598 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:34:05.598 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:34:05.815 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:34:05.816 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:34:05.816 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:34:05.816 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:34:06.107 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T05:34:06.108 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T05:34:06.108 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T05:34:06.108 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T05:34:06.108 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T05:34:06.108 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T05:34:06.108 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T05:34:06.109 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T05:34:06.109 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T05:34:06.394 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T05:34:06.394 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T05:34:06.395 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-17T05:34:06.395 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T05:34:06.395 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-17T05:34:12.795 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T05:34:12.795 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:34:12.796 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:34:12.797 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:34:12.797 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:34:12.797 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:34:12.797 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:34:12.797 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:34:13.007 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:34:13.007 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:34:13.008 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:34:13.008 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:34:13.292 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T05:34:13.292 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T05:34:13.292 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T05:34:13.292 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T05:34:13.292 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T05:34:13.292 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T05:34:13.292 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T05:34:13.292 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T05:34:13.293 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T05:34:13.572 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T05:34:13.573 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T05:34:13.573 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-17T05:34:13.573 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T05:34:13.573 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-17T05:34:20.874 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T05:34:20.874 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:34:20.875 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:34:20.875 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:34:20.875 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:34:20.875 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:34:20.875 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:34:20.875 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:34:21.089 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:34:21.090 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:34:21.090 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:34:21.090 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:34:21.377 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T05:34:21.377 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T05:34:21.377 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T05:34:21.377 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T05:34:21.377 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T05:34:21.377 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T05:34:21.377 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T05:34:21.377 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T05:34:21.377 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T05:34:21.665 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T05:34:21.665 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T05:34:21.666 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-17T05:34:21.666 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-17T05:34:21.957 INFO:tasks.workunit.client.0.trial030.stdout:{ 2026-02-17T05:34:21.957 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_fingerprint": "f99118a8-d6a9-4e58-8abe-fc2fa4130dcd", 2026-02-17T05:34:21.957 INFO:tasks.workunit.client.0.trial030.stdout: "version": "20.3.0-5271-g32585015", 2026-02-17T05:34:21.957 INFO:tasks.workunit.client.0.trial030.stdout: "commit": "325850157d309f65985eea9ec9bb9f1d56726fee", 2026-02-17T05:34:21.957 INFO:tasks.workunit.client.0.trial030.stdout: "timestamp": "2026-02-17T05:34:21.954773+0000", 2026-02-17T05:34:21.958 INFO:tasks.workunit.client.0.trial030.stdout: "tag": "", 2026-02-17T05:34:21.958 INFO:tasks.workunit.client.0.trial030.stdout: "health": { 2026-02-17T05:34:21.958 INFO:tasks.workunit.client.0.trial030.stdout: "status": "HEALTH_WARN", 2026-02-17T05:34:21.958 INFO:tasks.workunit.client.0.trial030.stdout: "checks": { 2026-02-17T05:34:21.958 INFO:tasks.workunit.client.0.trial030.stdout: "OSDMAP_FLAGS": { 2026-02-17T05:34:21.958 INFO:tasks.workunit.client.0.trial030.stdout: "severity": "HEALTH_WARN", 2026-02-17T05:34:21.958 INFO:tasks.workunit.client.0.trial030.stdout: "summary": { 2026-02-17T05:34:21.958 INFO:tasks.workunit.client.0.trial030.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-17T05:34:21.958 INFO:tasks.workunit.client.0.trial030.stdout: "count": 17 2026-02-17T05:34:21.958 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.958 INFO:tasks.workunit.client.0.trial030.stdout: "detail": [], 2026-02-17T05:34:21.958 INFO:tasks.workunit.client.0.trial030.stdout: "muted": false 2026-02-17T05:34:21.958 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.958 INFO:tasks.workunit.client.0.trial030.stdout: "OSD_DOWN": { 2026-02-17T05:34:21.958 INFO:tasks.workunit.client.0.trial030.stdout: "severity": "HEALTH_WARN", 2026-02-17T05:34:21.958 INFO:tasks.workunit.client.0.trial030.stdout: "summary": { 2026-02-17T05:34:21.958 INFO:tasks.workunit.client.0.trial030.stdout: "message": "1 osds down", 2026-02-17T05:34:21.958 INFO:tasks.workunit.client.0.trial030.stdout: "count": 1 2026-02-17T05:34:21.958 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.958 INFO:tasks.workunit.client.0.trial030.stdout: "detail": [ 2026-02-17T05:34:21.958 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.959 INFO:tasks.workunit.client.0.trial030.stdout: "message": "osd.1 (root=default,host=trial030) is down" 2026-02-17T05:34:21.959 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:21.959 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:34:21.959 INFO:tasks.workunit.client.0.trial030.stdout: "muted": false 2026-02-17T05:34:21.959 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.959 INFO:tasks.workunit.client.0.trial030.stdout: "PG_DEGRADED": { 2026-02-17T05:34:21.959 INFO:tasks.workunit.client.0.trial030.stdout: "severity": "HEALTH_WARN", 2026-02-17T05:34:21.959 INFO:tasks.workunit.client.0.trial030.stdout: "summary": { 2026-02-17T05:34:21.959 INFO:tasks.workunit.client.0.trial030.stdout: "message": "Degraded data redundancy: 101/303 objects degraded (33.333%), 1 pg degraded", 2026-02-17T05:34:21.959 INFO:tasks.workunit.client.0.trial030.stdout: "count": 1 2026-02-17T05:34:21.959 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.959 INFO:tasks.workunit.client.0.trial030.stdout: "detail": [ 2026-02-17T05:34:21.959 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.959 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [NONE,0,2]" 2026-02-17T05:34:21.959 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:21.959 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:34:21.959 INFO:tasks.workunit.client.0.trial030.stdout: "muted": false 2026-02-17T05:34:21.959 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:21.959 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.959 INFO:tasks.workunit.client.0.trial030.stdout: "mutes": [] 2026-02-17T05:34:21.959 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.959 INFO:tasks.workunit.client.0.trial030.stdout: "monmap_first_committed": 1, 2026-02-17T05:34:21.960 INFO:tasks.workunit.client.0.trial030.stdout: "monmap_last_committed": 1, 2026-02-17T05:34:21.960 INFO:tasks.workunit.client.0.trial030.stdout: "monmap": { 2026-02-17T05:34:21.960 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 1, 2026-02-17T05:34:21.960 INFO:tasks.workunit.client.0.trial030.stdout: "fsid": "931b36d9-02d4-44f0-bc8b-c9190b7fdb00", 2026-02-17T05:34:21.960 INFO:tasks.workunit.client.0.trial030.stdout: "modified": "2026-02-17T05:33:01.522999Z", 2026-02-17T05:34:21.960 INFO:tasks.workunit.client.0.trial030.stdout: "created": "2026-02-17T05:33:01.522999Z", 2026-02-17T05:34:21.960 INFO:tasks.workunit.client.0.trial030.stdout: "min_mon_release": 20, 2026-02-17T05:34:21.960 INFO:tasks.workunit.client.0.trial030.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:34:21.960 INFO:tasks.workunit.client.0.trial030.stdout: "election_strategy": 1, 2026-02-17T05:34:21.960 INFO:tasks.workunit.client.0.trial030.stdout: "disallowed_leaders": "", 2026-02-17T05:34:21.960 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_mode": false, 2026-02-17T05:34:21.960 INFO:tasks.workunit.client.0.trial030.stdout: "tiebreaker_mon": "", 2026-02-17T05:34:21.960 INFO:tasks.workunit.client.0.trial030.stdout: "removed_ranks": "", 2026-02-17T05:34:21.960 INFO:tasks.workunit.client.0.trial030.stdout: "features": { 2026-02-17T05:34:21.960 INFO:tasks.workunit.client.0.trial030.stdout: "persistent": [ 2026-02-17T05:34:21.960 INFO:tasks.workunit.client.0.trial030.stdout: "kraken", 2026-02-17T05:34:21.960 INFO:tasks.workunit.client.0.trial030.stdout: "luminous", 2026-02-17T05:34:21.960 INFO:tasks.workunit.client.0.trial030.stdout: "mimic", 2026-02-17T05:34:21.960 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap-prune", 2026-02-17T05:34:21.960 INFO:tasks.workunit.client.0.trial030.stdout: "nautilus", 2026-02-17T05:34:21.960 INFO:tasks.workunit.client.0.trial030.stdout: "octopus", 2026-02-17T05:34:21.960 INFO:tasks.workunit.client.0.trial030.stdout: "pacific", 2026-02-17T05:34:21.961 INFO:tasks.workunit.client.0.trial030.stdout: "elector-pinging", 2026-02-17T05:34:21.961 INFO:tasks.workunit.client.0.trial030.stdout: "quincy", 2026-02-17T05:34:21.961 INFO:tasks.workunit.client.0.trial030.stdout: "reef", 2026-02-17T05:34:21.961 INFO:tasks.workunit.client.0.trial030.stdout: "squid", 2026-02-17T05:34:21.961 INFO:tasks.workunit.client.0.trial030.stdout: "tentacle", 2026-02-17T05:34:21.961 INFO:tasks.workunit.client.0.trial030.stdout: "nvmeof_beacon_diff" 2026-02-17T05:34:21.961 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:34:21.961 INFO:tasks.workunit.client.0.trial030.stdout: "optional": [] 2026-02-17T05:34:21.961 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.961 INFO:tasks.workunit.client.0.trial030.stdout: "mons": [ 2026-02-17T05:34:21.961 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.961 INFO:tasks.workunit.client.0.trial030.stdout: "rank": 0, 2026-02-17T05:34:21.961 INFO:tasks.workunit.client.0.trial030.stdout: "name": "a", 2026-02-17T05:34:21.961 INFO:tasks.workunit.client.0.trial030.stdout: "public_addrs": { 2026-02-17T05:34:21.961 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:34:21.961 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.961 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:34:21.961 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:7115", 2026-02-17T05:34:21.961 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 0 2026-02-17T05:34:21.961 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:21.961 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:34:21.961 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.961 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:7115/0", 2026-02-17T05:34:21.961 INFO:tasks.workunit.client.0.trial030.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-17T05:34:21.961 INFO:tasks.workunit.client.0.trial030.stdout: "priority": 0, 2026-02-17T05:34:21.961 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 0, 2026-02-17T05:34:21.962 INFO:tasks.workunit.client.0.trial030.stdout: "time_added": "2026-02-17T05:33:01:522997+0000", 2026-02-17T05:34:21.962 INFO:tasks.workunit.client.0.trial030.stdout: "crush_location": [] 2026-02-17T05:34:21.962 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:21.962 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:34:21.962 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.962 INFO:tasks.workunit.client.0.trial030.stdout: "quorum": [ 2026-02-17T05:34:21.962 INFO:tasks.workunit.client.0.trial030.stdout: 0 2026-02-17T05:34:21.962 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:34:21.962 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap": { 2026-02-17T05:34:21.962 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 42, 2026-02-17T05:34:21.962 INFO:tasks.workunit.client.0.trial030.stdout: "fsid": "931b36d9-02d4-44f0-bc8b-c9190b7fdb00", 2026-02-17T05:34:21.962 INFO:tasks.workunit.client.0.trial030.stdout: "created": "2026-02-17T05:33:01.611858+0000", 2026-02-17T05:34:21.962 INFO:tasks.workunit.client.0.trial030.stdout: "modified": "2026-02-17T05:33:47.068821+0000", 2026-02-17T05:34:21.962 INFO:tasks.workunit.client.0.trial030.stdout: "last_up_change": "2026-02-17T05:33:46.072160+0000", 2026-02-17T05:34:21.962 INFO:tasks.workunit.client.0.trial030.stdout: "last_in_change": "2026-02-17T05:33:46.966734+0000", 2026-02-17T05:34:21.962 INFO:tasks.workunit.client.0.trial030.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-17T05:34:21.962 INFO:tasks.workunit.client.0.trial030.stdout: "flags_num": 5800384, 2026-02-17T05:34:21.962 INFO:tasks.workunit.client.0.trial030.stdout: "flags_set": [ 2026-02-17T05:34:21.962 INFO:tasks.workunit.client.0.trial030.stdout: "nodown", 2026-02-17T05:34:21.962 INFO:tasks.workunit.client.0.trial030.stdout: "noin", 2026-02-17T05:34:21.962 INFO:tasks.workunit.client.0.trial030.stdout: "noout", 2026-02-17T05:34:21.962 INFO:tasks.workunit.client.0.trial030.stdout: "pglog_hardlimit", 2026-02-17T05:34:21.962 INFO:tasks.workunit.client.0.trial030.stdout: "purged_snapdirs", 2026-02-17T05:34:21.962 INFO:tasks.workunit.client.0.trial030.stdout: "recovery_deletes", 2026-02-17T05:34:21.963 INFO:tasks.workunit.client.0.trial030.stdout: "sortbitwise" 2026-02-17T05:34:21.963 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:34:21.963 INFO:tasks.workunit.client.0.trial030.stdout: "crush_version": 10, 2026-02-17T05:34:21.963 INFO:tasks.workunit.client.0.trial030.stdout: "full_ratio": 0.99000000953674316, 2026-02-17T05:34:21.963 INFO:tasks.workunit.client.0.trial030.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-17T05:34:21.963 INFO:tasks.workunit.client.0.trial030.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-17T05:34:21.963 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_snapshot": "", 2026-02-17T05:34:21.963 INFO:tasks.workunit.client.0.trial030.stdout: "pool_max": 1, 2026-02-17T05:34:21.963 INFO:tasks.workunit.client.0.trial030.stdout: "max_osd": 3, 2026-02-17T05:34:21.963 INFO:tasks.workunit.client.0.trial030.stdout: "require_min_compat_client": "luminous", 2026-02-17T05:34:21.963 INFO:tasks.workunit.client.0.trial030.stdout: "min_compat_client": "jewel", 2026-02-17T05:34:21.963 INFO:tasks.workunit.client.0.trial030.stdout: "require_osd_release": "tentacle", 2026-02-17T05:34:21.963 INFO:tasks.workunit.client.0.trial030.stdout: "allow_crimson": false, 2026-02-17T05:34:21.963 INFO:tasks.workunit.client.0.trial030.stdout: "pools": [ 2026-02-17T05:34:21.963 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.963 INFO:tasks.workunit.client.0.trial030.stdout: "pool": 1, 2026-02-17T05:34:21.963 INFO:tasks.workunit.client.0.trial030.stdout: "pool_name": "test", 2026-02-17T05:34:21.963 INFO:tasks.workunit.client.0.trial030.stdout: "create_time": "2026-02-17T05:33:13.835394+0000", 2026-02-17T05:34:21.963 INFO:tasks.workunit.client.0.trial030.stdout: "flags": 16389, 2026-02-17T05:34:21.963 INFO:tasks.workunit.client.0.trial030.stdout: "flags_names": "hashpspool,ec_overwrites,pool_snaps", 2026-02-17T05:34:21.963 INFO:tasks.workunit.client.0.trial030.stdout: "type": 3, 2026-02-17T05:34:21.963 INFO:tasks.workunit.client.0.trial030.stdout: "size": 3, 2026-02-17T05:34:21.963 INFO:tasks.workunit.client.0.trial030.stdout: "min_size": 2, 2026-02-17T05:34:21.963 INFO:tasks.workunit.client.0.trial030.stdout: "crush_rule": 1, 2026-02-17T05:34:21.964 INFO:tasks.workunit.client.0.trial030.stdout: "peering_crush_bucket_count": 0, 2026-02-17T05:34:21.964 INFO:tasks.workunit.client.0.trial030.stdout: "peering_crush_bucket_target": 0, 2026-02-17T05:34:21.964 INFO:tasks.workunit.client.0.trial030.stdout: "peering_crush_bucket_barrier": 0, 2026-02-17T05:34:21.964 INFO:tasks.workunit.client.0.trial030.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-17T05:34:21.964 INFO:tasks.workunit.client.0.trial030.stdout: "is_stretch_pool": false, 2026-02-17T05:34:21.964 INFO:tasks.workunit.client.0.trial030.stdout: "object_hash": 2, 2026-02-17T05:34:21.964 INFO:tasks.workunit.client.0.trial030.stdout: "pg_autoscale_mode": "off", 2026-02-17T05:34:21.964 INFO:tasks.workunit.client.0.trial030.stdout: "pg_num": 1, 2026-02-17T05:34:21.964 INFO:tasks.workunit.client.0.trial030.stdout: "pg_placement_num": 1, 2026-02-17T05:34:21.964 INFO:tasks.workunit.client.0.trial030.stdout: "pg_placement_num_target": 1, 2026-02-17T05:34:21.964 INFO:tasks.workunit.client.0.trial030.stdout: "pg_num_target": 1, 2026-02-17T05:34:21.964 INFO:tasks.workunit.client.0.trial030.stdout: "pg_num_pending": 1, 2026-02-17T05:34:21.964 INFO:tasks.workunit.client.0.trial030.stdout: "last_pg_merge_meta": { 2026-02-17T05:34:21.964 INFO:tasks.workunit.client.0.trial030.stdout: "source_pgid": "0.0", 2026-02-17T05:34:21.964 INFO:tasks.workunit.client.0.trial030.stdout: "ready_epoch": 0, 2026-02-17T05:34:21.964 INFO:tasks.workunit.client.0.trial030.stdout: "last_epoch_started": 0, 2026-02-17T05:34:21.964 INFO:tasks.workunit.client.0.trial030.stdout: "last_epoch_clean": 0, 2026-02-17T05:34:21.964 INFO:tasks.workunit.client.0.trial030.stdout: "source_version": "0'0", 2026-02-17T05:34:21.964 INFO:tasks.workunit.client.0.trial030.stdout: "target_version": "0'0" 2026-02-17T05:34:21.964 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.964 INFO:tasks.workunit.client.0.trial030.stdout: "last_change": "29", 2026-02-17T05:34:21.964 INFO:tasks.workunit.client.0.trial030.stdout: "last_force_op_resend": "0", 2026-02-17T05:34:21.964 INFO:tasks.workunit.client.0.trial030.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-17T05:34:21.964 INFO:tasks.workunit.client.0.trial030.stdout: "last_force_op_resend_preluminous": "0", 2026-02-17T05:34:21.964 INFO:tasks.workunit.client.0.trial030.stdout: "auid": 0, 2026-02-17T05:34:21.965 INFO:tasks.workunit.client.0.trial030.stdout: "snap_mode": "pool", 2026-02-17T05:34:21.965 INFO:tasks.workunit.client.0.trial030.stdout: "snap_seq": 1, 2026-02-17T05:34:21.965 INFO:tasks.workunit.client.0.trial030.stdout: "snap_epoch": 29, 2026-02-17T05:34:21.965 INFO:tasks.workunit.client.0.trial030.stdout: "pool_snaps": [ 2026-02-17T05:34:21.965 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.965 INFO:tasks.workunit.client.0.trial030.stdout: "snapid": 1, 2026-02-17T05:34:21.965 INFO:tasks.workunit.client.0.trial030.stdout: "stamp": "2026-02-17T05:33:31.057622+0000", 2026-02-17T05:34:21.965 INFO:tasks.workunit.client.0.trial030.stdout: "name": "snap1" 2026-02-17T05:34:21.965 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:21.965 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:34:21.965 INFO:tasks.workunit.client.0.trial030.stdout: "removed_snaps": "[]", 2026-02-17T05:34:21.965 INFO:tasks.workunit.client.0.trial030.stdout: "quota_max_bytes": 0, 2026-02-17T05:34:21.965 INFO:tasks.workunit.client.0.trial030.stdout: "quota_max_objects": 0, 2026-02-17T05:34:21.965 INFO:tasks.workunit.client.0.trial030.stdout: "tiers": [], 2026-02-17T05:34:21.965 INFO:tasks.workunit.client.0.trial030.stdout: "tier_of": -1, 2026-02-17T05:34:21.965 INFO:tasks.workunit.client.0.trial030.stdout: "read_tier": -1, 2026-02-17T05:34:21.965 INFO:tasks.workunit.client.0.trial030.stdout: "write_tier": -1, 2026-02-17T05:34:21.965 INFO:tasks.workunit.client.0.trial030.stdout: "cache_mode": "none", 2026-02-17T05:34:21.965 INFO:tasks.workunit.client.0.trial030.stdout: "target_max_bytes": 0, 2026-02-17T05:34:21.965 INFO:tasks.workunit.client.0.trial030.stdout: "target_max_objects": 0, 2026-02-17T05:34:21.965 INFO:tasks.workunit.client.0.trial030.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-17T05:34:21.965 INFO:tasks.workunit.client.0.trial030.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-17T05:34:21.965 INFO:tasks.workunit.client.0.trial030.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-17T05:34:21.966 INFO:tasks.workunit.client.0.trial030.stdout: "cache_min_flush_age": 0, 2026-02-17T05:34:21.966 INFO:tasks.workunit.client.0.trial030.stdout: "cache_min_evict_age": 0, 2026-02-17T05:34:21.966 INFO:tasks.workunit.client.0.trial030.stdout: "erasure_code_profile": "myprofile", 2026-02-17T05:34:21.966 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_params": { 2026-02-17T05:34:21.966 INFO:tasks.workunit.client.0.trial030.stdout: "type": "none" 2026-02-17T05:34:21.966 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.966 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_period": 0, 2026-02-17T05:34:21.966 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_count": 0, 2026-02-17T05:34:21.966 INFO:tasks.workunit.client.0.trial030.stdout: "use_gmt_hitset": true, 2026-02-17T05:34:21.966 INFO:tasks.workunit.client.0.trial030.stdout: "min_read_recency_for_promote": 0, 2026-02-17T05:34:21.966 INFO:tasks.workunit.client.0.trial030.stdout: "min_write_recency_for_promote": 0, 2026-02-17T05:34:21.966 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_grade_decay_rate": 0, 2026-02-17T05:34:21.966 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_search_last_n": 0, 2026-02-17T05:34:21.966 INFO:tasks.workunit.client.0.trial030.stdout: "grade_table": [], 2026-02-17T05:34:21.966 INFO:tasks.workunit.client.0.trial030.stdout: "stripe_width": 8192, 2026-02-17T05:34:21.966 INFO:tasks.workunit.client.0.trial030.stdout: "expected_num_objects": 0, 2026-02-17T05:34:21.966 INFO:tasks.workunit.client.0.trial030.stdout: "fast_read": false, 2026-02-17T05:34:21.966 INFO:tasks.workunit.client.0.trial030.stdout: "nonprimary_shards": "{}", 2026-02-17T05:34:21.966 INFO:tasks.workunit.client.0.trial030.stdout: "options": {}, 2026-02-17T05:34:21.966 INFO:tasks.workunit.client.0.trial030.stdout: "application_metadata": {} 2026-02-17T05:34:21.966 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:21.966 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:34:21.966 INFO:tasks.workunit.client.0.trial030.stdout: "osds": [ 2026-02-17T05:34:21.966 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.966 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 0, 2026-02-17T05:34:21.966 INFO:tasks.workunit.client.0.trial030.stdout: "uuid": "ffd61780-fdee-492a-b89a-f0298d033d42", 2026-02-17T05:34:21.967 INFO:tasks.workunit.client.0.trial030.stdout: "up": 1, 2026-02-17T05:34:21.967 INFO:tasks.workunit.client.0.trial030.stdout: "in": 1, 2026-02-17T05:34:21.967 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 1, 2026-02-17T05:34:21.967 INFO:tasks.workunit.client.0.trial030.stdout: "primary_affinity": 1, 2026-02-17T05:34:21.967 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_begin": 5, 2026-02-17T05:34:21.967 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_end": 28, 2026-02-17T05:34:21.967 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 36, 2026-02-17T05:34:21.967 INFO:tasks.workunit.client.0.trial030.stdout: "up_thru": 41, 2026-02-17T05:34:21.967 INFO:tasks.workunit.client.0.trial030.stdout: "down_at": 30, 2026-02-17T05:34:21.967 INFO:tasks.workunit.client.0.trial030.stdout: "lost_at": 0, 2026-02-17T05:34:21.967 INFO:tasks.workunit.client.0.trial030.stdout: "public_addrs": { 2026-02-17T05:34:21.967 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:34:21.967 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.967 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:34:21.967 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6800", 2026-02-17T05:34:21.967 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 860338477 2026-02-17T05:34:21.967 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.967 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.967 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:34:21.967 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6801", 2026-02-17T05:34:21.967 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 860338477 2026-02-17T05:34:21.967 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:21.967 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:34:21.967 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.967 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addrs": { 2026-02-17T05:34:21.967 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:34:21.967 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.967 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:34:21.967 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6802", 2026-02-17T05:34:21.968 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 860338477 2026-02-17T05:34:21.968 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.968 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.968 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:34:21.968 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6803", 2026-02-17T05:34:21.968 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 860338477 2026-02-17T05:34:21.968 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:21.968 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:34:21.968 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.968 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addrs": { 2026-02-17T05:34:21.968 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:34:21.968 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.968 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:34:21.968 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6806", 2026-02-17T05:34:21.968 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 860338477 2026-02-17T05:34:21.968 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.968 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.968 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:34:21.968 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6807", 2026-02-17T05:34:21.968 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 860338477 2026-02-17T05:34:21.968 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:21.968 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:34:21.968 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.968 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addrs": { 2026-02-17T05:34:21.968 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:34:21.968 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.968 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:34:21.968 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6804", 2026-02-17T05:34:21.968 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 860338477 2026-02-17T05:34:21.968 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.968 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.968 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:34:21.968 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6805", 2026-02-17T05:34:21.968 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 860338477 2026-02-17T05:34:21.969 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:21.969 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:34:21.969 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.969 INFO:tasks.workunit.client.0.trial030.stdout: "public_addr": "127.0.0.1:6801/860338477", 2026-02-17T05:34:21.969 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addr": "127.0.0.1:6803/860338477", 2026-02-17T05:34:21.969 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addr": "127.0.0.1:6807/860338477", 2026-02-17T05:34:21.969 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addr": "127.0.0.1:6805/860338477", 2026-02-17T05:34:21.969 INFO:tasks.workunit.client.0.trial030.stdout: "state": [ 2026-02-17T05:34:21.969 INFO:tasks.workunit.client.0.trial030.stdout: "exists", 2026-02-17T05:34:21.969 INFO:tasks.workunit.client.0.trial030.stdout: "up" 2026-02-17T05:34:21.969 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:34:21.969 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.969 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.969 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 1, 2026-02-17T05:34:21.969 INFO:tasks.workunit.client.0.trial030.stdout: "uuid": "66e43dc5-03ed-42cb-985e-85686a5152c5", 2026-02-17T05:34:21.969 INFO:tasks.workunit.client.0.trial030.stdout: "up": 0, 2026-02-17T05:34:21.969 INFO:tasks.workunit.client.0.trial030.stdout: "in": 1, 2026-02-17T05:34:21.969 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 1, 2026-02-17T05:34:21.969 INFO:tasks.workunit.client.0.trial030.stdout: "primary_affinity": 1, 2026-02-17T05:34:21.969 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_begin": 0, 2026-02-17T05:34:21.969 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_end": 0, 2026-02-17T05:34:21.969 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 9, 2026-02-17T05:34:21.969 INFO:tasks.workunit.client.0.trial030.stdout: "up_thru": 24, 2026-02-17T05:34:21.969 INFO:tasks.workunit.client.0.trial030.stdout: "down_at": 31, 2026-02-17T05:34:21.969 INFO:tasks.workunit.client.0.trial030.stdout: "lost_at": 0, 2026-02-17T05:34:21.969 INFO:tasks.workunit.client.0.trial030.stdout: "public_addrs": { 2026-02-17T05:34:21.969 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:34:21.969 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.969 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:34:21.969 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6810", 2026-02-17T05:34:21.969 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2668219398 2026-02-17T05:34:21.969 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.969 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.969 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:34:21.969 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6811", 2026-02-17T05:34:21.970 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2668219398 2026-02-17T05:34:21.970 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:21.970 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:34:21.970 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.970 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addrs": { 2026-02-17T05:34:21.970 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:34:21.970 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.970 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:34:21.970 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6812", 2026-02-17T05:34:21.970 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2668219398 2026-02-17T05:34:21.970 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.970 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.970 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:34:21.970 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6813", 2026-02-17T05:34:21.970 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2668219398 2026-02-17T05:34:21.970 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:21.970 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:34:21.970 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.970 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addrs": { 2026-02-17T05:34:21.970 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:34:21.970 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.970 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:34:21.970 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6816", 2026-02-17T05:34:21.970 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2668219398 2026-02-17T05:34:21.970 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.970 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.970 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:34:21.970 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6817", 2026-02-17T05:34:21.970 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2668219398 2026-02-17T05:34:21.970 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:21.970 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:34:21.970 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.970 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addrs": { 2026-02-17T05:34:21.971 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:34:21.971 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.971 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:34:21.971 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6814", 2026-02-17T05:34:21.971 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2668219398 2026-02-17T05:34:21.971 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.971 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.971 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:34:21.971 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6815", 2026-02-17T05:34:21.971 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2668219398 2026-02-17T05:34:21.971 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:21.971 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:34:21.971 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.971 INFO:tasks.workunit.client.0.trial030.stdout: "public_addr": "127.0.0.1:6811/2668219398", 2026-02-17T05:34:21.971 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addr": "127.0.0.1:6813/2668219398", 2026-02-17T05:34:21.971 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addr": "127.0.0.1:6817/2668219398", 2026-02-17T05:34:21.971 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addr": "127.0.0.1:6815/2668219398", 2026-02-17T05:34:21.971 INFO:tasks.workunit.client.0.trial030.stdout: "state": [ 2026-02-17T05:34:21.971 INFO:tasks.workunit.client.0.trial030.stdout: "exists" 2026-02-17T05:34:21.971 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:34:21.971 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.971 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.971 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2, 2026-02-17T05:34:21.971 INFO:tasks.workunit.client.0.trial030.stdout: "uuid": "09dea4cc-8ddf-4609-83f3-70b490de0aa5", 2026-02-17T05:34:21.971 INFO:tasks.workunit.client.0.trial030.stdout: "up": 1, 2026-02-17T05:34:21.971 INFO:tasks.workunit.client.0.trial030.stdout: "in": 1, 2026-02-17T05:34:21.971 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 1, 2026-02-17T05:34:21.971 INFO:tasks.workunit.client.0.trial030.stdout: "primary_affinity": 1, 2026-02-17T05:34:21.971 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_begin": 14, 2026-02-17T05:34:21.971 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_end": 28, 2026-02-17T05:34:21.971 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 39, 2026-02-17T05:34:21.971 INFO:tasks.workunit.client.0.trial030.stdout: "up_thru": 0, 2026-02-17T05:34:21.971 INFO:tasks.workunit.client.0.trial030.stdout: "down_at": 32, 2026-02-17T05:34:21.971 INFO:tasks.workunit.client.0.trial030.stdout: "lost_at": 0, 2026-02-17T05:34:21.971 INFO:tasks.workunit.client.0.trial030.stdout: "public_addrs": { 2026-02-17T05:34:21.971 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:34:21.971 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.971 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:34:21.971 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6810", 2026-02-17T05:34:21.971 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2154342846 2026-02-17T05:34:21.971 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.972 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.972 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:34:21.972 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6811", 2026-02-17T05:34:21.972 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2154342846 2026-02-17T05:34:21.972 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:21.972 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:34:21.972 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.972 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addrs": { 2026-02-17T05:34:21.972 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:34:21.972 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.972 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:34:21.972 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6812", 2026-02-17T05:34:21.972 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2154342846 2026-02-17T05:34:21.972 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.972 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.972 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:34:21.972 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6813", 2026-02-17T05:34:21.972 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2154342846 2026-02-17T05:34:21.972 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:21.972 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:34:21.972 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.972 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addrs": { 2026-02-17T05:34:21.972 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:34:21.972 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.972 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:34:21.972 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6816", 2026-02-17T05:34:21.972 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2154342846 2026-02-17T05:34:21.972 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.972 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.972 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:34:21.972 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6817", 2026-02-17T05:34:21.972 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2154342846 2026-02-17T05:34:21.972 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:21.972 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:34:21.972 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.972 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addrs": { 2026-02-17T05:34:21.972 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:34:21.972 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.972 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:34:21.972 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6814", 2026-02-17T05:34:21.972 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2154342846 2026-02-17T05:34:21.972 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.972 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.972 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:34:21.972 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6815", 2026-02-17T05:34:21.972 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2154342846 2026-02-17T05:34:21.972 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:21.973 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:34:21.973 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.973 INFO:tasks.workunit.client.0.trial030.stdout: "public_addr": "127.0.0.1:6811/2154342846", 2026-02-17T05:34:21.973 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addr": "127.0.0.1:6813/2154342846", 2026-02-17T05:34:21.973 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addr": "127.0.0.1:6817/2154342846", 2026-02-17T05:34:21.973 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addr": "127.0.0.1:6815/2154342846", 2026-02-17T05:34:21.973 INFO:tasks.workunit.client.0.trial030.stdout: "state": [ 2026-02-17T05:34:21.973 INFO:tasks.workunit.client.0.trial030.stdout: "exists", 2026-02-17T05:34:21.973 INFO:tasks.workunit.client.0.trial030.stdout: "up" 2026-02-17T05:34:21.973 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:34:21.973 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:21.973 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:34:21.973 INFO:tasks.workunit.client.0.trial030.stdout: "osd_xinfo": [ 2026-02-17T05:34:21.973 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.973 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 0, 2026-02-17T05:34:21.973 INFO:tasks.workunit.client.0.trial030.stdout: "down_stamp": "2026-02-17T05:33:41.696091+0000", 2026-02-17T05:34:21.973 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_probability": 0, 2026-02-17T05:34:21.973 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_interval": 0, 2026-02-17T05:34:21.973 INFO:tasks.workunit.client.0.trial030.stdout: "features": 4544132024016699391, 2026-02-17T05:34:21.973 INFO:tasks.workunit.client.0.trial030.stdout: "old_weight": 0, 2026-02-17T05:34:21.973 INFO:tasks.workunit.client.0.trial030.stdout: "last_purged_snaps_scrub": "2026-02-17T05:33:05.364715+0000", 2026-02-17T05:34:21.973 INFO:tasks.workunit.client.0.trial030.stdout: "dead_epoch": 0 2026-02-17T05:34:21.973 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.973 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.973 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 1, 2026-02-17T05:34:21.973 INFO:tasks.workunit.client.0.trial030.stdout: "down_stamp": "2026-02-17T05:33:42.001152+0000", 2026-02-17T05:34:21.973 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_probability": 0, 2026-02-17T05:34:21.973 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_interval": 0, 2026-02-17T05:34:21.973 INFO:tasks.workunit.client.0.trial030.stdout: "features": 4544132024016699391, 2026-02-17T05:34:21.973 INFO:tasks.workunit.client.0.trial030.stdout: "old_weight": 0, 2026-02-17T05:34:21.973 INFO:tasks.workunit.client.0.trial030.stdout: "last_purged_snaps_scrub": "2026-02-17T05:33:08.658208+0000", 2026-02-17T05:34:21.973 INFO:tasks.workunit.client.0.trial030.stdout: "dead_epoch": 0 2026-02-17T05:34:21.973 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.973 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.973 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2, 2026-02-17T05:34:21.973 INFO:tasks.workunit.client.0.trial030.stdout: "down_stamp": "2026-02-17T05:33:42.271497+0000", 2026-02-17T05:34:21.973 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_probability": 0, 2026-02-17T05:34:21.973 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_interval": 0, 2026-02-17T05:34:21.973 INFO:tasks.workunit.client.0.trial030.stdout: "features": 4544132024016699391, 2026-02-17T05:34:21.973 INFO:tasks.workunit.client.0.trial030.stdout: "old_weight": 0, 2026-02-17T05:34:21.973 INFO:tasks.workunit.client.0.trial030.stdout: "last_purged_snaps_scrub": "2026-02-17T05:33:11.611472+0000", 2026-02-17T05:34:21.973 INFO:tasks.workunit.client.0.trial030.stdout: "dead_epoch": 0 2026-02-17T05:34:21.973 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:21.973 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:34:21.973 INFO:tasks.workunit.client.0.trial030.stdout: "pg_upmap": [], 2026-02-17T05:34:21.973 INFO:tasks.workunit.client.0.trial030.stdout: "pg_upmap_items": [], 2026-02-17T05:34:21.974 INFO:tasks.workunit.client.0.trial030.stdout: "pg_upmap_primaries": [], 2026-02-17T05:34:21.974 INFO:tasks.workunit.client.0.trial030.stdout: "pg_temp": [], 2026-02-17T05:34:21.974 INFO:tasks.workunit.client.0.trial030.stdout: "primary_temp": [], 2026-02-17T05:34:21.974 INFO:tasks.workunit.client.0.trial030.stdout: "blocklist": {}, 2026-02-17T05:34:21.974 INFO:tasks.workunit.client.0.trial030.stdout: "range_blocklist": {}, 2026-02-17T05:34:21.974 INFO:tasks.workunit.client.0.trial030.stdout: "erasure_code_profiles": { 2026-02-17T05:34:21.974 INFO:tasks.workunit.client.0.trial030.stdout: "default": { 2026-02-17T05:34:21.974 INFO:tasks.workunit.client.0.trial030.stdout: "k": "2", 2026-02-17T05:34:21.974 INFO:tasks.workunit.client.0.trial030.stdout: "m": "2", 2026-02-17T05:34:21.974 INFO:tasks.workunit.client.0.trial030.stdout: "plugin": "isa", 2026-02-17T05:34:21.974 INFO:tasks.workunit.client.0.trial030.stdout: "technique": "reed_sol_van" 2026-02-17T05:34:21.974 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.974 INFO:tasks.workunit.client.0.trial030.stdout: "myprofile": { 2026-02-17T05:34:21.974 INFO:tasks.workunit.client.0.trial030.stdout: "crush-device-class": "", 2026-02-17T05:34:21.974 INFO:tasks.workunit.client.0.trial030.stdout: "crush-failure-domain": "osd", 2026-02-17T05:34:21.974 INFO:tasks.workunit.client.0.trial030.stdout: "crush-num-failure-domains": "0", 2026-02-17T05:34:21.974 INFO:tasks.workunit.client.0.trial030.stdout: "crush-osds-per-failure-domain": "0", 2026-02-17T05:34:21.974 INFO:tasks.workunit.client.0.trial030.stdout: "crush-root": "default", 2026-02-17T05:34:21.974 INFO:tasks.workunit.client.0.trial030.stdout: "k": "2", 2026-02-17T05:34:21.974 INFO:tasks.workunit.client.0.trial030.stdout: "m": "1", 2026-02-17T05:34:21.974 INFO:tasks.workunit.client.0.trial030.stdout: "plugin": "isa", 2026-02-17T05:34:21.974 INFO:tasks.workunit.client.0.trial030.stdout: "technique": "reed_sol_van" 2026-02-17T05:34:21.974 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:21.974 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.974 INFO:tasks.workunit.client.0.trial030.stdout: "removed_snaps_queue": [], 2026-02-17T05:34:21.974 INFO:tasks.workunit.client.0.trial030.stdout: "new_removed_snaps": [], 2026-02-17T05:34:21.974 INFO:tasks.workunit.client.0.trial030.stdout: "new_purged_snaps": [], 2026-02-17T05:34:21.974 INFO:tasks.workunit.client.0.trial030.stdout: "crush_node_flags": {}, 2026-02-17T05:34:21.974 INFO:tasks.workunit.client.0.trial030.stdout: "device_class_flags": {}, 2026-02-17T05:34:21.974 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_mode": { 2026-02-17T05:34:21.974 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_mode_enabled": false, 2026-02-17T05:34:21.974 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_bucket_count": 0, 2026-02-17T05:34:21.974 INFO:tasks.workunit.client.0.trial030.stdout: "degraded_stretch_mode": 0, 2026-02-17T05:34:21.974 INFO:tasks.workunit.client.0.trial030.stdout: "recovering_stretch_mode": 0, 2026-02-17T05:34:21.974 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_mode_bucket": 0 2026-02-17T05:34:21.974 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:21.974 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.974 INFO:tasks.workunit.client.0.trial030.stdout: "osd_metadata": [ 2026-02-17T05:34:21.974 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.974 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-17T05:34:21.974 INFO:tasks.workunit.client.0.trial030.stdout: "arch": "x86_64", 2026-02-17T05:34:21.974 INFO:tasks.workunit.client.0.trial030.stdout: "back_addr": "[v2:127.0.0.1:6802/860338477,v1:127.0.0.1:6803/860338477]", 2026-02-17T05:34:21.974 INFO:tasks.workunit.client.0.trial030.stdout: "back_iface": "", 2026-02-17T05:34:21.974 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs": "1", 2026-02-17T05:34:21.974 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_db": "0", 2026-02-17T05:34:21.974 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T05:34:21.974 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_single_shared_device": "1", 2026-02-17T05:34:21.975 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T05:34:21.975 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocator": "hybrid", 2026-02-17T05:34:21.975 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T05:34:21.975 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T05:34:21.975 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T05:34:21.975 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T05:34:21.975 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T05:34:21.975 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-17T05:34:21.975 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T05:34:21.975 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T05:34:21.975 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T05:34:21.975 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T05:34:21.975 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-17T05:34:21.975 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T05:34:21.975 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T05:34:21.975 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_write_mode": "classic", 2026-02-17T05:34:21.975 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_release": "tentacle", 2026-02-17T05:34:21.975 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version": "ceph version 20.3.0-5271-g32585015 (325850157d309f65985eea9ec9bb9f1d56726fee) tentacle (dev - None)", 2026-02-17T05:34:21.975 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_short": "20.3.0-5271-g32585015", 2026-02-17T05:34:21.975 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_when_created": "ceph version 20.3.0-5271-g32585015 (325850157d309f65985eea9ec9bb9f1d56726fee) tentacle (dev - None)", 2026-02-17T05:34:21.975 INFO:tasks.workunit.client.0.trial030.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T05:34:21.975 INFO:tasks.workunit.client.0.trial030.stdout: "created_at": "2026-02-17T05:33:02.547087Z", 2026-02-17T05:34:21.975 INFO:tasks.workunit.client.0.trial030.stdout: "default_device_class": "ssd", 2026-02-17T05:34:21.975 INFO:tasks.workunit.client.0.trial030.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6B65", 2026-02-17T05:34:21.975 INFO:tasks.workunit.client.0.trial030.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T05:34:21.975 INFO:tasks.workunit.client.0.trial030.stdout: "devices": "nvme0n1", 2026-02-17T05:34:21.975 INFO:tasks.workunit.client.0.trial030.stdout: "distro": "ubuntu", 2026-02-17T05:34:21.975 INFO:tasks.workunit.client.0.trial030.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T05:34:21.975 INFO:tasks.workunit.client.0.trial030.stdout: "distro_version": "22.04", 2026-02-17T05:34:21.975 INFO:tasks.workunit.client.0.trial030.stdout: "front_addr": "[v2:127.0.0.1:6800/860338477,v1:127.0.0.1:6801/860338477]", 2026-02-17T05:34:21.975 INFO:tasks.workunit.client.0.trial030.stdout: "front_iface": "", 2026-02-17T05:34:21.975 INFO:tasks.workunit.client.0.trial030.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/860338477,v1:127.0.0.1:6807/860338477]", 2026-02-17T05:34:21.975 INFO:tasks.workunit.client.0.trial030.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/860338477,v1:127.0.0.1:6805/860338477]", 2026-02-17T05:34:21.975 INFO:tasks.workunit.client.0.trial030.stdout: "hostname": "trial030", 2026-02-17T05:34:21.975 INFO:tasks.workunit.client.0.trial030.stdout: "journal_rotational": "0", 2026-02-17T05:34:21.975 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T05:34:21.975 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T05:34:21.975 INFO:tasks.workunit.client.0.trial030.stdout: "mem_swap_kb": "8388604", 2026-02-17T05:34:21.975 INFO:tasks.workunit.client.0.trial030.stdout: "mem_total_kb": "130961692", 2026-02-17T05:34:21.975 INFO:tasks.workunit.client.0.trial030.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T05:34:21.975 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_node": "0", 2026-02-17T05:34:21.975 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_nodes": "0", 2026-02-17T05:34:21.975 INFO:tasks.workunit.client.0.trial030.stdout: "os": "Linux", 2026-02-17T05:34:21.975 INFO:tasks.workunit.client.0.trial030.stdout: "osd_data": "td/divergent-priors/0", 2026-02-17T05:34:21.975 INFO:tasks.workunit.client.0.trial030.stdout: "osd_objectstore": "bluestore", 2026-02-17T05:34:21.975 INFO:tasks.workunit.client.0.trial030.stdout: "osdspec_affinity": "", 2026-02-17T05:34:21.975 INFO:tasks.workunit.client.0.trial030.stdout: "rotational": "0" 2026-02-17T05:34:21.976 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.976 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.976 INFO:tasks.workunit.client.0.trial030.stdout: "id": 1, 2026-02-17T05:34:21.976 INFO:tasks.workunit.client.0.trial030.stdout: "arch": "x86_64", 2026-02-17T05:34:21.976 INFO:tasks.workunit.client.0.trial030.stdout: "back_addr": "[v2:127.0.0.1:6812/2668219398,v1:127.0.0.1:6813/2668219398]", 2026-02-17T05:34:21.976 INFO:tasks.workunit.client.0.trial030.stdout: "back_iface": "", 2026-02-17T05:34:21.976 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs": "1", 2026-02-17T05:34:21.976 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_db": "0", 2026-02-17T05:34:21.976 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T05:34:21.976 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_single_shared_device": "1", 2026-02-17T05:34:21.976 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T05:34:21.976 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocator": "hybrid", 2026-02-17T05:34:21.976 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T05:34:21.976 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T05:34:21.976 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T05:34:21.976 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T05:34:21.976 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T05:34:21.976 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-17T05:34:21.976 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T05:34:21.976 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T05:34:21.976 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T05:34:21.976 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T05:34:21.976 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-17T05:34:21.976 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T05:34:21.976 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T05:34:21.976 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_write_mode": "classic", 2026-02-17T05:34:21.976 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_release": "tentacle", 2026-02-17T05:34:21.976 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version": "ceph version 20.3.0-5271-g32585015 (325850157d309f65985eea9ec9bb9f1d56726fee) tentacle (dev - None)", 2026-02-17T05:34:21.976 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_short": "20.3.0-5271-g32585015", 2026-02-17T05:34:21.976 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_when_created": "ceph version 20.3.0-5271-g32585015 (325850157d309f65985eea9ec9bb9f1d56726fee) tentacle (dev - None)", 2026-02-17T05:34:21.976 INFO:tasks.workunit.client.0.trial030.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T05:34:21.976 INFO:tasks.workunit.client.0.trial030.stdout: "created_at": "2026-02-17T05:33:06.264025Z", 2026-02-17T05:34:21.976 INFO:tasks.workunit.client.0.trial030.stdout: "default_device_class": "ssd", 2026-02-17T05:34:21.976 INFO:tasks.workunit.client.0.trial030.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6B65", 2026-02-17T05:34:21.976 INFO:tasks.workunit.client.0.trial030.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T05:34:21.976 INFO:tasks.workunit.client.0.trial030.stdout: "devices": "nvme0n1", 2026-02-17T05:34:21.976 INFO:tasks.workunit.client.0.trial030.stdout: "distro": "ubuntu", 2026-02-17T05:34:21.976 INFO:tasks.workunit.client.0.trial030.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T05:34:21.976 INFO:tasks.workunit.client.0.trial030.stdout: "distro_version": "22.04", 2026-02-17T05:34:21.976 INFO:tasks.workunit.client.0.trial030.stdout: "front_addr": "[v2:127.0.0.1:6810/2668219398,v1:127.0.0.1:6811/2668219398]", 2026-02-17T05:34:21.976 INFO:tasks.workunit.client.0.trial030.stdout: "front_iface": "", 2026-02-17T05:34:21.976 INFO:tasks.workunit.client.0.trial030.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/2668219398,v1:127.0.0.1:6817/2668219398]", 2026-02-17T05:34:21.976 INFO:tasks.workunit.client.0.trial030.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/2668219398,v1:127.0.0.1:6815/2668219398]", 2026-02-17T05:34:21.976 INFO:tasks.workunit.client.0.trial030.stdout: "hostname": "trial030", 2026-02-17T05:34:21.976 INFO:tasks.workunit.client.0.trial030.stdout: "journal_rotational": "0", 2026-02-17T05:34:21.976 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T05:34:21.976 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T05:34:21.976 INFO:tasks.workunit.client.0.trial030.stdout: "mem_swap_kb": "8388604", 2026-02-17T05:34:21.977 INFO:tasks.workunit.client.0.trial030.stdout: "mem_total_kb": "130961692", 2026-02-17T05:34:21.977 INFO:tasks.workunit.client.0.trial030.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T05:34:21.977 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_node": "0", 2026-02-17T05:34:21.977 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_nodes": "0", 2026-02-17T05:34:21.977 INFO:tasks.workunit.client.0.trial030.stdout: "os": "Linux", 2026-02-17T05:34:21.977 INFO:tasks.workunit.client.0.trial030.stdout: "osd_data": "td/divergent-priors/1", 2026-02-17T05:34:21.977 INFO:tasks.workunit.client.0.trial030.stdout: "osd_objectstore": "bluestore", 2026-02-17T05:34:21.977 INFO:tasks.workunit.client.0.trial030.stdout: "osdspec_affinity": "", 2026-02-17T05:34:21.977 INFO:tasks.workunit.client.0.trial030.stdout: "rotational": "0" 2026-02-17T05:34:21.977 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.977 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.977 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-17T05:34:21.977 INFO:tasks.workunit.client.0.trial030.stdout: "arch": "x86_64", 2026-02-17T05:34:21.977 INFO:tasks.workunit.client.0.trial030.stdout: "back_addr": "[v2:127.0.0.1:6812/2154342846,v1:127.0.0.1:6813/2154342846]", 2026-02-17T05:34:21.977 INFO:tasks.workunit.client.0.trial030.stdout: "back_iface": "", 2026-02-17T05:34:21.977 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs": "1", 2026-02-17T05:34:21.977 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_db": "0", 2026-02-17T05:34:21.977 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T05:34:21.977 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_single_shared_device": "1", 2026-02-17T05:34:21.977 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T05:34:21.977 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocator": "hybrid", 2026-02-17T05:34:21.977 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T05:34:21.977 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T05:34:21.977 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T05:34:21.977 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T05:34:21.977 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T05:34:21.977 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-17T05:34:21.977 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T05:34:21.977 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T05:34:21.977 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T05:34:21.977 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T05:34:21.977 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-17T05:34:21.977 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T05:34:21.977 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T05:34:21.977 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_write_mode": "classic", 2026-02-17T05:34:21.977 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_release": "tentacle", 2026-02-17T05:34:21.977 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version": "ceph version 20.3.0-5271-g32585015 (325850157d309f65985eea9ec9bb9f1d56726fee) tentacle (dev - None)", 2026-02-17T05:34:21.977 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_short": "20.3.0-5271-g32585015", 2026-02-17T05:34:21.977 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_when_created": "ceph version 20.3.0-5271-g32585015 (325850157d309f65985eea9ec9bb9f1d56726fee) tentacle (dev - None)", 2026-02-17T05:34:21.977 INFO:tasks.workunit.client.0.trial030.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T05:34:21.977 INFO:tasks.workunit.client.0.trial030.stdout: "created_at": "2026-02-17T05:33:09.137649Z", 2026-02-17T05:34:21.977 INFO:tasks.workunit.client.0.trial030.stdout: "default_device_class": "ssd", 2026-02-17T05:34:21.977 INFO:tasks.workunit.client.0.trial030.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6B65", 2026-02-17T05:34:21.977 INFO:tasks.workunit.client.0.trial030.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T05:34:21.977 INFO:tasks.workunit.client.0.trial030.stdout: "devices": "nvme0n1", 2026-02-17T05:34:21.977 INFO:tasks.workunit.client.0.trial030.stdout: "distro": "ubuntu", 2026-02-17T05:34:21.978 INFO:tasks.workunit.client.0.trial030.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T05:34:21.978 INFO:tasks.workunit.client.0.trial030.stdout: "distro_version": "22.04", 2026-02-17T05:34:21.978 INFO:tasks.workunit.client.0.trial030.stdout: "front_addr": "[v2:127.0.0.1:6810/2154342846,v1:127.0.0.1:6811/2154342846]", 2026-02-17T05:34:21.978 INFO:tasks.workunit.client.0.trial030.stdout: "front_iface": "", 2026-02-17T05:34:21.978 INFO:tasks.workunit.client.0.trial030.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/2154342846,v1:127.0.0.1:6817/2154342846]", 2026-02-17T05:34:21.978 INFO:tasks.workunit.client.0.trial030.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/2154342846,v1:127.0.0.1:6815/2154342846]", 2026-02-17T05:34:21.978 INFO:tasks.workunit.client.0.trial030.stdout: "hostname": "trial030", 2026-02-17T05:34:21.978 INFO:tasks.workunit.client.0.trial030.stdout: "journal_rotational": "0", 2026-02-17T05:34:21.978 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T05:34:21.978 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T05:34:21.978 INFO:tasks.workunit.client.0.trial030.stdout: "mem_swap_kb": "8388604", 2026-02-17T05:34:21.978 INFO:tasks.workunit.client.0.trial030.stdout: "mem_total_kb": "130961692", 2026-02-17T05:34:21.978 INFO:tasks.workunit.client.0.trial030.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T05:34:21.978 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_node": "0", 2026-02-17T05:34:21.978 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_nodes": "0", 2026-02-17T05:34:21.978 INFO:tasks.workunit.client.0.trial030.stdout: "os": "Linux", 2026-02-17T05:34:21.978 INFO:tasks.workunit.client.0.trial030.stdout: "osd_data": "td/divergent-priors/2", 2026-02-17T05:34:21.978 INFO:tasks.workunit.client.0.trial030.stdout: "osd_objectstore": "bluestore", 2026-02-17T05:34:21.978 INFO:tasks.workunit.client.0.trial030.stdout: "osdspec_affinity": "", 2026-02-17T05:34:21.978 INFO:tasks.workunit.client.0.trial030.stdout: "rotational": "0" 2026-02-17T05:34:21.978 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:21.978 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:34:21.978 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap_clean_epochs": { 2026-02-17T05:34:21.978 INFO:tasks.workunit.client.0.trial030.stdout: "min_last_epoch_clean": 0, 2026-02-17T05:34:21.978 INFO:tasks.workunit.client.0.trial030.stdout: "last_epoch_clean": { 2026-02-17T05:34:21.978 INFO:tasks.workunit.client.0.trial030.stdout: "per_pool": [] 2026-02-17T05:34:21.978 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.978 INFO:tasks.workunit.client.0.trial030.stdout: "osd_epochs": [ 2026-02-17T05:34:21.978 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.978 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-17T05:34:21.978 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 36 2026-02-17T05:34:21.978 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.978 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.978 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-17T05:34:21.978 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 40 2026-02-17T05:34:21.978 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:21.978 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:34:21.978 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.978 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap_first_committed": 1, 2026-02-17T05:34:21.978 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap_last_committed": 42, 2026-02-17T05:34:21.978 INFO:tasks.workunit.client.0.trial030.stdout: "crushmap": { 2026-02-17T05:34:21.978 INFO:tasks.workunit.client.0.trial030.stdout: "devices": [ 2026-02-17T05:34:21.978 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.978 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-17T05:34:21.978 INFO:tasks.workunit.client.0.trial030.stdout: "name": "osd.0", 2026-02-17T05:34:21.978 INFO:tasks.workunit.client.0.trial030.stdout: "class": "ssd" 2026-02-17T05:34:21.978 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.979 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.979 INFO:tasks.workunit.client.0.trial030.stdout: "id": 1, 2026-02-17T05:34:21.979 INFO:tasks.workunit.client.0.trial030.stdout: "name": "osd.1", 2026-02-17T05:34:21.979 INFO:tasks.workunit.client.0.trial030.stdout: "class": "ssd" 2026-02-17T05:34:21.979 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.979 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.979 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-17T05:34:21.979 INFO:tasks.workunit.client.0.trial030.stdout: "name": "osd.2", 2026-02-17T05:34:21.979 INFO:tasks.workunit.client.0.trial030.stdout: "class": "ssd" 2026-02-17T05:34:21.979 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:21.979 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:34:21.979 INFO:tasks.workunit.client.0.trial030.stdout: "types": [ 2026-02-17T05:34:21.979 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.979 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 0, 2026-02-17T05:34:21.979 INFO:tasks.workunit.client.0.trial030.stdout: "name": "osd" 2026-02-17T05:34:21.979 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.979 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.979 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 1, 2026-02-17T05:34:21.979 INFO:tasks.workunit.client.0.trial030.stdout: "name": "host" 2026-02-17T05:34:21.979 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.979 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.979 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 2, 2026-02-17T05:34:21.979 INFO:tasks.workunit.client.0.trial030.stdout: "name": "chassis" 2026-02-17T05:34:21.979 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.979 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.979 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 3, 2026-02-17T05:34:21.979 INFO:tasks.workunit.client.0.trial030.stdout: "name": "rack" 2026-02-17T05:34:21.979 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.979 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.979 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 4, 2026-02-17T05:34:21.979 INFO:tasks.workunit.client.0.trial030.stdout: "name": "row" 2026-02-17T05:34:21.979 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.979 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.979 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 5, 2026-02-17T05:34:21.979 INFO:tasks.workunit.client.0.trial030.stdout: "name": "pdu" 2026-02-17T05:34:21.979 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.979 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.979 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 6, 2026-02-17T05:34:21.979 INFO:tasks.workunit.client.0.trial030.stdout: "name": "pod" 2026-02-17T05:34:21.979 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.979 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.979 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 7, 2026-02-17T05:34:21.979 INFO:tasks.workunit.client.0.trial030.stdout: "name": "room" 2026-02-17T05:34:21.979 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.979 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.979 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 8, 2026-02-17T05:34:21.980 INFO:tasks.workunit.client.0.trial030.stdout: "name": "datacenter" 2026-02-17T05:34:21.980 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.980 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.980 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 9, 2026-02-17T05:34:21.980 INFO:tasks.workunit.client.0.trial030.stdout: "name": "zone" 2026-02-17T05:34:21.980 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.980 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.980 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 10, 2026-02-17T05:34:21.980 INFO:tasks.workunit.client.0.trial030.stdout: "name": "region" 2026-02-17T05:34:21.980 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.980 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.980 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 11, 2026-02-17T05:34:21.980 INFO:tasks.workunit.client.0.trial030.stdout: "name": "root" 2026-02-17T05:34:21.980 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:21.980 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:34:21.980 INFO:tasks.workunit.client.0.trial030.stdout: "buckets": [ 2026-02-17T05:34:21.980 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.980 INFO:tasks.workunit.client.0.trial030.stdout: "id": -1, 2026-02-17T05:34:21.980 INFO:tasks.workunit.client.0.trial030.stdout: "name": "default", 2026-02-17T05:34:21.980 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 11, 2026-02-17T05:34:21.980 INFO:tasks.workunit.client.0.trial030.stdout: "type_name": "root", 2026-02-17T05:34:21.980 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-17T05:34:21.980 INFO:tasks.workunit.client.0.trial030.stdout: "alg": "straw2", 2026-02-17T05:34:21.980 INFO:tasks.workunit.client.0.trial030.stdout: "hash": "rjenkins1", 2026-02-17T05:34:21.980 INFO:tasks.workunit.client.0.trial030.stdout: "items": [ 2026-02-17T05:34:21.980 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.980 INFO:tasks.workunit.client.0.trial030.stdout: "id": -3, 2026-02-17T05:34:21.980 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-17T05:34:21.980 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 0 2026-02-17T05:34:21.980 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:21.980 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:34:21.980 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.980 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.980 INFO:tasks.workunit.client.0.trial030.stdout: "id": -2, 2026-02-17T05:34:21.980 INFO:tasks.workunit.client.0.trial030.stdout: "name": "default~ssd", 2026-02-17T05:34:21.980 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 11, 2026-02-17T05:34:21.980 INFO:tasks.workunit.client.0.trial030.stdout: "type_name": "root", 2026-02-17T05:34:21.980 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-17T05:34:21.980 INFO:tasks.workunit.client.0.trial030.stdout: "alg": "straw2", 2026-02-17T05:34:21.980 INFO:tasks.workunit.client.0.trial030.stdout: "hash": "rjenkins1", 2026-02-17T05:34:21.980 INFO:tasks.workunit.client.0.trial030.stdout: "items": [ 2026-02-17T05:34:21.980 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.980 INFO:tasks.workunit.client.0.trial030.stdout: "id": -4, 2026-02-17T05:34:21.980 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-17T05:34:21.980 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 0 2026-02-17T05:34:21.980 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:21.981 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:34:21.981 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.981 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.981 INFO:tasks.workunit.client.0.trial030.stdout: "id": -3, 2026-02-17T05:34:21.981 INFO:tasks.workunit.client.0.trial030.stdout: "name": "trial030", 2026-02-17T05:34:21.981 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 1, 2026-02-17T05:34:21.981 INFO:tasks.workunit.client.0.trial030.stdout: "type_name": "host", 2026-02-17T05:34:21.981 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-17T05:34:21.981 INFO:tasks.workunit.client.0.trial030.stdout: "alg": "straw2", 2026-02-17T05:34:21.981 INFO:tasks.workunit.client.0.trial030.stdout: "hash": "rjenkins1", 2026-02-17T05:34:21.981 INFO:tasks.workunit.client.0.trial030.stdout: "items": [ 2026-02-17T05:34:21.981 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.981 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-17T05:34:21.981 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-17T05:34:21.981 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 0 2026-02-17T05:34:21.981 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.981 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.981 INFO:tasks.workunit.client.0.trial030.stdout: "id": 1, 2026-02-17T05:34:21.981 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-17T05:34:21.981 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 1 2026-02-17T05:34:21.981 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.981 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.981 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-17T05:34:21.981 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-17T05:34:21.981 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 2 2026-02-17T05:34:21.981 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:21.981 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:34:21.981 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.981 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.981 INFO:tasks.workunit.client.0.trial030.stdout: "id": -4, 2026-02-17T05:34:21.981 INFO:tasks.workunit.client.0.trial030.stdout: "name": "trial030~ssd", 2026-02-17T05:34:21.981 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 1, 2026-02-17T05:34:21.981 INFO:tasks.workunit.client.0.trial030.stdout: "type_name": "host", 2026-02-17T05:34:21.981 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-17T05:34:21.981 INFO:tasks.workunit.client.0.trial030.stdout: "alg": "straw2", 2026-02-17T05:34:21.981 INFO:tasks.workunit.client.0.trial030.stdout: "hash": "rjenkins1", 2026-02-17T05:34:21.981 INFO:tasks.workunit.client.0.trial030.stdout: "items": [ 2026-02-17T05:34:21.981 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.981 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-17T05:34:21.981 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-17T05:34:21.981 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 0 2026-02-17T05:34:21.981 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.981 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.981 INFO:tasks.workunit.client.0.trial030.stdout: "id": 1, 2026-02-17T05:34:21.981 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-17T05:34:21.981 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 1 2026-02-17T05:34:21.981 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.981 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.982 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-17T05:34:21.982 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-17T05:34:21.982 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 2 2026-02-17T05:34:21.982 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:21.982 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:34:21.982 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:21.982 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:34:21.982 INFO:tasks.workunit.client.0.trial030.stdout: "rules": [ 2026-02-17T05:34:21.982 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.982 INFO:tasks.workunit.client.0.trial030.stdout: "rule_id": 0, 2026-02-17T05:34:21.982 INFO:tasks.workunit.client.0.trial030.stdout: "rule_name": "replicated_rule", 2026-02-17T05:34:21.982 INFO:tasks.workunit.client.0.trial030.stdout: "type": 1, 2026-02-17T05:34:21.982 INFO:tasks.workunit.client.0.trial030.stdout: "steps": [ 2026-02-17T05:34:21.982 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.982 INFO:tasks.workunit.client.0.trial030.stdout: "op": "take", 2026-02-17T05:34:21.982 INFO:tasks.workunit.client.0.trial030.stdout: "item": -1, 2026-02-17T05:34:21.982 INFO:tasks.workunit.client.0.trial030.stdout: "item_name": "default" 2026-02-17T05:34:21.982 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.982 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.982 INFO:tasks.workunit.client.0.trial030.stdout: "op": "choose_firstn", 2026-02-17T05:34:21.982 INFO:tasks.workunit.client.0.trial030.stdout: "num": 0, 2026-02-17T05:34:21.982 INFO:tasks.workunit.client.0.trial030.stdout: "type": "osd" 2026-02-17T05:34:21.982 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.982 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.982 INFO:tasks.workunit.client.0.trial030.stdout: "op": "emit" 2026-02-17T05:34:21.982 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:21.982 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:34:21.982 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.982 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.982 INFO:tasks.workunit.client.0.trial030.stdout: "rule_id": 1, 2026-02-17T05:34:21.982 INFO:tasks.workunit.client.0.trial030.stdout: "rule_name": "test", 2026-02-17T05:34:21.982 INFO:tasks.workunit.client.0.trial030.stdout: "type": 3, 2026-02-17T05:34:21.982 INFO:tasks.workunit.client.0.trial030.stdout: "steps": [ 2026-02-17T05:34:21.982 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.982 INFO:tasks.workunit.client.0.trial030.stdout: "op": "set_chooseleaf_tries", 2026-02-17T05:34:21.982 INFO:tasks.workunit.client.0.trial030.stdout: "num": 5 2026-02-17T05:34:21.982 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.982 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.983 INFO:tasks.workunit.client.0.trial030.stderr:report 2901435465 2026-02-17T05:34:21.983 INFO:tasks.workunit.client.0.trial030.stdout: "op": "set_choose_tries", 2026-02-17T05:34:21.983 INFO:tasks.workunit.client.0.trial030.stdout: "num": 100 2026-02-17T05:34:21.983 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.983 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.983 INFO:tasks.workunit.client.0.trial030.stdout: "op": "take", 2026-02-17T05:34:21.983 INFO:tasks.workunit.client.0.trial030.stdout: "item": -1, 2026-02-17T05:34:21.983 INFO:tasks.workunit.client.0.trial030.stdout: "item_name": "default" 2026-02-17T05:34:21.983 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.983 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.983 INFO:tasks.workunit.client.0.trial030.stdout: "op": "choose_indep", 2026-02-17T05:34:21.983 INFO:tasks.workunit.client.0.trial030.stdout: "num": 0, 2026-02-17T05:34:21.983 INFO:tasks.workunit.client.0.trial030.stdout: "type": "osd" 2026-02-17T05:34:21.983 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.983 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.983 INFO:tasks.workunit.client.0.trial030.stdout: "op": "emit" 2026-02-17T05:34:21.983 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:21.983 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:34:21.983 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:21.983 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:34:21.983 INFO:tasks.workunit.client.0.trial030.stdout: "tunables": { 2026-02-17T05:34:21.983 INFO:tasks.workunit.client.0.trial030.stdout: "choose_local_tries": 0, 2026-02-17T05:34:21.983 INFO:tasks.workunit.client.0.trial030.stdout: "choose_local_fallback_tries": 0, 2026-02-17T05:34:21.983 INFO:tasks.workunit.client.0.trial030.stdout: "choose_total_tries": 50, 2026-02-17T05:34:21.983 INFO:tasks.workunit.client.0.trial030.stdout: "chooseleaf_descend_once": 1, 2026-02-17T05:34:21.983 INFO:tasks.workunit.client.0.trial030.stdout: "chooseleaf_vary_r": 1, 2026-02-17T05:34:21.983 INFO:tasks.workunit.client.0.trial030.stdout: "chooseleaf_stable": 1, 2026-02-17T05:34:21.983 INFO:tasks.workunit.client.0.trial030.stdout: "msr_descents": 100, 2026-02-17T05:34:21.984 INFO:tasks.workunit.client.0.trial030.stdout: "msr_collision_tries": 100, 2026-02-17T05:34:21.984 INFO:tasks.workunit.client.0.trial030.stdout: "straw_calc_version": 1, 2026-02-17T05:34:21.984 INFO:tasks.workunit.client.0.trial030.stdout: "allowed_bucket_algs": 54, 2026-02-17T05:34:21.984 INFO:tasks.workunit.client.0.trial030.stdout: "profile": "jewel", 2026-02-17T05:34:21.984 INFO:tasks.workunit.client.0.trial030.stdout: "optimal_tunables": 1, 2026-02-17T05:34:21.984 INFO:tasks.workunit.client.0.trial030.stdout: "legacy_tunables": 0, 2026-02-17T05:34:21.984 INFO:tasks.workunit.client.0.trial030.stdout: "minimum_required_version": "jewel", 2026-02-17T05:34:21.984 INFO:tasks.workunit.client.0.trial030.stdout: "require_feature_tunables": 1, 2026-02-17T05:34:21.984 INFO:tasks.workunit.client.0.trial030.stdout: "require_feature_tunables2": 1, 2026-02-17T05:34:21.984 INFO:tasks.workunit.client.0.trial030.stdout: "has_v2_rules": 1, 2026-02-17T05:34:21.984 INFO:tasks.workunit.client.0.trial030.stdout: "require_feature_tunables3": 1, 2026-02-17T05:34:21.984 INFO:tasks.workunit.client.0.trial030.stdout: "has_v3_rules": 0, 2026-02-17T05:34:21.984 INFO:tasks.workunit.client.0.trial030.stdout: "has_v4_buckets": 1, 2026-02-17T05:34:21.984 INFO:tasks.workunit.client.0.trial030.stdout: "require_feature_tunables5": 1, 2026-02-17T05:34:21.984 INFO:tasks.workunit.client.0.trial030.stdout: "has_v5_rules": 0, 2026-02-17T05:34:21.984 INFO:tasks.workunit.client.0.trial030.stdout: "has_msr_rules": 0 2026-02-17T05:34:21.984 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.984 INFO:tasks.workunit.client.0.trial030.stdout: "choose_args": {} 2026-02-17T05:34:21.984 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.984 INFO:tasks.workunit.client.0.trial030.stdout: "fsmap": { 2026-02-17T05:34:21.984 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 1, 2026-02-17T05:34:21.984 INFO:tasks.workunit.client.0.trial030.stdout: "btime": "2026-02-17T05:33:01:611616+0000", 2026-02-17T05:34:21.984 INFO:tasks.workunit.client.0.trial030.stdout: "default_fscid": -1, 2026-02-17T05:34:21.984 INFO:tasks.workunit.client.0.trial030.stdout: "compat": { 2026-02-17T05:34:21.984 INFO:tasks.workunit.client.0.trial030.stdout: "compat": {}, 2026-02-17T05:34:21.984 INFO:tasks.workunit.client.0.trial030.stdout: "ro_compat": {}, 2026-02-17T05:34:21.984 INFO:tasks.workunit.client.0.trial030.stdout: "incompat": { 2026-02-17T05:34:21.984 INFO:tasks.workunit.client.0.trial030.stdout: "feature_1": "base v0.20", 2026-02-17T05:34:21.984 INFO:tasks.workunit.client.0.trial030.stdout: "feature_2": "client writeable ranges", 2026-02-17T05:34:21.984 INFO:tasks.workunit.client.0.trial030.stdout: "feature_3": "default file layouts on dirs", 2026-02-17T05:34:21.984 INFO:tasks.workunit.client.0.trial030.stdout: "feature_4": "dir inode in separate object", 2026-02-17T05:34:21.985 INFO:tasks.workunit.client.0.trial030.stdout: "feature_5": "mds uses versioned encoding", 2026-02-17T05:34:21.985 INFO:tasks.workunit.client.0.trial030.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-17T05:34:21.985 INFO:tasks.workunit.client.0.trial030.stdout: "feature_8": "no anchor table", 2026-02-17T05:34:21.985 INFO:tasks.workunit.client.0.trial030.stdout: "feature_9": "file layout v2", 2026-02-17T05:34:21.985 INFO:tasks.workunit.client.0.trial030.stdout: "feature_10": "snaprealm v2", 2026-02-17T05:34:21.985 INFO:tasks.workunit.client.0.trial030.stdout: "feature_11": "minor log segments", 2026-02-17T05:34:21.985 INFO:tasks.workunit.client.0.trial030.stdout: "feature_12": "quiesce subvolumes" 2026-02-17T05:34:21.985 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:21.985 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.985 INFO:tasks.workunit.client.0.trial030.stdout: "feature_flags": { 2026-02-17T05:34:21.985 INFO:tasks.workunit.client.0.trial030.stdout: "enable_multiple": true, 2026-02-17T05:34:21.985 INFO:tasks.workunit.client.0.trial030.stdout: "ever_enabled_multiple": true 2026-02-17T05:34:21.985 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.985 INFO:tasks.workunit.client.0.trial030.stdout: "standbys": [], 2026-02-17T05:34:21.985 INFO:tasks.workunit.client.0.trial030.stdout: "filesystems": [] 2026-02-17T05:34:21.985 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.985 INFO:tasks.workunit.client.0.trial030.stdout: "mdsmap_first_committed": 1, 2026-02-17T05:34:21.985 INFO:tasks.workunit.client.0.trial030.stdout: "mdsmap_last_committed": 1, 2026-02-17T05:34:21.985 INFO:tasks.workunit.client.0.trial030.stdout: "auth": { 2026-02-17T05:34:21.985 INFO:tasks.workunit.client.0.trial030.stdout: "first_committed": 1, 2026-02-17T05:34:21.985 INFO:tasks.workunit.client.0.trial030.stdout: "last_committed": 5, 2026-02-17T05:34:21.985 INFO:tasks.workunit.client.0.trial030.stdout: "num_secrets": 3 2026-02-17T05:34:21.985 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.985 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg": 1, 2026-02-17T05:34:21.985 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg_active": 1, 2026-02-17T05:34:21.985 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg_unknown": 0, 2026-02-17T05:34:21.985 INFO:tasks.workunit.client.0.trial030.stdout: "num_osd": 3, 2026-02-17T05:34:21.985 INFO:tasks.workunit.client.0.trial030.stdout: "pool_sum": { 2026-02-17T05:34:21.985 INFO:tasks.workunit.client.0.trial030.stdout: "stat_sum": { 2026-02-17T05:34:21.985 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes": 52200, 2026-02-17T05:34:21.985 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects": 101, 2026-02-17T05:34:21.985 INFO:tasks.workunit.client.0.trial030.stdout: "num_object_clones": 1, 2026-02-17T05:34:21.986 INFO:tasks.workunit.client.0.trial030.stdout: "num_object_copies": 303, 2026-02-17T05:34:21.986 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T05:34:21.986 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_missing": 0, 2026-02-17T05:34:21.986 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_degraded": 101, 2026-02-17T05:34:21.986 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_misplaced": 0, 2026-02-17T05:34:21.986 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_unfound": 0, 2026-02-17T05:34:21.986 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_dirty": 101, 2026-02-17T05:34:21.986 INFO:tasks.workunit.client.0.trial030.stdout: "num_whiteouts": 0, 2026-02-17T05:34:21.986 INFO:tasks.workunit.client.0.trial030.stdout: "num_read": 0, 2026-02-17T05:34:21.986 INFO:tasks.workunit.client.0.trial030.stdout: "num_read_kb": 0, 2026-02-17T05:34:21.986 INFO:tasks.workunit.client.0.trial030.stdout: "num_write": 101, 2026-02-17T05:34:21.986 INFO:tasks.workunit.client.0.trial030.stdout: "num_write_kb": 101, 2026-02-17T05:34:21.986 INFO:tasks.workunit.client.0.trial030.stdout: "num_scrub_errors": 0, 2026-02-17T05:34:21.986 INFO:tasks.workunit.client.0.trial030.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T05:34:21.986 INFO:tasks.workunit.client.0.trial030.stdout: "num_deep_scrub_errors": 0, 2026-02-17T05:34:21.986 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_recovered": 0, 2026-02-17T05:34:21.986 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes_recovered": 0, 2026-02-17T05:34:21.986 INFO:tasks.workunit.client.0.trial030.stdout: "num_keys_recovered": 0, 2026-02-17T05:34:21.986 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_omap": 0, 2026-02-17T05:34:21.986 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T05:34:21.986 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T05:34:21.986 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush": 0, 2026-02-17T05:34:21.986 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_kb": 0, 2026-02-17T05:34:21.986 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict": 0, 2026-02-17T05:34:21.986 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_kb": 0, 2026-02-17T05:34:21.986 INFO:tasks.workunit.client.0.trial030.stdout: "num_promote": 0, 2026-02-17T05:34:21.986 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_mode_high": 0, 2026-02-17T05:34:21.986 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_mode_low": 0, 2026-02-17T05:34:21.986 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_mode_some": 0, 2026-02-17T05:34:21.986 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_mode_full": 0, 2026-02-17T05:34:21.986 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_pinned": 0, 2026-02-17T05:34:21.986 INFO:tasks.workunit.client.0.trial030.stdout: "num_legacy_snapsets": 0, 2026-02-17T05:34:21.986 INFO:tasks.workunit.client.0.trial030.stdout: "num_large_omap_objects": 0, 2026-02-17T05:34:21.986 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_manifest": 0, 2026-02-17T05:34:21.987 INFO:tasks.workunit.client.0.trial030.stdout: "num_omap_bytes": 0, 2026-02-17T05:34:21.987 INFO:tasks.workunit.client.0.trial030.stdout: "num_omap_keys": 0, 2026-02-17T05:34:21.987 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_repaired": 0 2026-02-17T05:34:21.987 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.987 INFO:tasks.workunit.client.0.trial030.stdout: "store_stats": { 2026-02-17T05:34:21.987 INFO:tasks.workunit.client.0.trial030.stdout: "total": 0, 2026-02-17T05:34:21.987 INFO:tasks.workunit.client.0.trial030.stdout: "available": 0, 2026-02-17T05:34:21.987 INFO:tasks.workunit.client.0.trial030.stdout: "internally_reserved": 0, 2026-02-17T05:34:21.987 INFO:tasks.workunit.client.0.trial030.stdout: "allocated": 0, 2026-02-17T05:34:21.987 INFO:tasks.workunit.client.0.trial030.stdout: "data_stored": 0, 2026-02-17T05:34:21.987 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed": 0, 2026-02-17T05:34:21.987 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_allocated": 0, 2026-02-17T05:34:21.987 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_original": 0, 2026-02-17T05:34:21.987 INFO:tasks.workunit.client.0.trial030.stdout: "omap_allocated": 0, 2026-02-17T05:34:21.987 INFO:tasks.workunit.client.0.trial030.stdout: "internal_metadata": 0 2026-02-17T05:34:21.987 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.987 INFO:tasks.workunit.client.0.trial030.stdout: "log_size": 18, 2026-02-17T05:34:21.987 INFO:tasks.workunit.client.0.trial030.stdout: "ondisk_log_size": 18, 2026-02-17T05:34:21.987 INFO:tasks.workunit.client.0.trial030.stdout: "up": 3, 2026-02-17T05:34:21.987 INFO:tasks.workunit.client.0.trial030.stdout: "acting": 3, 2026-02-17T05:34:21.987 INFO:tasks.workunit.client.0.trial030.stdout: "num_store_stats": 0 2026-02-17T05:34:21.987 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.987 INFO:tasks.workunit.client.0.trial030.stdout: "osd_sum": { 2026-02-17T05:34:21.987 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 0, 2026-02-17T05:34:21.987 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 0, 2026-02-17T05:34:21.987 INFO:tasks.workunit.client.0.trial030.stdout: "num_pgs": 3, 2026-02-17T05:34:21.987 INFO:tasks.workunit.client.0.trial030.stdout: "num_osds": 3, 2026-02-17T05:34:21.987 INFO:tasks.workunit.client.0.trial030.stdout: "num_per_pool_osds": 3, 2026-02-17T05:34:21.987 INFO:tasks.workunit.client.0.trial030.stdout: "num_per_pool_omap_osds": 3, 2026-02-17T05:34:21.987 INFO:tasks.workunit.client.0.trial030.stdout: "kb": 314572800, 2026-02-17T05:34:21.987 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used": 83916, 2026-02-17T05:34:21.987 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_data": 2140, 2026-02-17T05:34:21.987 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_omap": 27, 2026-02-17T05:34:21.987 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_meta": 81700, 2026-02-17T05:34:21.988 INFO:tasks.workunit.client.0.trial030.stdout: "kb_avail": 314488884, 2026-02-17T05:34:21.988 INFO:tasks.workunit.client.0.trial030.stdout: "statfs": { 2026-02-17T05:34:21.988 INFO:tasks.workunit.client.0.trial030.stdout: "total": 322122547200, 2026-02-17T05:34:21.988 INFO:tasks.workunit.client.0.trial030.stdout: "available": 322036617216, 2026-02-17T05:34:21.988 INFO:tasks.workunit.client.0.trial030.stdout: "internally_reserved": 0, 2026-02-17T05:34:21.988 INFO:tasks.workunit.client.0.trial030.stdout: "allocated": 2191360, 2026-02-17T05:34:21.988 INFO:tasks.workunit.client.0.trial030.stdout: "data_stored": 1542707, 2026-02-17T05:34:21.988 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed": 0, 2026-02-17T05:34:21.988 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_allocated": 0, 2026-02-17T05:34:21.988 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_original": 0, 2026-02-17T05:34:21.988 INFO:tasks.workunit.client.0.trial030.stdout: "omap_allocated": 28368, 2026-02-17T05:34:21.988 INFO:tasks.workunit.client.0.trial030.stdout: "internal_metadata": 83661104 2026-02-17T05:34:21.988 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.988 INFO:tasks.workunit.client.0.trial030.stdout: "hb_peers": [], 2026-02-17T05:34:21.988 INFO:tasks.workunit.client.0.trial030.stdout: "snap_trim_queue_len": 0, 2026-02-17T05:34:21.988 INFO:tasks.workunit.client.0.trial030.stdout: "num_snap_trimming": 0, 2026-02-17T05:34:21.988 INFO:tasks.workunit.client.0.trial030.stdout: "num_shards_repaired": 0, 2026-02-17T05:34:21.988 INFO:tasks.workunit.client.0.trial030.stdout: "op_queue_age_hist": { 2026-02-17T05:34:21.988 INFO:tasks.workunit.client.0.trial030.stdout: "histogram": [], 2026-02-17T05:34:21.988 INFO:tasks.workunit.client.0.trial030.stdout: "upper_bound": 1 2026-02-17T05:34:21.988 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.988 INFO:tasks.workunit.client.0.trial030.stdout: "perf_stat": { 2026-02-17T05:34:21.988 INFO:tasks.workunit.client.0.trial030.stdout: "commit_latency_ms": 0, 2026-02-17T05:34:21.988 INFO:tasks.workunit.client.0.trial030.stdout: "apply_latency_ms": 0, 2026-02-17T05:34:21.988 INFO:tasks.workunit.client.0.trial030.stdout: "commit_latency_ns": 0, 2026-02-17T05:34:21.988 INFO:tasks.workunit.client.0.trial030.stdout: "apply_latency_ns": 0 2026-02-17T05:34:21.988 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.988 INFO:tasks.workunit.client.0.trial030.stdout: "alerts": [], 2026-02-17T05:34:21.988 INFO:tasks.workunit.client.0.trial030.stdout: "network_ping_times": [] 2026-02-17T05:34:21.988 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.988 INFO:tasks.workunit.client.0.trial030.stdout: "osd_sum_by_class": { 2026-02-17T05:34:21.988 INFO:tasks.workunit.client.0.trial030.stdout: "ssd": { 2026-02-17T05:34:21.988 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 0, 2026-02-17T05:34:21.988 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 0, 2026-02-17T05:34:21.988 INFO:tasks.workunit.client.0.trial030.stdout: "num_pgs": 3, 2026-02-17T05:34:21.989 INFO:tasks.workunit.client.0.trial030.stdout: "num_osds": 3, 2026-02-17T05:34:21.989 INFO:tasks.workunit.client.0.trial030.stdout: "num_per_pool_osds": 3, 2026-02-17T05:34:21.989 INFO:tasks.workunit.client.0.trial030.stdout: "num_per_pool_omap_osds": 3, 2026-02-17T05:34:21.989 INFO:tasks.workunit.client.0.trial030.stdout: "kb": 314572800, 2026-02-17T05:34:21.989 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used": 83916, 2026-02-17T05:34:21.989 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_data": 2140, 2026-02-17T05:34:21.989 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_omap": 27, 2026-02-17T05:34:21.989 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_meta": 81700, 2026-02-17T05:34:21.989 INFO:tasks.workunit.client.0.trial030.stdout: "kb_avail": 314488884, 2026-02-17T05:34:21.989 INFO:tasks.workunit.client.0.trial030.stdout: "statfs": { 2026-02-17T05:34:21.989 INFO:tasks.workunit.client.0.trial030.stdout: "total": 322122547200, 2026-02-17T05:34:21.989 INFO:tasks.workunit.client.0.trial030.stdout: "available": 322036617216, 2026-02-17T05:34:21.989 INFO:tasks.workunit.client.0.trial030.stdout: "internally_reserved": 0, 2026-02-17T05:34:21.989 INFO:tasks.workunit.client.0.trial030.stdout: "allocated": 2191360, 2026-02-17T05:34:21.989 INFO:tasks.workunit.client.0.trial030.stdout: "data_stored": 1542707, 2026-02-17T05:34:21.989 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed": 0, 2026-02-17T05:34:21.989 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_allocated": 0, 2026-02-17T05:34:21.989 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_original": 0, 2026-02-17T05:34:21.989 INFO:tasks.workunit.client.0.trial030.stdout: "omap_allocated": 28368, 2026-02-17T05:34:21.989 INFO:tasks.workunit.client.0.trial030.stdout: "internal_metadata": 83661104 2026-02-17T05:34:21.989 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.989 INFO:tasks.workunit.client.0.trial030.stdout: "hb_peers": [], 2026-02-17T05:34:21.989 INFO:tasks.workunit.client.0.trial030.stdout: "snap_trim_queue_len": 0, 2026-02-17T05:34:21.989 INFO:tasks.workunit.client.0.trial030.stdout: "num_snap_trimming": 0, 2026-02-17T05:34:21.989 INFO:tasks.workunit.client.0.trial030.stdout: "num_shards_repaired": 0, 2026-02-17T05:34:21.989 INFO:tasks.workunit.client.0.trial030.stdout: "op_queue_age_hist": { 2026-02-17T05:34:21.989 INFO:tasks.workunit.client.0.trial030.stdout: "histogram": [], 2026-02-17T05:34:21.989 INFO:tasks.workunit.client.0.trial030.stdout: "upper_bound": 1 2026-02-17T05:34:21.989 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.989 INFO:tasks.workunit.client.0.trial030.stdout: "perf_stat": { 2026-02-17T05:34:21.989 INFO:tasks.workunit.client.0.trial030.stdout: "commit_latency_ms": 0, 2026-02-17T05:34:21.989 INFO:tasks.workunit.client.0.trial030.stdout: "apply_latency_ms": 0, 2026-02-17T05:34:21.989 INFO:tasks.workunit.client.0.trial030.stdout: "commit_latency_ns": 0, 2026-02-17T05:34:21.989 INFO:tasks.workunit.client.0.trial030.stdout: "apply_latency_ns": 0 2026-02-17T05:34:21.989 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.990 INFO:tasks.workunit.client.0.trial030.stdout: "alerts": [], 2026-02-17T05:34:21.990 INFO:tasks.workunit.client.0.trial030.stdout: "network_ping_times": [] 2026-02-17T05:34:21.990 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:21.990 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.990 INFO:tasks.workunit.client.0.trial030.stdout: "pool_stats": [ 2026-02-17T05:34:21.990 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.990 INFO:tasks.workunit.client.0.trial030.stdout: "poolid": 1, 2026-02-17T05:34:21.990 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg": 1, 2026-02-17T05:34:21.990 INFO:tasks.workunit.client.0.trial030.stdout: "stat_sum": { 2026-02-17T05:34:21.990 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes": 52200, 2026-02-17T05:34:21.990 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects": 101, 2026-02-17T05:34:21.990 INFO:tasks.workunit.client.0.trial030.stdout: "num_object_clones": 1, 2026-02-17T05:34:21.990 INFO:tasks.workunit.client.0.trial030.stdout: "num_object_copies": 303, 2026-02-17T05:34:21.990 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T05:34:21.990 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_missing": 0, 2026-02-17T05:34:21.990 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_degraded": 101, 2026-02-17T05:34:21.990 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_misplaced": 0, 2026-02-17T05:34:21.990 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_unfound": 0, 2026-02-17T05:34:21.990 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_dirty": 101, 2026-02-17T05:34:21.990 INFO:tasks.workunit.client.0.trial030.stdout: "num_whiteouts": 0, 2026-02-17T05:34:21.990 INFO:tasks.workunit.client.0.trial030.stdout: "num_read": 0, 2026-02-17T05:34:21.990 INFO:tasks.workunit.client.0.trial030.stdout: "num_read_kb": 0, 2026-02-17T05:34:21.990 INFO:tasks.workunit.client.0.trial030.stdout: "num_write": 101, 2026-02-17T05:34:21.990 INFO:tasks.workunit.client.0.trial030.stdout: "num_write_kb": 101, 2026-02-17T05:34:21.990 INFO:tasks.workunit.client.0.trial030.stdout: "num_scrub_errors": 0, 2026-02-17T05:34:21.990 INFO:tasks.workunit.client.0.trial030.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T05:34:21.990 INFO:tasks.workunit.client.0.trial030.stdout: "num_deep_scrub_errors": 0, 2026-02-17T05:34:21.990 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_recovered": 0, 2026-02-17T05:34:21.990 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes_recovered": 0, 2026-02-17T05:34:21.990 INFO:tasks.workunit.client.0.trial030.stdout: "num_keys_recovered": 0, 2026-02-17T05:34:21.990 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_omap": 0, 2026-02-17T05:34:21.990 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T05:34:21.990 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T05:34:21.990 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush": 0, 2026-02-17T05:34:21.990 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_kb": 0, 2026-02-17T05:34:21.991 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict": 0, 2026-02-17T05:34:21.991 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_kb": 0, 2026-02-17T05:34:21.991 INFO:tasks.workunit.client.0.trial030.stdout: "num_promote": 0, 2026-02-17T05:34:21.991 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_mode_high": 0, 2026-02-17T05:34:21.991 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_mode_low": 0, 2026-02-17T05:34:21.991 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_mode_some": 0, 2026-02-17T05:34:21.991 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_mode_full": 0, 2026-02-17T05:34:21.991 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_pinned": 0, 2026-02-17T05:34:21.991 INFO:tasks.workunit.client.0.trial030.stdout: "num_legacy_snapsets": 0, 2026-02-17T05:34:21.991 INFO:tasks.workunit.client.0.trial030.stdout: "num_large_omap_objects": 0, 2026-02-17T05:34:21.991 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_manifest": 0, 2026-02-17T05:34:21.991 INFO:tasks.workunit.client.0.trial030.stdout: "num_omap_bytes": 0, 2026-02-17T05:34:21.991 INFO:tasks.workunit.client.0.trial030.stdout: "num_omap_keys": 0, 2026-02-17T05:34:21.991 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_repaired": 0 2026-02-17T05:34:21.991 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.991 INFO:tasks.workunit.client.0.trial030.stdout: "store_stats": { 2026-02-17T05:34:21.991 INFO:tasks.workunit.client.0.trial030.stdout: "total": 0, 2026-02-17T05:34:21.991 INFO:tasks.workunit.client.0.trial030.stdout: "available": 0, 2026-02-17T05:34:21.991 INFO:tasks.workunit.client.0.trial030.stdout: "internally_reserved": 0, 2026-02-17T05:34:21.991 INFO:tasks.workunit.client.0.trial030.stdout: "allocated": 1241088, 2026-02-17T05:34:21.991 INFO:tasks.workunit.client.0.trial030.stdout: "data_stored": 1241088, 2026-02-17T05:34:21.991 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed": 0, 2026-02-17T05:34:21.991 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_allocated": 0, 2026-02-17T05:34:21.991 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_original": 0, 2026-02-17T05:34:21.991 INFO:tasks.workunit.client.0.trial030.stdout: "omap_allocated": 0, 2026-02-17T05:34:21.991 INFO:tasks.workunit.client.0.trial030.stdout: "internal_metadata": 0 2026-02-17T05:34:21.991 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.991 INFO:tasks.workunit.client.0.trial030.stdout: "log_size": 18, 2026-02-17T05:34:21.991 INFO:tasks.workunit.client.0.trial030.stdout: "ondisk_log_size": 18, 2026-02-17T05:34:21.991 INFO:tasks.workunit.client.0.trial030.stdout: "up": 3, 2026-02-17T05:34:21.991 INFO:tasks.workunit.client.0.trial030.stdout: "acting": 3, 2026-02-17T05:34:21.991 INFO:tasks.workunit.client.0.trial030.stdout: "num_store_stats": 3 2026-02-17T05:34:21.991 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:21.991 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:34:21.992 INFO:tasks.workunit.client.0.trial030.stdout: "osd_stats": [ 2026-02-17T05:34:21.992 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.992 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 0, 2026-02-17T05:34:21.992 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 154618822666 2026-02-17T05:34:21.992 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.992 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.992 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 1, 2026-02-17T05:34:21.992 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 38654705679 2026-02-17T05:34:21.992 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.992 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.992 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2, 2026-02-17T05:34:21.992 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 167503724553 2026-02-17T05:34:21.992 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:21.992 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:34:21.992 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg_by_state": [ 2026-02-17T05:34:21.992 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.992 INFO:tasks.workunit.client.0.trial030.stdout: "state": "active+undersized+degraded", 2026-02-17T05:34:21.992 INFO:tasks.workunit.client.0.trial030.stdout: "num": 1 2026-02-17T05:34:21.992 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:21.992 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:34:21.992 INFO:tasks.workunit.client.0.trial030.stdout: "pool_pg_unavailable_map": [ 2026-02-17T05:34:21.992 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.992 INFO:tasks.workunit.client.0.trial030.stdout: "poolid": "1", 2026-02-17T05:34:21.992 INFO:tasks.workunit.client.0.trial030.stdout: "pgs": [] 2026-02-17T05:34:21.992 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:21.992 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:34:21.992 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg_by_osd": [ 2026-02-17T05:34:21.992 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.992 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2147483647, 2026-02-17T05:34:21.992 INFO:tasks.workunit.client.0.trial030.stdout: "num_primary_pg": 0, 2026-02-17T05:34:21.992 INFO:tasks.workunit.client.0.trial030.stdout: "num_acting_pg": 1, 2026-02-17T05:34:21.992 INFO:tasks.workunit.client.0.trial030.stdout: "num_up_not_acting_pg": 0 2026-02-17T05:34:21.992 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.992 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.992 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2, 2026-02-17T05:34:21.992 INFO:tasks.workunit.client.0.trial030.stdout: "num_primary_pg": 0, 2026-02-17T05:34:21.993 INFO:tasks.workunit.client.0.trial030.stdout: "num_acting_pg": 1, 2026-02-17T05:34:21.993 INFO:tasks.workunit.client.0.trial030.stdout: "num_up_not_acting_pg": 0 2026-02-17T05:34:21.993 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.993 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.993 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 0, 2026-02-17T05:34:21.993 INFO:tasks.workunit.client.0.trial030.stdout: "num_primary_pg": 1, 2026-02-17T05:34:21.993 INFO:tasks.workunit.client.0.trial030.stdout: "num_acting_pg": 1, 2026-02-17T05:34:21.993 INFO:tasks.workunit.client.0.trial030.stdout: "num_up_not_acting_pg": 0 2026-02-17T05:34:21.993 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.993 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.993 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 1, 2026-02-17T05:34:21.993 INFO:tasks.workunit.client.0.trial030.stdout: "num_primary_pg": 0, 2026-02-17T05:34:21.993 INFO:tasks.workunit.client.0.trial030.stdout: "num_acting_pg": 0, 2026-02-17T05:34:21.993 INFO:tasks.workunit.client.0.trial030.stdout: "num_up_not_acting_pg": 0 2026-02-17T05:34:21.993 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:21.993 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:34:21.993 INFO:tasks.workunit.client.0.trial030.stdout: "purged_snaps": [ 2026-02-17T05:34:21.993 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:21.993 INFO:tasks.workunit.client.0.trial030.stdout: "pool": 1, 2026-02-17T05:34:21.993 INFO:tasks.workunit.client.0.trial030.stdout: "purged_snaps": {} 2026-02-17T05:34:21.993 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:21.993 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:34:21.993 INFO:tasks.workunit.client.0.trial030.stdout: "servicemap": { 2026-02-17T05:34:21.993 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 3, 2026-02-17T05:34:21.993 INFO:tasks.workunit.client.0.trial030.stdout: "modified": "2026-02-17T05:34:10.082252+0000", 2026-02-17T05:34:21.993 INFO:tasks.workunit.client.0.trial030.stdout: "services": { 2026-02-17T05:34:21.993 INFO:tasks.workunit.client.0.trial030.stdout: "osd": { 2026-02-17T05:34:21.993 INFO:tasks.workunit.client.0.trial030.stdout: "daemons": { 2026-02-17T05:34:21.993 INFO:tasks.workunit.client.0.trial030.stdout: "summary": "", 2026-02-17T05:34:21.993 INFO:tasks.workunit.client.0.trial030.stdout: "0": { 2026-02-17T05:34:21.993 INFO:tasks.workunit.client.0.trial030.stdout: "start_epoch": 0, 2026-02-17T05:34:21.993 INFO:tasks.workunit.client.0.trial030.stdout: "start_stamp": "0.000000", 2026-02-17T05:34:21.993 INFO:tasks.workunit.client.0.trial030.stdout: "gid": 0, 2026-02-17T05:34:21.993 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-17T05:34:21.993 INFO:tasks.workunit.client.0.trial030.stdout: "metadata": {}, 2026-02-17T05:34:21.993 INFO:tasks.workunit.client.0.trial030.stdout: "task_status": {} 2026-02-17T05:34:21.994 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.994 INFO:tasks.workunit.client.0.trial030.stdout: "2": { 2026-02-17T05:34:21.994 INFO:tasks.workunit.client.0.trial030.stdout: "start_epoch": 0, 2026-02-17T05:34:21.994 INFO:tasks.workunit.client.0.trial030.stdout: "start_stamp": "0.000000", 2026-02-17T05:34:21.994 INFO:tasks.workunit.client.0.trial030.stdout: "gid": 0, 2026-02-17T05:34:21.994 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-17T05:34:21.994 INFO:tasks.workunit.client.0.trial030.stdout: "metadata": {}, 2026-02-17T05:34:21.994 INFO:tasks.workunit.client.0.trial030.stdout: "task_status": {} 2026-02-17T05:34:21.994 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:21.994 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:21.994 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:21.994 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:21.994 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:21.994 INFO:tasks.workunit.client.0.trial030.stdout: "mgrstat_first_committed": 1, 2026-02-17T05:34:21.994 INFO:tasks.workunit.client.0.trial030.stdout: "mgrstat_last_committed": 40, 2026-02-17T05:34:21.994 INFO:tasks.workunit.client.0.trial030.stdout: "logm_first_committed": 1, 2026-02-17T05:34:21.994 INFO:tasks.workunit.client.0.trial030.stdout: "logm_last_committed": 241, 2026-02-17T05:34:21.994 INFO:tasks.workunit.client.0.trial030.stdout: "paxos": { 2026-02-17T05:34:21.994 INFO:tasks.workunit.client.0.trial030.stdout: "first_committed": 1, 2026-02-17T05:34:21.994 INFO:tasks.workunit.client.0.trial030.stdout: "last_committed": 334, 2026-02-17T05:34:21.994 INFO:tasks.workunit.client.0.trial030.stdout: "last_pn": 0, 2026-02-17T05:34:21.994 INFO:tasks.workunit.client.0.trial030.stdout: "accepted_pn": 0 2026-02-17T05:34:21.994 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:21.994 INFO:tasks.workunit.client.0.trial030.stdout:} 2026-02-17T05:34:21.995 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-17T05:34:21.995 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:330: TEST_divergent_ec: for i in $non_divergent 2026-02-17T05:34:21.995 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:332: TEST_divergent_ec: kill_daemons td/divergent-priors KILL osd.0 2026-02-17T05:34:21.995 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:34:21.995 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:34:21.995 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:34:21.995 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:34:21.995 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:34:22.075 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:34:22.075 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:333: TEST_divergent_ec: _objectstore_tool_nodown td/divergent-priors 0 --op log --pgid 1.0 2026-02-17T05:34:22.075 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-17T05:34:22.076 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T05:34:22.076 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T05:34:22.076 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T05:34:22.076 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/0 2026-02-17T05:34:22.076 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/0 --op log --pgid 1.0 2026-02-17T05:34:22.245 INFO:tasks.workunit.client.0.trial030.stderr:PG '1.0' not found 2026-02-17T05:34:22.353 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1256: _objectstore_tool_nodown: return 1 2026-02-17T05:34:22.353 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:334: TEST_divergent_ec: activate_osd td/divergent-priors 0 2026-02-17T05:34:22.353 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-17T05:34:22.353 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T05:34:22.354 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T05:34:22.354 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T05:34:22.354 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/0 2026-02-17T05:34:22.354 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T05:34:22.354 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:34:22.354 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:34:22.354 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:34:22.354 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-17T05:34:22.354 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-17T05:34:22.354 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T05:34:22.354 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T05:34:22.354 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T05:34:22.354 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T05:34:22.354 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:34:22.354 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:34:22.355 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:34:22.355 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:34:22.355 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:34:22.355 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:34:22.356 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:34:22.356 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:34:22.356 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T05:34:22.356 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T05:34:22.356 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:34:22.356 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:34:22.356 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:34:22.356 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:34:22.356 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T05:34:22.356 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T05:34:22.356 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/0 2026-02-17T05:34:22.356 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T05:34:22.357 INFO:tasks.workunit.client.0.trial030.stdout:start osd.0 2026-02-17T05:34:22.357 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T05:34:22.357 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/0/whoami 2026-02-17T05:34:22.357 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T05:34:22.357 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T05:34:22.358 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T05:34:22.358 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T05:34:22.378 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:34:22.374+0000 7f1eb73c3a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:34:22.380 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:34:22.374+0000 7f1eb73c3a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:34:22.381 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:34:22.378+0000 7f1eb73c3a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:34:22.580 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T05:34:22.581 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:34:22.581 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T05:34:22.581 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:34:22.581 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:34:22.581 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:34:22.581 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:34:22.582 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:34:22.582 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:34:22.582 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T05:34:22.766 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:34:22.762+0000 7f1eb73c3a40 -1 Falling back to public interface 2026-02-17T05:34:22.801 INFO:tasks.workunit.client.0.trial030.stdout:osd.0 up in weight 1 up_from 36 up_thru 41 down_at 30 last_clean_interval [5,28) [v2:127.0.0.1:6800/860338477,v1:127.0.0.1:6801/860338477] [v2:127.0.0.1:6802/860338477,v1:127.0.0.1:6803/860338477] exists,up ffd61780-fdee-492a-b89a-f0298d033d42 2026-02-17T05:34:22.802 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:34:22.802 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:34:22.802 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:34:22.803 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:330: TEST_divergent_ec: for i in $non_divergent 2026-02-17T05:34:22.803 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:332: TEST_divergent_ec: kill_daemons td/divergent-priors KILL osd.2 2026-02-17T05:34:22.803 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:34:22.803 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:34:22.803 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:34:22.803 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:34:22.803 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:34:22.911 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:34:22.911 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:333: TEST_divergent_ec: _objectstore_tool_nodown td/divergent-priors 2 --op log --pgid 1.0 2026-02-17T05:34:22.911 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-17T05:34:22.911 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T05:34:22.911 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=2 2026-02-17T05:34:22.912 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T05:34:22.912 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/2 2026-02-17T05:34:22.912 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/2 --op log --pgid 1.0 2026-02-17T05:34:23.101 INFO:tasks.workunit.client.0.trial030.stderr:PG '1.0' not found 2026-02-17T05:34:23.199 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1256: _objectstore_tool_nodown: return 1 2026-02-17T05:34:23.200 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:334: TEST_divergent_ec: activate_osd td/divergent-priors 2 2026-02-17T05:34:23.200 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-17T05:34:23.200 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T05:34:23.200 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-17T05:34:23.200 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T05:34:23.200 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/2 2026-02-17T05:34:23.200 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T05:34:23.200 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:34:23.200 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:34:23.200 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:34:23.201 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-17T05:34:23.201 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-17T05:34:23.201 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T05:34:23.201 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T05:34:23.201 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T05:34:23.201 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T05:34:23.201 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:34:23.201 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:34:23.201 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:34:23.201 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:34:23.201 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:34:23.201 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:34:23.202 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:34:23.202 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:34:23.202 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T05:34:23.202 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T05:34:23.202 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:34:23.202 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:34:23.202 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:34:23.202 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:34:23.202 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T05:34:23.202 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T05:34:23.202 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/2 2026-02-17T05:34:23.203 INFO:tasks.workunit.client.0.trial030.stdout:start osd.2 2026-02-17T05:34:23.204 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-17T05:34:23.204 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T05:34:23.204 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/2/whoami 2026-02-17T05:34:23.204 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-17T05:34:23.204 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T05:34:23.204 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T05:34:23.204 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T05:34:23.219 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:34:23.214+0000 7f7ca6815a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:34:23.221 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:34:23.218+0000 7f7ca6815a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:34:23.222 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:34:23.218+0000 7f7ca6815a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:34:23.416 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-17T05:34:23.416 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:34:23.416 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T05:34:23.416 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:34:23.416 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:34:23.416 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:34:23.417 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:34:23.417 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:34:23.418 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:34:23.418 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T05:34:23.631 INFO:tasks.workunit.client.0.trial030.stdout:osd.2 up in weight 1 up_from 39 up_thru 0 down_at 32 last_clean_interval [14,28) [v2:127.0.0.1:6810/2154342846,v1:127.0.0.1:6811/2154342846] [v2:127.0.0.1:6812/2154342846,v1:127.0.0.1:6813/2154342846] exists,up 09dea4cc-8ddf-4609-83f3-70b490de0aa5 2026-02-17T05:34:23.632 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:34:23.632 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:34:23.632 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:34:23.632 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:336: TEST_divergent_ec: _objectstore_tool_nodown td/divergent-priors 1 --op log --pgid 1.0 2026-02-17T05:34:23.633 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-17T05:34:23.633 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T05:34:23.633 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T05:34:23.633 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T05:34:23.633 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2026-02-17T05:34:23.633 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op log --pgid 1.0 2026-02-17T05:34:23.661 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:34:23.658+0000 7f1eb73c3a40 -1 osd.0 42 log_to_monitors true 2026-02-17T05:34:23.697 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:34:23.694+0000 7f7ca6815a40 -1 Falling back to public interface 2026-02-17T05:34:23.898 INFO:tasks.workunit.client.0.trial030.stderr:PG '1.0' not found 2026-02-17T05:34:23.997 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1256: _objectstore_tool_nodown: return 1 2026-02-17T05:34:23.997 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:338: TEST_divergent_ec: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-17T05:34:23.998 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:338: TEST_divergent_ec: wait_for_clean 2026-02-17T05:34:23.998 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T05:34:23.998 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T05:34:23.998 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T05:34:23.998 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-17T05:34:23.999 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T05:34:23.999 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T05:34:23.999 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T05:34:23.999 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T05:34:23.999 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T05:34:24.063 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-17T05:34:24.063 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T05:34:24.063 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T05:34:24.063 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T05:34:24.063 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T05:34:24.063 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:34:24.287 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:34:24.288 INFO:tasks.workunit.client.0.trial030.stderr:1 2026-02-17T05:34:24.288 INFO:tasks.workunit.client.0.trial030.stderr:2' 2026-02-17T05:34:24.288 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:34:24.288 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:34:24.288 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T05:34:24.370 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=193273528323 2026-02-17T05:34:24.370 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 193273528323 2026-02-17T05:34:24.371 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-193273528323' 2026-02-17T05:34:24.371 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:34:24.371 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T05:34:24.434 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-17T05:34:24.434 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: true 2026-02-17T05:34:24.434 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-17T05:34:24.434 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: continue 2026-02-17T05:34:24.434 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:34:24.435 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T05:34:24.594 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:34:24.590+0000 7f7ca6815a40 -1 osd.2 42 log_to_monitors true 2026-02-17T05:34:29.525 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=210453397507 2026-02-17T05:34:29.525 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 210453397507 2026-02-17T05:34:29.525 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-193273528323 2-210453397507' 2026-02-17T05:34:29.525 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:34:29.526 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-193273528323 2026-02-17T05:34:29.526 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:34:29.527 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:34:29.527 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-193273528323 2026-02-17T05:34:29.528 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:34:29.529 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=193273528323 2026-02-17T05:34:29.529 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.0 seq 193273528323 2026-02-17T05:34:29.530 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 193273528323' 2026-02-17T05:34:29.530 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:34:29.745 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 193273528323 -lt 193273528323 2026-02-17T05:34:29.745 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:34:29.745 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-210453397507 2026-02-17T05:34:29.746 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:34:29.747 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:34:29.748 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-210453397507 2026-02-17T05:34:29.748 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:34:29.749 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=210453397507 2026-02-17T05:34:29.749 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.2 seq 210453397507 2026-02-17T05:34:29.749 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 210453397507' 2026-02-17T05:34:29.749 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:34:29.968 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 210453397507 2026-02-17T05:34:29.968 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:34:30.969 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T05:34:30.970 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:34:31.184 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 210453397508 -lt 210453397507 2026-02-17T05:34:31.185 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T05:34:31.185 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:34:31.185 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:34:31.462 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T05:34:31.463 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:34:31.463 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:34:31.463 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:34:31.463 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:34:31.463 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:34:31.463 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:34:31.463 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:34:31.681 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:34:31.682 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:34:31.682 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:34:31.682 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:34:31.973 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T05:34:31.973 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-17T05:34:31.973 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-17T05:34:31.974 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-17T05:34:31.974 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T05:34:31.974 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-17T05:34:32.074 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T05:34:32.074 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:34:32.075 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:34:32.075 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:34:32.075 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:34:32.075 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:34:32.076 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:34:32.076 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:34:32.297 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:34:32.297 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:34:32.298 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:34:32.298 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:34:32.593 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T05:34:32.593 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T05:34:32.593 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T05:34:32.593 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T05:34:32.593 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T05:34:32.593 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T05:34:32.593 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T05:34:32.593 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T05:34:32.593 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T05:34:32.884 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T05:34:32.884 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T05:34:32.884 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-17T05:34:32.884 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T05:34:32.884 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-17T05:34:33.086 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T05:34:33.086 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:34:33.087 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:34:33.087 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:34:33.087 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:34:33.088 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:34:33.088 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:34:33.088 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:34:33.304 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:34:33.305 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:34:33.305 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:34:33.305 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:34:33.588 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T05:34:33.588 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T05:34:33.588 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T05:34:33.588 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T05:34:33.588 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T05:34:33.588 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T05:34:33.588 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T05:34:33.588 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T05:34:33.589 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T05:34:33.873 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T05:34:33.873 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T05:34:33.873 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-17T05:34:33.873 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T05:34:33.873 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-17T05:34:34.273 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T05:34:34.273 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:34:34.274 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:34:34.275 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:34:34.275 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:34:34.275 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:34:34.275 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:34:34.275 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:34:34.482 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:34:34.483 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:34:34.483 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:34:34.483 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:34:34.762 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T05:34:34.763 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T05:34:34.763 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T05:34:34.763 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T05:34:34.763 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T05:34:34.763 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T05:34:34.764 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T05:34:34.764 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T05:34:34.764 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T05:34:35.043 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T05:34:35.044 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T05:34:35.044 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-17T05:34:35.044 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T05:34:35.044 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-17T05:34:35.844 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T05:34:35.844 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:34:35.845 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:34:35.845 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:34:35.845 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:34:35.845 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:34:35.845 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:34:35.845 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:34:36.063 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:34:36.064 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:34:36.064 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:34:36.064 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:34:36.368 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T05:34:36.369 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T05:34:36.369 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T05:34:36.369 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T05:34:36.369 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T05:34:36.369 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T05:34:36.369 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T05:34:36.369 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T05:34:36.369 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T05:34:36.660 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T05:34:36.660 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T05:34:36.660 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-17T05:34:36.661 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T05:34:36.661 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-17T05:34:38.261 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T05:34:38.262 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:34:38.262 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:34:38.262 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:34:38.262 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:34:38.262 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:34:38.263 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:34:38.263 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:34:38.486 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:34:38.486 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:34:38.487 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:34:38.487 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:34:38.783 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T05:34:38.783 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T05:34:38.783 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T05:34:38.784 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T05:34:38.784 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T05:34:38.784 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T05:34:38.784 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T05:34:38.784 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T05:34:38.784 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T05:34:39.069 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T05:34:39.070 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T05:34:39.070 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-17T05:34:39.070 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T05:34:39.070 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-17T05:34:42.270 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T05:34:42.270 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:34:42.270 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:34:42.270 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:34:42.270 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:34:42.270 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:34:42.272 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:34:42.272 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:34:42.492 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:34:42.493 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:34:42.493 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:34:42.493 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:34:42.786 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T05:34:42.786 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T05:34:42.786 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T05:34:42.786 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T05:34:42.787 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T05:34:42.787 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T05:34:42.787 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T05:34:42.787 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T05:34:42.787 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T05:34:43.085 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T05:34:43.086 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T05:34:43.086 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-17T05:34:43.086 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T05:34:43.086 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-17T05:34:49.498 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T05:34:49.498 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:34:49.498 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:34:49.498 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:34:49.498 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:34:49.498 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:34:49.498 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:34:49.498 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:34:49.704 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:34:49.705 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:34:49.705 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:34:49.705 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:34:49.996 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T05:34:49.996 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T05:34:49.996 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T05:34:49.996 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T05:34:49.996 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T05:34:49.996 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T05:34:49.996 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T05:34:49.997 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T05:34:49.997 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T05:34:50.292 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T05:34:50.292 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T05:34:50.292 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-17T05:34:50.292 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T05:34:50.292 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-17T05:34:57.593 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T05:34:57.593 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:34:57.594 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:34:57.594 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:34:57.594 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:34:57.594 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:34:57.595 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:34:57.595 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:34:57.810 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T05:34:57.810 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:34:57.811 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:34:57.811 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:34:58.095 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T05:34:58.095 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T05:34:58.095 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T05:34:58.095 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T05:34:58.095 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T05:34:58.095 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T05:34:58.095 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T05:34:58.095 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T05:34:58.096 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T05:34:58.377 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T05:34:58.377 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T05:34:58.377 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-17T05:34:58.377 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-17T05:34:58.666 INFO:tasks.workunit.client.0.trial030.stdout:{ 2026-02-17T05:34:58.667 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_fingerprint": "f99118a8-d6a9-4e58-8abe-fc2fa4130dcd", 2026-02-17T05:34:58.667 INFO:tasks.workunit.client.0.trial030.stdout: "version": "20.3.0-5271-g32585015", 2026-02-17T05:34:58.667 INFO:tasks.workunit.client.0.trial030.stdout: "commit": "325850157d309f65985eea9ec9bb9f1d56726fee", 2026-02-17T05:34:58.667 INFO:tasks.workunit.client.0.trial030.stdout: "timestamp": "2026-02-17T05:34:58.663334+0000", 2026-02-17T05:34:58.667 INFO:tasks.workunit.client.0.trial030.stdout: "tag": "", 2026-02-17T05:34:58.667 INFO:tasks.workunit.client.0.trial030.stdout: "health": { 2026-02-17T05:34:58.667 INFO:tasks.workunit.client.0.trial030.stdout: "status": "HEALTH_WARN", 2026-02-17T05:34:58.667 INFO:tasks.workunit.client.0.trial030.stdout: "checks": { 2026-02-17T05:34:58.667 INFO:tasks.workunit.client.0.trial030.stdout: "OSDMAP_FLAGS": { 2026-02-17T05:34:58.668 INFO:tasks.workunit.client.0.trial030.stdout: "severity": "HEALTH_WARN", 2026-02-17T05:34:58.668 INFO:tasks.workunit.client.0.trial030.stdout: "summary": { 2026-02-17T05:34:58.668 INFO:tasks.workunit.client.0.trial030.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-17T05:34:58.668 INFO:tasks.workunit.client.0.trial030.stdout: "count": 17 2026-02-17T05:34:58.668 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.668 INFO:tasks.workunit.client.0.trial030.stdout: "detail": [], 2026-02-17T05:34:58.668 INFO:tasks.workunit.client.0.trial030.stdout: "muted": false 2026-02-17T05:34:58.668 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.668 INFO:tasks.workunit.client.0.trial030.stdout: "OSD_DOWN": { 2026-02-17T05:34:58.668 INFO:tasks.workunit.client.0.trial030.stdout: "severity": "HEALTH_WARN", 2026-02-17T05:34:58.668 INFO:tasks.workunit.client.0.trial030.stdout: "summary": { 2026-02-17T05:34:58.668 INFO:tasks.workunit.client.0.trial030.stdout: "message": "1 osds down", 2026-02-17T05:34:58.669 INFO:tasks.workunit.client.0.trial030.stdout: "count": 1 2026-02-17T05:34:58.669 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.669 INFO:tasks.workunit.client.0.trial030.stdout: "detail": [ 2026-02-17T05:34:58.669 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.669 INFO:tasks.workunit.client.0.trial030.stdout: "message": "osd.1 (root=default,host=trial030) is down" 2026-02-17T05:34:58.669 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:58.669 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:34:58.669 INFO:tasks.workunit.client.0.trial030.stdout: "muted": false 2026-02-17T05:34:58.669 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.669 INFO:tasks.workunit.client.0.trial030.stdout: "PG_DEGRADED": { 2026-02-17T05:34:58.669 INFO:tasks.workunit.client.0.trial030.stdout: "severity": "HEALTH_WARN", 2026-02-17T05:34:58.669 INFO:tasks.workunit.client.0.trial030.stdout: "summary": { 2026-02-17T05:34:58.670 INFO:tasks.workunit.client.0.trial030.stdout: "message": "Degraded data redundancy: 101/303 objects degraded (33.333%), 1 pg degraded", 2026-02-17T05:34:58.670 INFO:tasks.workunit.client.0.trial030.stdout: "count": 1 2026-02-17T05:34:58.670 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.670 INFO:tasks.workunit.client.0.trial030.stdout: "detail": [ 2026-02-17T05:34:58.670 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.670 INFO:tasks.workunit.client.0.trial030.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [NONE,0,2]" 2026-02-17T05:34:58.670 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:58.670 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:34:58.670 INFO:tasks.workunit.client.0.trial030.stdout: "muted": false 2026-02-17T05:34:58.670 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:58.670 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.670 INFO:tasks.workunit.client.0.trial030.stdout: "mutes": [] 2026-02-17T05:34:58.671 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.671 INFO:tasks.workunit.client.0.trial030.stdout: "monmap_first_committed": 1, 2026-02-17T05:34:58.671 INFO:tasks.workunit.client.0.trial030.stdout: "monmap_last_committed": 1, 2026-02-17T05:34:58.671 INFO:tasks.workunit.client.0.trial030.stdout: "monmap": { 2026-02-17T05:34:58.671 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 1, 2026-02-17T05:34:58.671 INFO:tasks.workunit.client.0.trial030.stdout: "fsid": "931b36d9-02d4-44f0-bc8b-c9190b7fdb00", 2026-02-17T05:34:58.671 INFO:tasks.workunit.client.0.trial030.stdout: "modified": "2026-02-17T05:33:01.522999Z", 2026-02-17T05:34:58.671 INFO:tasks.workunit.client.0.trial030.stdout: "created": "2026-02-17T05:33:01.522999Z", 2026-02-17T05:34:58.671 INFO:tasks.workunit.client.0.trial030.stdout: "min_mon_release": 20, 2026-02-17T05:34:58.671 INFO:tasks.workunit.client.0.trial030.stdout: "min_mon_release_name": "tentacle", 2026-02-17T05:34:58.671 INFO:tasks.workunit.client.0.trial030.stdout: "election_strategy": 1, 2026-02-17T05:34:58.671 INFO:tasks.workunit.client.0.trial030.stdout: "disallowed_leaders": "", 2026-02-17T05:34:58.672 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_mode": false, 2026-02-17T05:34:58.672 INFO:tasks.workunit.client.0.trial030.stdout: "tiebreaker_mon": "", 2026-02-17T05:34:58.672 INFO:tasks.workunit.client.0.trial030.stdout: "removed_ranks": "", 2026-02-17T05:34:58.672 INFO:tasks.workunit.client.0.trial030.stdout: "features": { 2026-02-17T05:34:58.672 INFO:tasks.workunit.client.0.trial030.stdout: "persistent": [ 2026-02-17T05:34:58.672 INFO:tasks.workunit.client.0.trial030.stdout: "kraken", 2026-02-17T05:34:58.672 INFO:tasks.workunit.client.0.trial030.stdout: "luminous", 2026-02-17T05:34:58.672 INFO:tasks.workunit.client.0.trial030.stdout: "mimic", 2026-02-17T05:34:58.672 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap-prune", 2026-02-17T05:34:58.672 INFO:tasks.workunit.client.0.trial030.stdout: "nautilus", 2026-02-17T05:34:58.672 INFO:tasks.workunit.client.0.trial030.stdout: "octopus", 2026-02-17T05:34:58.672 INFO:tasks.workunit.client.0.trial030.stdout: "pacific", 2026-02-17T05:34:58.673 INFO:tasks.workunit.client.0.trial030.stdout: "elector-pinging", 2026-02-17T05:34:58.673 INFO:tasks.workunit.client.0.trial030.stdout: "quincy", 2026-02-17T05:34:58.673 INFO:tasks.workunit.client.0.trial030.stdout: "reef", 2026-02-17T05:34:58.673 INFO:tasks.workunit.client.0.trial030.stdout: "squid", 2026-02-17T05:34:58.673 INFO:tasks.workunit.client.0.trial030.stdout: "tentacle", 2026-02-17T05:34:58.673 INFO:tasks.workunit.client.0.trial030.stdout: "nvmeof_beacon_diff" 2026-02-17T05:34:58.673 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:34:58.673 INFO:tasks.workunit.client.0.trial030.stdout: "optional": [] 2026-02-17T05:34:58.673 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.673 INFO:tasks.workunit.client.0.trial030.stdout: "mons": [ 2026-02-17T05:34:58.673 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.673 INFO:tasks.workunit.client.0.trial030.stdout: "rank": 0, 2026-02-17T05:34:58.673 INFO:tasks.workunit.client.0.trial030.stdout: "name": "a", 2026-02-17T05:34:58.674 INFO:tasks.workunit.client.0.trial030.stdout: "public_addrs": { 2026-02-17T05:34:58.674 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:34:58.674 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.674 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:34:58.674 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:7115", 2026-02-17T05:34:58.674 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 0 2026-02-17T05:34:58.674 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:58.674 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:34:58.674 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.674 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:7115/0", 2026-02-17T05:34:58.674 INFO:tasks.workunit.client.0.trial030.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-17T05:34:58.674 INFO:tasks.workunit.client.0.trial030.stdout: "priority": 0, 2026-02-17T05:34:58.674 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 0, 2026-02-17T05:34:58.675 INFO:tasks.workunit.client.0.trial030.stdout: "time_added": "2026-02-17T05:33:01:522997+0000", 2026-02-17T05:34:58.675 INFO:tasks.workunit.client.0.trial030.stdout: "crush_location": [] 2026-02-17T05:34:58.675 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:58.675 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:34:58.675 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.675 INFO:tasks.workunit.client.0.trial030.stdout: "quorum": [ 2026-02-17T05:34:58.675 INFO:tasks.workunit.client.0.trial030.stdout: 0 2026-02-17T05:34:58.675 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:34:58.675 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap": { 2026-02-17T05:34:58.675 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 50, 2026-02-17T05:34:58.675 INFO:tasks.workunit.client.0.trial030.stdout: "fsid": "931b36d9-02d4-44f0-bc8b-c9190b7fdb00", 2026-02-17T05:34:58.675 INFO:tasks.workunit.client.0.trial030.stdout: "created": "2026-02-17T05:33:01.611858+0000", 2026-02-17T05:34:58.675 INFO:tasks.workunit.client.0.trial030.stdout: "modified": "2026-02-17T05:34:24.952550+0000", 2026-02-17T05:34:58.676 INFO:tasks.workunit.client.0.trial030.stdout: "last_up_change": "2026-02-17T05:34:24.849716+0000", 2026-02-17T05:34:58.676 INFO:tasks.workunit.client.0.trial030.stdout: "last_in_change": "2026-02-17T05:33:46.966734+0000", 2026-02-17T05:34:58.676 INFO:tasks.workunit.client.0.trial030.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-17T05:34:58.676 INFO:tasks.workunit.client.0.trial030.stdout: "flags_num": 5800384, 2026-02-17T05:34:58.676 INFO:tasks.workunit.client.0.trial030.stdout: "flags_set": [ 2026-02-17T05:34:58.676 INFO:tasks.workunit.client.0.trial030.stdout: "nodown", 2026-02-17T05:34:58.676 INFO:tasks.workunit.client.0.trial030.stdout: "noin", 2026-02-17T05:34:58.676 INFO:tasks.workunit.client.0.trial030.stdout: "noout", 2026-02-17T05:34:58.676 INFO:tasks.workunit.client.0.trial030.stdout: "pglog_hardlimit", 2026-02-17T05:34:58.676 INFO:tasks.workunit.client.0.trial030.stdout: "purged_snapdirs", 2026-02-17T05:34:58.676 INFO:tasks.workunit.client.0.trial030.stdout: "recovery_deletes", 2026-02-17T05:34:58.677 INFO:tasks.workunit.client.0.trial030.stdout: "sortbitwise" 2026-02-17T05:34:58.677 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:34:58.677 INFO:tasks.workunit.client.0.trial030.stdout: "crush_version": 12, 2026-02-17T05:34:58.677 INFO:tasks.workunit.client.0.trial030.stdout: "full_ratio": 0.99000000953674316, 2026-02-17T05:34:58.677 INFO:tasks.workunit.client.0.trial030.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-17T05:34:58.677 INFO:tasks.workunit.client.0.trial030.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-17T05:34:58.677 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_snapshot": "", 2026-02-17T05:34:58.677 INFO:tasks.workunit.client.0.trial030.stdout: "pool_max": 1, 2026-02-17T05:34:58.677 INFO:tasks.workunit.client.0.trial030.stdout: "max_osd": 3, 2026-02-17T05:34:58.677 INFO:tasks.workunit.client.0.trial030.stdout: "require_min_compat_client": "luminous", 2026-02-17T05:34:58.677 INFO:tasks.workunit.client.0.trial030.stdout: "min_compat_client": "jewel", 2026-02-17T05:34:58.677 INFO:tasks.workunit.client.0.trial030.stdout: "require_osd_release": "tentacle", 2026-02-17T05:34:58.678 INFO:tasks.workunit.client.0.trial030.stdout: "allow_crimson": false, 2026-02-17T05:34:58.678 INFO:tasks.workunit.client.0.trial030.stdout: "pools": [ 2026-02-17T05:34:58.678 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.678 INFO:tasks.workunit.client.0.trial030.stdout: "pool": 1, 2026-02-17T05:34:58.678 INFO:tasks.workunit.client.0.trial030.stdout: "pool_name": "test", 2026-02-17T05:34:58.678 INFO:tasks.workunit.client.0.trial030.stdout: "create_time": "2026-02-17T05:33:13.835394+0000", 2026-02-17T05:34:58.678 INFO:tasks.workunit.client.0.trial030.stdout: "flags": 16389, 2026-02-17T05:34:58.678 INFO:tasks.workunit.client.0.trial030.stdout: "flags_names": "hashpspool,ec_overwrites,pool_snaps", 2026-02-17T05:34:58.678 INFO:tasks.workunit.client.0.trial030.stdout: "type": 3, 2026-02-17T05:34:58.678 INFO:tasks.workunit.client.0.trial030.stdout: "size": 3, 2026-02-17T05:34:58.678 INFO:tasks.workunit.client.0.trial030.stdout: "min_size": 2, 2026-02-17T05:34:58.678 INFO:tasks.workunit.client.0.trial030.stdout: "crush_rule": 1, 2026-02-17T05:34:58.679 INFO:tasks.workunit.client.0.trial030.stdout: "peering_crush_bucket_count": 0, 2026-02-17T05:34:58.679 INFO:tasks.workunit.client.0.trial030.stdout: "peering_crush_bucket_target": 0, 2026-02-17T05:34:58.679 INFO:tasks.workunit.client.0.trial030.stdout: "peering_crush_bucket_barrier": 0, 2026-02-17T05:34:58.679 INFO:tasks.workunit.client.0.trial030.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-17T05:34:58.679 INFO:tasks.workunit.client.0.trial030.stdout: "is_stretch_pool": false, 2026-02-17T05:34:58.679 INFO:tasks.workunit.client.0.trial030.stdout: "object_hash": 2, 2026-02-17T05:34:58.679 INFO:tasks.workunit.client.0.trial030.stdout: "pg_autoscale_mode": "off", 2026-02-17T05:34:58.679 INFO:tasks.workunit.client.0.trial030.stdout: "pg_num": 1, 2026-02-17T05:34:58.679 INFO:tasks.workunit.client.0.trial030.stdout: "pg_placement_num": 1, 2026-02-17T05:34:58.679 INFO:tasks.workunit.client.0.trial030.stdout: "pg_placement_num_target": 1, 2026-02-17T05:34:58.679 INFO:tasks.workunit.client.0.trial030.stdout: "pg_num_target": 1, 2026-02-17T05:34:58.679 INFO:tasks.workunit.client.0.trial030.stdout: "pg_num_pending": 1, 2026-02-17T05:34:58.679 INFO:tasks.workunit.client.0.trial030.stdout: "last_pg_merge_meta": { 2026-02-17T05:34:58.680 INFO:tasks.workunit.client.0.trial030.stdout: "source_pgid": "0.0", 2026-02-17T05:34:58.680 INFO:tasks.workunit.client.0.trial030.stdout: "ready_epoch": 0, 2026-02-17T05:34:58.680 INFO:tasks.workunit.client.0.trial030.stdout: "last_epoch_started": 0, 2026-02-17T05:34:58.680 INFO:tasks.workunit.client.0.trial030.stdout: "last_epoch_clean": 0, 2026-02-17T05:34:58.680 INFO:tasks.workunit.client.0.trial030.stdout: "source_version": "0'0", 2026-02-17T05:34:58.680 INFO:tasks.workunit.client.0.trial030.stdout: "target_version": "0'0" 2026-02-17T05:34:58.680 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.680 INFO:tasks.workunit.client.0.trial030.stdout: "last_change": "29", 2026-02-17T05:34:58.680 INFO:tasks.workunit.client.0.trial030.stdout: "last_force_op_resend": "0", 2026-02-17T05:34:58.680 INFO:tasks.workunit.client.0.trial030.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-17T05:34:58.680 INFO:tasks.workunit.client.0.trial030.stdout: "last_force_op_resend_preluminous": "0", 2026-02-17T05:34:58.680 INFO:tasks.workunit.client.0.trial030.stdout: "auid": 0, 2026-02-17T05:34:58.680 INFO:tasks.workunit.client.0.trial030.stdout: "snap_mode": "pool", 2026-02-17T05:34:58.681 INFO:tasks.workunit.client.0.trial030.stdout: "snap_seq": 1, 2026-02-17T05:34:58.681 INFO:tasks.workunit.client.0.trial030.stdout: "snap_epoch": 29, 2026-02-17T05:34:58.681 INFO:tasks.workunit.client.0.trial030.stdout: "pool_snaps": [ 2026-02-17T05:34:58.681 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.681 INFO:tasks.workunit.client.0.trial030.stdout: "snapid": 1, 2026-02-17T05:34:58.681 INFO:tasks.workunit.client.0.trial030.stdout: "stamp": "2026-02-17T05:33:31.057622+0000", 2026-02-17T05:34:58.681 INFO:tasks.workunit.client.0.trial030.stdout: "name": "snap1" 2026-02-17T05:34:58.681 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:58.681 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:34:58.681 INFO:tasks.workunit.client.0.trial030.stdout: "removed_snaps": "[]", 2026-02-17T05:34:58.681 INFO:tasks.workunit.client.0.trial030.stdout: "quota_max_bytes": 0, 2026-02-17T05:34:58.681 INFO:tasks.workunit.client.0.trial030.stdout: "quota_max_objects": 0, 2026-02-17T05:34:58.681 INFO:tasks.workunit.client.0.trial030.stdout: "tiers": [], 2026-02-17T05:34:58.682 INFO:tasks.workunit.client.0.trial030.stdout: "tier_of": -1, 2026-02-17T05:34:58.682 INFO:tasks.workunit.client.0.trial030.stdout: "read_tier": -1, 2026-02-17T05:34:58.682 INFO:tasks.workunit.client.0.trial030.stdout: "write_tier": -1, 2026-02-17T05:34:58.682 INFO:tasks.workunit.client.0.trial030.stdout: "cache_mode": "none", 2026-02-17T05:34:58.682 INFO:tasks.workunit.client.0.trial030.stdout: "target_max_bytes": 0, 2026-02-17T05:34:58.682 INFO:tasks.workunit.client.0.trial030.stdout: "target_max_objects": 0, 2026-02-17T05:34:58.682 INFO:tasks.workunit.client.0.trial030.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-17T05:34:58.682 INFO:tasks.workunit.client.0.trial030.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-17T05:34:58.682 INFO:tasks.workunit.client.0.trial030.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-17T05:34:58.682 INFO:tasks.workunit.client.0.trial030.stdout: "cache_min_flush_age": 0, 2026-02-17T05:34:58.682 INFO:tasks.workunit.client.0.trial030.stdout: "cache_min_evict_age": 0, 2026-02-17T05:34:58.682 INFO:tasks.workunit.client.0.trial030.stdout: "erasure_code_profile": "myprofile", 2026-02-17T05:34:58.682 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_params": { 2026-02-17T05:34:58.683 INFO:tasks.workunit.client.0.trial030.stdout: "type": "none" 2026-02-17T05:34:58.683 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.683 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_period": 0, 2026-02-17T05:34:58.683 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_count": 0, 2026-02-17T05:34:58.683 INFO:tasks.workunit.client.0.trial030.stdout: "use_gmt_hitset": true, 2026-02-17T05:34:58.683 INFO:tasks.workunit.client.0.trial030.stdout: "min_read_recency_for_promote": 0, 2026-02-17T05:34:58.683 INFO:tasks.workunit.client.0.trial030.stdout: "min_write_recency_for_promote": 0, 2026-02-17T05:34:58.683 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_grade_decay_rate": 0, 2026-02-17T05:34:58.683 INFO:tasks.workunit.client.0.trial030.stdout: "hit_set_search_last_n": 0, 2026-02-17T05:34:58.683 INFO:tasks.workunit.client.0.trial030.stdout: "grade_table": [], 2026-02-17T05:34:58.683 INFO:tasks.workunit.client.0.trial030.stdout: "stripe_width": 8192, 2026-02-17T05:34:58.683 INFO:tasks.workunit.client.0.trial030.stdout: "expected_num_objects": 0, 2026-02-17T05:34:58.683 INFO:tasks.workunit.client.0.trial030.stdout: "fast_read": false, 2026-02-17T05:34:58.684 INFO:tasks.workunit.client.0.trial030.stdout: "nonprimary_shards": "{}", 2026-02-17T05:34:58.684 INFO:tasks.workunit.client.0.trial030.stdout: "options": {}, 2026-02-17T05:34:58.684 INFO:tasks.workunit.client.0.trial030.stdout: "application_metadata": {} 2026-02-17T05:34:58.684 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:58.684 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:34:58.684 INFO:tasks.workunit.client.0.trial030.stdout: "osds": [ 2026-02-17T05:34:58.684 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.684 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 0, 2026-02-17T05:34:58.684 INFO:tasks.workunit.client.0.trial030.stdout: "uuid": "ffd61780-fdee-492a-b89a-f0298d033d42", 2026-02-17T05:34:58.684 INFO:tasks.workunit.client.0.trial030.stdout: "up": 1, 2026-02-17T05:34:58.684 INFO:tasks.workunit.client.0.trial030.stdout: "in": 1, 2026-02-17T05:34:58.684 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 1, 2026-02-17T05:34:58.684 INFO:tasks.workunit.client.0.trial030.stdout: "primary_affinity": 1, 2026-02-17T05:34:58.685 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_begin": 36, 2026-02-17T05:34:58.685 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_end": 42, 2026-02-17T05:34:58.685 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 45, 2026-02-17T05:34:58.685 INFO:tasks.workunit.client.0.trial030.stdout: "up_thru": 49, 2026-02-17T05:34:58.685 INFO:tasks.workunit.client.0.trial030.stdout: "down_at": 44, 2026-02-17T05:34:58.685 INFO:tasks.workunit.client.0.trial030.stdout: "lost_at": 0, 2026-02-17T05:34:58.685 INFO:tasks.workunit.client.0.trial030.stdout: "public_addrs": { 2026-02-17T05:34:58.685 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:34:58.685 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.685 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:34:58.685 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6800", 2026-02-17T05:34:58.685 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1584474654 2026-02-17T05:34:58.685 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.686 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.686 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:34:58.686 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6801", 2026-02-17T05:34:58.686 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1584474654 2026-02-17T05:34:58.686 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:58.686 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:34:58.686 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.686 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addrs": { 2026-02-17T05:34:58.686 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:34:58.686 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.686 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:34:58.686 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6802", 2026-02-17T05:34:58.687 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1584474654 2026-02-17T05:34:58.687 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.687 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.687 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:34:58.687 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6803", 2026-02-17T05:34:58.687 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1584474654 2026-02-17T05:34:58.687 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:58.687 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:34:58.687 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.687 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addrs": { 2026-02-17T05:34:58.687 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:34:58.687 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.687 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:34:58.688 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6806", 2026-02-17T05:34:58.688 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1584474654 2026-02-17T05:34:58.688 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.688 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.688 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:34:58.688 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6807", 2026-02-17T05:34:58.688 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1584474654 2026-02-17T05:34:58.688 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:58.688 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:34:58.688 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.688 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addrs": { 2026-02-17T05:34:58.688 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:34:58.688 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.689 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:34:58.689 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6804", 2026-02-17T05:34:58.689 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1584474654 2026-02-17T05:34:58.689 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.689 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.689 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:34:58.689 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6805", 2026-02-17T05:34:58.689 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1584474654 2026-02-17T05:34:58.689 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:58.689 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:34:58.689 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.689 INFO:tasks.workunit.client.0.trial030.stdout: "public_addr": "127.0.0.1:6801/1584474654", 2026-02-17T05:34:58.689 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addr": "127.0.0.1:6803/1584474654", 2026-02-17T05:34:58.690 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addr": "127.0.0.1:6807/1584474654", 2026-02-17T05:34:58.690 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addr": "127.0.0.1:6805/1584474654", 2026-02-17T05:34:58.690 INFO:tasks.workunit.client.0.trial030.stdout: "state": [ 2026-02-17T05:34:58.690 INFO:tasks.workunit.client.0.trial030.stdout: "exists", 2026-02-17T05:34:58.690 INFO:tasks.workunit.client.0.trial030.stdout: "up" 2026-02-17T05:34:58.690 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:34:58.690 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.690 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.690 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 1, 2026-02-17T05:34:58.690 INFO:tasks.workunit.client.0.trial030.stdout: "uuid": "66e43dc5-03ed-42cb-985e-85686a5152c5", 2026-02-17T05:34:58.690 INFO:tasks.workunit.client.0.trial030.stdout: "up": 0, 2026-02-17T05:34:58.690 INFO:tasks.workunit.client.0.trial030.stdout: "in": 1, 2026-02-17T05:34:58.690 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 1, 2026-02-17T05:34:58.691 INFO:tasks.workunit.client.0.trial030.stdout: "primary_affinity": 1, 2026-02-17T05:34:58.691 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_begin": 0, 2026-02-17T05:34:58.691 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_end": 0, 2026-02-17T05:34:58.691 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 9, 2026-02-17T05:34:58.691 INFO:tasks.workunit.client.0.trial030.stdout: "up_thru": 24, 2026-02-17T05:34:58.691 INFO:tasks.workunit.client.0.trial030.stdout: "down_at": 31, 2026-02-17T05:34:58.691 INFO:tasks.workunit.client.0.trial030.stdout: "lost_at": 0, 2026-02-17T05:34:58.691 INFO:tasks.workunit.client.0.trial030.stdout: "public_addrs": { 2026-02-17T05:34:58.691 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:34:58.691 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.691 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:34:58.691 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6810", 2026-02-17T05:34:58.692 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2668219398 2026-02-17T05:34:58.692 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.692 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.692 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:34:58.692 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6811", 2026-02-17T05:34:58.692 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2668219398 2026-02-17T05:34:58.692 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:58.692 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:34:58.692 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.692 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addrs": { 2026-02-17T05:34:58.692 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:34:58.692 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.692 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:34:58.693 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6812", 2026-02-17T05:34:58.693 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2668219398 2026-02-17T05:34:58.693 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.693 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.693 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:34:58.693 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6813", 2026-02-17T05:34:58.693 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2668219398 2026-02-17T05:34:58.693 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:58.693 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:34:58.693 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.693 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addrs": { 2026-02-17T05:34:58.693 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:34:58.693 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.694 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:34:58.694 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6816", 2026-02-17T05:34:58.694 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2668219398 2026-02-17T05:34:58.694 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.694 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.694 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:34:58.694 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6817", 2026-02-17T05:34:58.694 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2668219398 2026-02-17T05:34:58.694 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:58.694 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:34:58.694 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.694 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addrs": { 2026-02-17T05:34:58.694 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:34:58.695 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.695 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:34:58.695 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6814", 2026-02-17T05:34:58.695 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2668219398 2026-02-17T05:34:58.695 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.695 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.695 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:34:58.695 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6815", 2026-02-17T05:34:58.695 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 2668219398 2026-02-17T05:34:58.695 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:58.695 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:34:58.695 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.695 INFO:tasks.workunit.client.0.trial030.stdout: "public_addr": "127.0.0.1:6811/2668219398", 2026-02-17T05:34:58.696 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addr": "127.0.0.1:6813/2668219398", 2026-02-17T05:34:58.696 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addr": "127.0.0.1:6817/2668219398", 2026-02-17T05:34:58.696 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addr": "127.0.0.1:6815/2668219398", 2026-02-17T05:34:58.696 INFO:tasks.workunit.client.0.trial030.stdout: "state": [ 2026-02-17T05:34:58.696 INFO:tasks.workunit.client.0.trial030.stdout: "exists" 2026-02-17T05:34:58.696 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:34:58.696 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.696 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.696 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2, 2026-02-17T05:34:58.696 INFO:tasks.workunit.client.0.trial030.stdout: "uuid": "09dea4cc-8ddf-4609-83f3-70b490de0aa5", 2026-02-17T05:34:58.696 INFO:tasks.workunit.client.0.trial030.stdout: "up": 1, 2026-02-17T05:34:58.696 INFO:tasks.workunit.client.0.trial030.stdout: "in": 1, 2026-02-17T05:34:58.696 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 1, 2026-02-17T05:34:58.697 INFO:tasks.workunit.client.0.trial030.stdout: "primary_affinity": 1, 2026-02-17T05:34:58.697 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_begin": 39, 2026-02-17T05:34:58.697 INFO:tasks.workunit.client.0.trial030.stdout: "last_clean_end": 42, 2026-02-17T05:34:58.697 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 49, 2026-02-17T05:34:58.697 INFO:tasks.workunit.client.0.trial030.stdout: "up_thru": 0, 2026-02-17T05:34:58.697 INFO:tasks.workunit.client.0.trial030.stdout: "down_at": 48, 2026-02-17T05:34:58.697 INFO:tasks.workunit.client.0.trial030.stdout: "lost_at": 0, 2026-02-17T05:34:58.697 INFO:tasks.workunit.client.0.trial030.stdout: "public_addrs": { 2026-02-17T05:34:58.697 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:34:58.697 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.697 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:34:58.697 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6810", 2026-02-17T05:34:58.697 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1142442231 2026-02-17T05:34:58.698 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.698 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.698 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:34:58.698 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6811", 2026-02-17T05:34:58.698 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1142442231 2026-02-17T05:34:58.698 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:58.698 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:34:58.698 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.698 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addrs": { 2026-02-17T05:34:58.698 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:34:58.698 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.698 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:34:58.698 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6812", 2026-02-17T05:34:58.698 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1142442231 2026-02-17T05:34:58.699 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.699 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.699 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:34:58.699 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6813", 2026-02-17T05:34:58.699 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1142442231 2026-02-17T05:34:58.699 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:58.699 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:34:58.699 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.699 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addrs": { 2026-02-17T05:34:58.699 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:34:58.699 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.699 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:34:58.699 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6816", 2026-02-17T05:34:58.699 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1142442231 2026-02-17T05:34:58.699 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.700 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.700 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:34:58.700 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6817", 2026-02-17T05:34:58.700 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1142442231 2026-02-17T05:34:58.700 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:58.700 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:34:58.700 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.700 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addrs": { 2026-02-17T05:34:58.700 INFO:tasks.workunit.client.0.trial030.stdout: "addrvec": [ 2026-02-17T05:34:58.700 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.700 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v2", 2026-02-17T05:34:58.700 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6814", 2026-02-17T05:34:58.700 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1142442231 2026-02-17T05:34:58.700 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.700 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.701 INFO:tasks.workunit.client.0.trial030.stdout: "type": "v1", 2026-02-17T05:34:58.701 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "127.0.0.1:6815", 2026-02-17T05:34:58.701 INFO:tasks.workunit.client.0.trial030.stdout: "nonce": 1142442231 2026-02-17T05:34:58.701 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:58.701 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:34:58.701 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.701 INFO:tasks.workunit.client.0.trial030.stdout: "public_addr": "127.0.0.1:6811/1142442231", 2026-02-17T05:34:58.701 INFO:tasks.workunit.client.0.trial030.stdout: "cluster_addr": "127.0.0.1:6813/1142442231", 2026-02-17T05:34:58.701 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_back_addr": "127.0.0.1:6817/1142442231", 2026-02-17T05:34:58.701 INFO:tasks.workunit.client.0.trial030.stdout: "heartbeat_front_addr": "127.0.0.1:6815/1142442231", 2026-02-17T05:34:58.701 INFO:tasks.workunit.client.0.trial030.stdout: "state": [ 2026-02-17T05:34:58.701 INFO:tasks.workunit.client.0.trial030.stdout: "exists", 2026-02-17T05:34:58.701 INFO:tasks.workunit.client.0.trial030.stdout: "up" 2026-02-17T05:34:58.701 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:34:58.702 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:58.702 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:34:58.702 INFO:tasks.workunit.client.0.trial030.stdout: "osd_xinfo": [ 2026-02-17T05:34:58.702 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.702 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 0, 2026-02-17T05:34:58.702 INFO:tasks.workunit.client.0.trial030.stdout: "down_stamp": "2026-02-17T05:34:23.805264+0000", 2026-02-17T05:34:58.702 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_probability": 0, 2026-02-17T05:34:58.702 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_interval": 0, 2026-02-17T05:34:58.702 INFO:tasks.workunit.client.0.trial030.stdout: "features": 4544132024016699391, 2026-02-17T05:34:58.702 INFO:tasks.workunit.client.0.trial030.stdout: "old_weight": 0, 2026-02-17T05:34:58.702 INFO:tasks.workunit.client.0.trial030.stdout: "last_purged_snaps_scrub": "2026-02-17T05:33:05.364715+0000", 2026-02-17T05:34:58.702 INFO:tasks.workunit.client.0.trial030.stdout: "dead_epoch": 0 2026-02-17T05:34:58.702 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.702 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.702 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 1, 2026-02-17T05:34:58.702 INFO:tasks.workunit.client.0.trial030.stdout: "down_stamp": "2026-02-17T05:33:42.001152+0000", 2026-02-17T05:34:58.703 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_probability": 0, 2026-02-17T05:34:58.703 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_interval": 0, 2026-02-17T05:34:58.703 INFO:tasks.workunit.client.0.trial030.stdout: "features": 4544132024016699391, 2026-02-17T05:34:58.703 INFO:tasks.workunit.client.0.trial030.stdout: "old_weight": 0, 2026-02-17T05:34:58.703 INFO:tasks.workunit.client.0.trial030.stdout: "last_purged_snaps_scrub": "2026-02-17T05:33:08.658208+0000", 2026-02-17T05:34:58.703 INFO:tasks.workunit.client.0.trial030.stdout: "dead_epoch": 0 2026-02-17T05:34:58.703 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.703 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.703 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2, 2026-02-17T05:34:58.703 INFO:tasks.workunit.client.0.trial030.stdout: "down_stamp": "2026-02-17T05:34:24.747797+0000", 2026-02-17T05:34:58.703 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_probability": 0, 2026-02-17T05:34:58.703 INFO:tasks.workunit.client.0.trial030.stdout: "laggy_interval": 0, 2026-02-17T05:34:58.703 INFO:tasks.workunit.client.0.trial030.stdout: "features": 4544132024016699391, 2026-02-17T05:34:58.703 INFO:tasks.workunit.client.0.trial030.stdout: "old_weight": 0, 2026-02-17T05:34:58.703 INFO:tasks.workunit.client.0.trial030.stdout: "last_purged_snaps_scrub": "2026-02-17T05:33:11.611472+0000", 2026-02-17T05:34:58.703 INFO:tasks.workunit.client.0.trial030.stdout: "dead_epoch": 0 2026-02-17T05:34:58.704 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:58.704 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:34:58.704 INFO:tasks.workunit.client.0.trial030.stdout: "pg_upmap": [], 2026-02-17T05:34:58.704 INFO:tasks.workunit.client.0.trial030.stdout: "pg_upmap_items": [], 2026-02-17T05:34:58.704 INFO:tasks.workunit.client.0.trial030.stdout: "pg_upmap_primaries": [], 2026-02-17T05:34:58.704 INFO:tasks.workunit.client.0.trial030.stdout: "pg_temp": [], 2026-02-17T05:34:58.704 INFO:tasks.workunit.client.0.trial030.stdout: "primary_temp": [], 2026-02-17T05:34:58.704 INFO:tasks.workunit.client.0.trial030.stdout: "blocklist": {}, 2026-02-17T05:34:58.704 INFO:tasks.workunit.client.0.trial030.stdout: "range_blocklist": {}, 2026-02-17T05:34:58.704 INFO:tasks.workunit.client.0.trial030.stdout: "erasure_code_profiles": { 2026-02-17T05:34:58.704 INFO:tasks.workunit.client.0.trial030.stdout: "default": { 2026-02-17T05:34:58.704 INFO:tasks.workunit.client.0.trial030.stdout: "k": "2", 2026-02-17T05:34:58.704 INFO:tasks.workunit.client.0.trial030.stdout: "m": "2", 2026-02-17T05:34:58.705 INFO:tasks.workunit.client.0.trial030.stdout: "plugin": "isa", 2026-02-17T05:34:58.705 INFO:tasks.workunit.client.0.trial030.stdout: "technique": "reed_sol_van" 2026-02-17T05:34:58.705 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.705 INFO:tasks.workunit.client.0.trial030.stdout: "myprofile": { 2026-02-17T05:34:58.705 INFO:tasks.workunit.client.0.trial030.stdout: "crush-device-class": "", 2026-02-17T05:34:58.705 INFO:tasks.workunit.client.0.trial030.stdout: "crush-failure-domain": "osd", 2026-02-17T05:34:58.705 INFO:tasks.workunit.client.0.trial030.stdout: "crush-num-failure-domains": "0", 2026-02-17T05:34:58.705 INFO:tasks.workunit.client.0.trial030.stdout: "crush-osds-per-failure-domain": "0", 2026-02-17T05:34:58.705 INFO:tasks.workunit.client.0.trial030.stdout: "crush-root": "default", 2026-02-17T05:34:58.705 INFO:tasks.workunit.client.0.trial030.stdout: "k": "2", 2026-02-17T05:34:58.705 INFO:tasks.workunit.client.0.trial030.stdout: "m": "1", 2026-02-17T05:34:58.705 INFO:tasks.workunit.client.0.trial030.stdout: "plugin": "isa", 2026-02-17T05:34:58.705 INFO:tasks.workunit.client.0.trial030.stdout: "technique": "reed_sol_van" 2026-02-17T05:34:58.705 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:58.705 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.705 INFO:tasks.workunit.client.0.trial030.stdout: "removed_snaps_queue": [], 2026-02-17T05:34:58.705 INFO:tasks.workunit.client.0.trial030.stdout: "new_removed_snaps": [], 2026-02-17T05:34:58.705 INFO:tasks.workunit.client.0.trial030.stdout: "new_purged_snaps": [], 2026-02-17T05:34:58.706 INFO:tasks.workunit.client.0.trial030.stdout: "crush_node_flags": {}, 2026-02-17T05:34:58.706 INFO:tasks.workunit.client.0.trial030.stdout: "device_class_flags": {}, 2026-02-17T05:34:58.706 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_mode": { 2026-02-17T05:34:58.706 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_mode_enabled": false, 2026-02-17T05:34:58.706 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_bucket_count": 0, 2026-02-17T05:34:58.706 INFO:tasks.workunit.client.0.trial030.stdout: "degraded_stretch_mode": 0, 2026-02-17T05:34:58.706 INFO:tasks.workunit.client.0.trial030.stdout: "recovering_stretch_mode": 0, 2026-02-17T05:34:58.706 INFO:tasks.workunit.client.0.trial030.stdout: "stretch_mode_bucket": 0 2026-02-17T05:34:58.706 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:58.706 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.706 INFO:tasks.workunit.client.0.trial030.stdout: "osd_metadata": [ 2026-02-17T05:34:58.706 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.706 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-17T05:34:58.706 INFO:tasks.workunit.client.0.trial030.stdout: "arch": "x86_64", 2026-02-17T05:34:58.706 INFO:tasks.workunit.client.0.trial030.stdout: "back_addr": "[v2:127.0.0.1:6802/1584474654,v1:127.0.0.1:6803/1584474654]", 2026-02-17T05:34:58.706 INFO:tasks.workunit.client.0.trial030.stdout: "back_iface": "", 2026-02-17T05:34:58.706 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs": "1", 2026-02-17T05:34:58.706 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_db": "0", 2026-02-17T05:34:58.707 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T05:34:58.707 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_single_shared_device": "1", 2026-02-17T05:34:58.707 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T05:34:58.707 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocator": "hybrid", 2026-02-17T05:34:58.707 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T05:34:58.707 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T05:34:58.707 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T05:34:58.707 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T05:34:58.707 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T05:34:58.707 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-17T05:34:58.707 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T05:34:58.707 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T05:34:58.707 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T05:34:58.707 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T05:34:58.707 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-17T05:34:58.707 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T05:34:58.707 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T05:34:58.707 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_write_mode": "classic", 2026-02-17T05:34:58.708 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_release": "tentacle", 2026-02-17T05:34:58.708 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version": "ceph version 20.3.0-5271-g32585015 (325850157d309f65985eea9ec9bb9f1d56726fee) tentacle (dev - None)", 2026-02-17T05:34:58.708 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_short": "20.3.0-5271-g32585015", 2026-02-17T05:34:58.708 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_when_created": "ceph version 20.3.0-5271-g32585015 (325850157d309f65985eea9ec9bb9f1d56726fee) tentacle (dev - None)", 2026-02-17T05:34:58.708 INFO:tasks.workunit.client.0.trial030.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T05:34:58.708 INFO:tasks.workunit.client.0.trial030.stdout: "created_at": "2026-02-17T05:33:02.547087Z", 2026-02-17T05:34:58.708 INFO:tasks.workunit.client.0.trial030.stdout: "default_device_class": "ssd", 2026-02-17T05:34:58.708 INFO:tasks.workunit.client.0.trial030.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6B65", 2026-02-17T05:34:58.708 INFO:tasks.workunit.client.0.trial030.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T05:34:58.708 INFO:tasks.workunit.client.0.trial030.stdout: "devices": "nvme0n1", 2026-02-17T05:34:58.708 INFO:tasks.workunit.client.0.trial030.stdout: "distro": "ubuntu", 2026-02-17T05:34:58.708 INFO:tasks.workunit.client.0.trial030.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T05:34:58.708 INFO:tasks.workunit.client.0.trial030.stdout: "distro_version": "22.04", 2026-02-17T05:34:58.708 INFO:tasks.workunit.client.0.trial030.stdout: "front_addr": "[v2:127.0.0.1:6800/1584474654,v1:127.0.0.1:6801/1584474654]", 2026-02-17T05:34:58.708 INFO:tasks.workunit.client.0.trial030.stdout: "front_iface": "", 2026-02-17T05:34:58.708 INFO:tasks.workunit.client.0.trial030.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/1584474654,v1:127.0.0.1:6807/1584474654]", 2026-02-17T05:34:58.709 INFO:tasks.workunit.client.0.trial030.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/1584474654,v1:127.0.0.1:6805/1584474654]", 2026-02-17T05:34:58.709 INFO:tasks.workunit.client.0.trial030.stdout: "hostname": "trial030", 2026-02-17T05:34:58.709 INFO:tasks.workunit.client.0.trial030.stdout: "journal_rotational": "0", 2026-02-17T05:34:58.709 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T05:34:58.709 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T05:34:58.709 INFO:tasks.workunit.client.0.trial030.stdout: "mem_swap_kb": "8388604", 2026-02-17T05:34:58.709 INFO:tasks.workunit.client.0.trial030.stdout: "mem_total_kb": "130961692", 2026-02-17T05:34:58.709 INFO:tasks.workunit.client.0.trial030.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T05:34:58.709 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_node": "0", 2026-02-17T05:34:58.709 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_nodes": "0", 2026-02-17T05:34:58.709 INFO:tasks.workunit.client.0.trial030.stdout: "os": "Linux", 2026-02-17T05:34:58.709 INFO:tasks.workunit.client.0.trial030.stdout: "osd_data": "td/divergent-priors/0", 2026-02-17T05:34:58.709 INFO:tasks.workunit.client.0.trial030.stdout: "osd_objectstore": "bluestore", 2026-02-17T05:34:58.709 INFO:tasks.workunit.client.0.trial030.stdout: "osdspec_affinity": "", 2026-02-17T05:34:58.709 INFO:tasks.workunit.client.0.trial030.stdout: "rotational": "0" 2026-02-17T05:34:58.709 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.710 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.710 INFO:tasks.workunit.client.0.trial030.stdout: "id": 1, 2026-02-17T05:34:58.710 INFO:tasks.workunit.client.0.trial030.stdout: "arch": "x86_64", 2026-02-17T05:34:58.710 INFO:tasks.workunit.client.0.trial030.stdout: "back_addr": "[v2:127.0.0.1:6812/2668219398,v1:127.0.0.1:6813/2668219398]", 2026-02-17T05:34:58.710 INFO:tasks.workunit.client.0.trial030.stdout: "back_iface": "", 2026-02-17T05:34:58.710 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs": "1", 2026-02-17T05:34:58.710 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_db": "0", 2026-02-17T05:34:58.710 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T05:34:58.710 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_single_shared_device": "1", 2026-02-17T05:34:58.710 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T05:34:58.710 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocator": "hybrid", 2026-02-17T05:34:58.710 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T05:34:58.710 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T05:34:58.710 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T05:34:58.710 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T05:34:58.710 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T05:34:58.710 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-17T05:34:58.710 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T05:34:58.710 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T05:34:58.711 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T05:34:58.711 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T05:34:58.711 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-17T05:34:58.711 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T05:34:58.711 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T05:34:58.711 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_write_mode": "classic", 2026-02-17T05:34:58.711 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_release": "tentacle", 2026-02-17T05:34:58.711 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version": "ceph version 20.3.0-5271-g32585015 (325850157d309f65985eea9ec9bb9f1d56726fee) tentacle (dev - None)", 2026-02-17T05:34:58.711 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_short": "20.3.0-5271-g32585015", 2026-02-17T05:34:58.711 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_when_created": "ceph version 20.3.0-5271-g32585015 (325850157d309f65985eea9ec9bb9f1d56726fee) tentacle (dev - None)", 2026-02-17T05:34:58.711 INFO:tasks.workunit.client.0.trial030.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T05:34:58.711 INFO:tasks.workunit.client.0.trial030.stdout: "created_at": "2026-02-17T05:33:06.264025Z", 2026-02-17T05:34:58.711 INFO:tasks.workunit.client.0.trial030.stdout: "default_device_class": "ssd", 2026-02-17T05:34:58.711 INFO:tasks.workunit.client.0.trial030.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6B65", 2026-02-17T05:34:58.711 INFO:tasks.workunit.client.0.trial030.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T05:34:58.711 INFO:tasks.workunit.client.0.trial030.stdout: "devices": "nvme0n1", 2026-02-17T05:34:58.711 INFO:tasks.workunit.client.0.trial030.stdout: "distro": "ubuntu", 2026-02-17T05:34:58.711 INFO:tasks.workunit.client.0.trial030.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T05:34:58.711 INFO:tasks.workunit.client.0.trial030.stdout: "distro_version": "22.04", 2026-02-17T05:34:58.711 INFO:tasks.workunit.client.0.trial030.stdout: "front_addr": "[v2:127.0.0.1:6810/2668219398,v1:127.0.0.1:6811/2668219398]", 2026-02-17T05:34:58.711 INFO:tasks.workunit.client.0.trial030.stdout: "front_iface": "", 2026-02-17T05:34:58.711 INFO:tasks.workunit.client.0.trial030.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/2668219398,v1:127.0.0.1:6817/2668219398]", 2026-02-17T05:34:58.712 INFO:tasks.workunit.client.0.trial030.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/2668219398,v1:127.0.0.1:6815/2668219398]", 2026-02-17T05:34:58.712 INFO:tasks.workunit.client.0.trial030.stdout: "hostname": "trial030", 2026-02-17T05:34:58.712 INFO:tasks.workunit.client.0.trial030.stdout: "journal_rotational": "0", 2026-02-17T05:34:58.712 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T05:34:58.712 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T05:34:58.712 INFO:tasks.workunit.client.0.trial030.stdout: "mem_swap_kb": "8388604", 2026-02-17T05:34:58.712 INFO:tasks.workunit.client.0.trial030.stdout: "mem_total_kb": "130961692", 2026-02-17T05:34:58.712 INFO:tasks.workunit.client.0.trial030.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T05:34:58.712 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_node": "0", 2026-02-17T05:34:58.712 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_nodes": "0", 2026-02-17T05:34:58.712 INFO:tasks.workunit.client.0.trial030.stdout: "os": "Linux", 2026-02-17T05:34:58.712 INFO:tasks.workunit.client.0.trial030.stdout: "osd_data": "td/divergent-priors/1", 2026-02-17T05:34:58.712 INFO:tasks.workunit.client.0.trial030.stdout: "osd_objectstore": "bluestore", 2026-02-17T05:34:58.712 INFO:tasks.workunit.client.0.trial030.stdout: "osdspec_affinity": "", 2026-02-17T05:34:58.712 INFO:tasks.workunit.client.0.trial030.stdout: "rotational": "0" 2026-02-17T05:34:58.712 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.712 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.712 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-17T05:34:58.712 INFO:tasks.workunit.client.0.trial030.stdout: "arch": "x86_64", 2026-02-17T05:34:58.712 INFO:tasks.workunit.client.0.trial030.stdout: "back_addr": "[v2:127.0.0.1:6812/1142442231,v1:127.0.0.1:6813/1142442231]", 2026-02-17T05:34:58.713 INFO:tasks.workunit.client.0.trial030.stdout: "back_iface": "", 2026-02-17T05:34:58.713 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs": "1", 2026-02-17T05:34:58.713 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_db": "0", 2026-02-17T05:34:58.713 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T05:34:58.713 INFO:tasks.workunit.client.0.trial030.stdout: "bluefs_single_shared_device": "1", 2026-02-17T05:34:58.713 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T05:34:58.713 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_allocator": "hybrid", 2026-02-17T05:34:58.713 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T05:34:58.713 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T05:34:58.713 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T05:34:58.713 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T05:34:58.713 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T05:34:58.713 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-17T05:34:58.713 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T05:34:58.713 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T05:34:58.713 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T05:34:58.713 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T05:34:58.713 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-17T05:34:58.713 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T05:34:58.713 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T05:34:58.713 INFO:tasks.workunit.client.0.trial030.stdout: "bluestore_write_mode": "classic", 2026-02-17T05:34:58.714 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_release": "tentacle", 2026-02-17T05:34:58.714 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version": "ceph version 20.3.0-5271-g32585015 (325850157d309f65985eea9ec9bb9f1d56726fee) tentacle (dev - None)", 2026-02-17T05:34:58.714 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_short": "20.3.0-5271-g32585015", 2026-02-17T05:34:58.714 INFO:tasks.workunit.client.0.trial030.stdout: "ceph_version_when_created": "ceph version 20.3.0-5271-g32585015 (325850157d309f65985eea9ec9bb9f1d56726fee) tentacle (dev - None)", 2026-02-17T05:34:58.714 INFO:tasks.workunit.client.0.trial030.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T05:34:58.714 INFO:tasks.workunit.client.0.trial030.stdout: "created_at": "2026-02-17T05:33:09.137649Z", 2026-02-17T05:34:58.714 INFO:tasks.workunit.client.0.trial030.stdout: "default_device_class": "ssd", 2026-02-17T05:34:58.714 INFO:tasks.workunit.client.0.trial030.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6B65", 2026-02-17T05:34:58.714 INFO:tasks.workunit.client.0.trial030.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T05:34:58.714 INFO:tasks.workunit.client.0.trial030.stdout: "devices": "nvme0n1", 2026-02-17T05:34:58.714 INFO:tasks.workunit.client.0.trial030.stdout: "distro": "ubuntu", 2026-02-17T05:34:58.714 INFO:tasks.workunit.client.0.trial030.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T05:34:58.714 INFO:tasks.workunit.client.0.trial030.stdout: "distro_version": "22.04", 2026-02-17T05:34:58.714 INFO:tasks.workunit.client.0.trial030.stdout: "front_addr": "[v2:127.0.0.1:6810/1142442231,v1:127.0.0.1:6811/1142442231]", 2026-02-17T05:34:58.714 INFO:tasks.workunit.client.0.trial030.stdout: "front_iface": "", 2026-02-17T05:34:58.714 INFO:tasks.workunit.client.0.trial030.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/1142442231,v1:127.0.0.1:6817/1142442231]", 2026-02-17T05:34:58.714 INFO:tasks.workunit.client.0.trial030.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/1142442231,v1:127.0.0.1:6815/1142442231]", 2026-02-17T05:34:58.714 INFO:tasks.workunit.client.0.trial030.stdout: "hostname": "trial030", 2026-02-17T05:34:58.714 INFO:tasks.workunit.client.0.trial030.stdout: "journal_rotational": "0", 2026-02-17T05:34:58.714 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T05:34:58.714 INFO:tasks.workunit.client.0.trial030.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T05:34:58.715 INFO:tasks.workunit.client.0.trial030.stdout: "mem_swap_kb": "8388604", 2026-02-17T05:34:58.715 INFO:tasks.workunit.client.0.trial030.stdout: "mem_total_kb": "130961692", 2026-02-17T05:34:58.715 INFO:tasks.workunit.client.0.trial030.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T05:34:58.715 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_node": "0", 2026-02-17T05:34:58.715 INFO:tasks.workunit.client.0.trial030.stdout: "objectstore_numa_nodes": "0", 2026-02-17T05:34:58.715 INFO:tasks.workunit.client.0.trial030.stdout: "os": "Linux", 2026-02-17T05:34:58.715 INFO:tasks.workunit.client.0.trial030.stdout: "osd_data": "td/divergent-priors/2", 2026-02-17T05:34:58.715 INFO:tasks.workunit.client.0.trial030.stdout: "osd_objectstore": "bluestore", 2026-02-17T05:34:58.715 INFO:tasks.workunit.client.0.trial030.stdout: "osdspec_affinity": "", 2026-02-17T05:34:58.715 INFO:tasks.workunit.client.0.trial030.stdout: "rotational": "0" 2026-02-17T05:34:58.715 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:58.715 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:34:58.715 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap_clean_epochs": { 2026-02-17T05:34:58.715 INFO:tasks.workunit.client.0.trial030.stdout: "min_last_epoch_clean": 25, 2026-02-17T05:34:58.715 INFO:tasks.workunit.client.0.trial030.stdout: "last_epoch_clean": { 2026-02-17T05:34:58.715 INFO:tasks.workunit.client.0.trial030.stdout: "per_pool": [ 2026-02-17T05:34:58.715 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.715 INFO:tasks.workunit.client.0.trial030.stdout: "poolid": 1, 2026-02-17T05:34:58.715 INFO:tasks.workunit.client.0.trial030.stdout: "floor": 25 2026-02-17T05:34:58.715 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:58.715 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:34:58.716 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.716 INFO:tasks.workunit.client.0.trial030.stdout: "osd_epochs": [ 2026-02-17T05:34:58.716 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.716 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-17T05:34:58.716 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 46 2026-02-17T05:34:58.716 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.716 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.716 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-17T05:34:58.716 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 50 2026-02-17T05:34:58.716 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:58.716 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:34:58.716 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.716 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap_first_committed": 1, 2026-02-17T05:34:58.716 INFO:tasks.workunit.client.0.trial030.stdout: "osdmap_last_committed": 50, 2026-02-17T05:34:58.716 INFO:tasks.workunit.client.0.trial030.stdout: "crushmap": { 2026-02-17T05:34:58.716 INFO:tasks.workunit.client.0.trial030.stdout: "devices": [ 2026-02-17T05:34:58.716 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.716 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-17T05:34:58.716 INFO:tasks.workunit.client.0.trial030.stdout: "name": "osd.0", 2026-02-17T05:34:58.716 INFO:tasks.workunit.client.0.trial030.stdout: "class": "ssd" 2026-02-17T05:34:58.716 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.716 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.716 INFO:tasks.workunit.client.0.trial030.stdout: "id": 1, 2026-02-17T05:34:58.717 INFO:tasks.workunit.client.0.trial030.stdout: "name": "osd.1", 2026-02-17T05:34:58.717 INFO:tasks.workunit.client.0.trial030.stdout: "class": "ssd" 2026-02-17T05:34:58.717 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.717 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.717 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-17T05:34:58.717 INFO:tasks.workunit.client.0.trial030.stdout: "name": "osd.2", 2026-02-17T05:34:58.717 INFO:tasks.workunit.client.0.trial030.stdout: "class": "ssd" 2026-02-17T05:34:58.717 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:58.717 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:34:58.717 INFO:tasks.workunit.client.0.trial030.stdout: "types": [ 2026-02-17T05:34:58.717 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.717 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 0, 2026-02-17T05:34:58.717 INFO:tasks.workunit.client.0.trial030.stdout: "name": "osd" 2026-02-17T05:34:58.717 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.717 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.717 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 1, 2026-02-17T05:34:58.717 INFO:tasks.workunit.client.0.trial030.stdout: "name": "host" 2026-02-17T05:34:58.717 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.717 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.717 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 2, 2026-02-17T05:34:58.717 INFO:tasks.workunit.client.0.trial030.stdout: "name": "chassis" 2026-02-17T05:34:58.717 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.717 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.718 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 3, 2026-02-17T05:34:58.718 INFO:tasks.workunit.client.0.trial030.stdout: "name": "rack" 2026-02-17T05:34:58.718 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.718 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.718 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 4, 2026-02-17T05:34:58.718 INFO:tasks.workunit.client.0.trial030.stdout: "name": "row" 2026-02-17T05:34:58.718 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.718 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.718 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 5, 2026-02-17T05:34:58.718 INFO:tasks.workunit.client.0.trial030.stdout: "name": "pdu" 2026-02-17T05:34:58.718 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.718 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.718 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 6, 2026-02-17T05:34:58.718 INFO:tasks.workunit.client.0.trial030.stdout: "name": "pod" 2026-02-17T05:34:58.718 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.718 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.718 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 7, 2026-02-17T05:34:58.718 INFO:tasks.workunit.client.0.trial030.stdout: "name": "room" 2026-02-17T05:34:58.718 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.718 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.718 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 8, 2026-02-17T05:34:58.718 INFO:tasks.workunit.client.0.trial030.stdout: "name": "datacenter" 2026-02-17T05:34:58.718 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.719 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.719 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 9, 2026-02-17T05:34:58.719 INFO:tasks.workunit.client.0.trial030.stdout: "name": "zone" 2026-02-17T05:34:58.719 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.719 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.719 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 10, 2026-02-17T05:34:58.719 INFO:tasks.workunit.client.0.trial030.stdout: "name": "region" 2026-02-17T05:34:58.719 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.719 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.719 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 11, 2026-02-17T05:34:58.719 INFO:tasks.workunit.client.0.trial030.stdout: "name": "root" 2026-02-17T05:34:58.719 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:58.719 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:34:58.719 INFO:tasks.workunit.client.0.trial030.stdout: "buckets": [ 2026-02-17T05:34:58.719 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.719 INFO:tasks.workunit.client.0.trial030.stdout: "id": -1, 2026-02-17T05:34:58.719 INFO:tasks.workunit.client.0.trial030.stdout: "name": "default", 2026-02-17T05:34:58.719 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 11, 2026-02-17T05:34:58.719 INFO:tasks.workunit.client.0.trial030.stdout: "type_name": "root", 2026-02-17T05:34:58.719 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-17T05:34:58.719 INFO:tasks.workunit.client.0.trial030.stdout: "alg": "straw2", 2026-02-17T05:34:58.719 INFO:tasks.workunit.client.0.trial030.stdout: "hash": "rjenkins1", 2026-02-17T05:34:58.719 INFO:tasks.workunit.client.0.trial030.stdout: "items": [ 2026-02-17T05:34:58.719 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.719 INFO:tasks.workunit.client.0.trial030.stdout: "id": -3, 2026-02-17T05:34:58.720 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-17T05:34:58.720 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 0 2026-02-17T05:34:58.720 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:58.720 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:34:58.720 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.720 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.720 INFO:tasks.workunit.client.0.trial030.stdout: "id": -2, 2026-02-17T05:34:58.720 INFO:tasks.workunit.client.0.trial030.stdout: "name": "default~ssd", 2026-02-17T05:34:58.720 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 11, 2026-02-17T05:34:58.720 INFO:tasks.workunit.client.0.trial030.stdout: "type_name": "root", 2026-02-17T05:34:58.720 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-17T05:34:58.720 INFO:tasks.workunit.client.0.trial030.stdout: "alg": "straw2", 2026-02-17T05:34:58.720 INFO:tasks.workunit.client.0.trial030.stdout: "hash": "rjenkins1", 2026-02-17T05:34:58.720 INFO:tasks.workunit.client.0.trial030.stdout: "items": [ 2026-02-17T05:34:58.720 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.720 INFO:tasks.workunit.client.0.trial030.stdout: "id": -4, 2026-02-17T05:34:58.720 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-17T05:34:58.720 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 0 2026-02-17T05:34:58.720 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:58.720 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:34:58.720 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.720 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.720 INFO:tasks.workunit.client.0.trial030.stdout: "id": -3, 2026-02-17T05:34:58.720 INFO:tasks.workunit.client.0.trial030.stdout: "name": "trial030", 2026-02-17T05:34:58.720 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 1, 2026-02-17T05:34:58.721 INFO:tasks.workunit.client.0.trial030.stdout: "type_name": "host", 2026-02-17T05:34:58.721 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-17T05:34:58.721 INFO:tasks.workunit.client.0.trial030.stdout: "alg": "straw2", 2026-02-17T05:34:58.721 INFO:tasks.workunit.client.0.trial030.stdout: "hash": "rjenkins1", 2026-02-17T05:34:58.721 INFO:tasks.workunit.client.0.trial030.stdout: "items": [ 2026-02-17T05:34:58.721 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.721 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-17T05:34:58.721 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-17T05:34:58.721 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 0 2026-02-17T05:34:58.721 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.721 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.721 INFO:tasks.workunit.client.0.trial030.stdout: "id": 1, 2026-02-17T05:34:58.721 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-17T05:34:58.721 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 1 2026-02-17T05:34:58.721 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.721 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.721 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-17T05:34:58.721 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-17T05:34:58.721 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 2 2026-02-17T05:34:58.721 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:58.721 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:34:58.721 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.721 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.721 INFO:tasks.workunit.client.0.trial030.stdout: "id": -4, 2026-02-17T05:34:58.721 INFO:tasks.workunit.client.0.trial030.stdout: "name": "trial030~ssd", 2026-02-17T05:34:58.722 INFO:tasks.workunit.client.0.trial030.stdout: "type_id": 1, 2026-02-17T05:34:58.722 INFO:tasks.workunit.client.0.trial030.stdout: "type_name": "host", 2026-02-17T05:34:58.722 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 19206, 2026-02-17T05:34:58.722 INFO:tasks.workunit.client.0.trial030.stdout: "alg": "straw2", 2026-02-17T05:34:58.722 INFO:tasks.workunit.client.0.trial030.stdout: "hash": "rjenkins1", 2026-02-17T05:34:58.722 INFO:tasks.workunit.client.0.trial030.stdout: "items": [ 2026-02-17T05:34:58.722 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.722 INFO:tasks.workunit.client.0.trial030.stdout: "id": 0, 2026-02-17T05:34:58.722 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-17T05:34:58.722 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 0 2026-02-17T05:34:58.722 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.722 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.722 INFO:tasks.workunit.client.0.trial030.stdout: "id": 1, 2026-02-17T05:34:58.722 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-17T05:34:58.722 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 1 2026-02-17T05:34:58.722 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.722 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.722 INFO:tasks.workunit.client.0.trial030.stdout: "id": 2, 2026-02-17T05:34:58.722 INFO:tasks.workunit.client.0.trial030.stdout: "weight": 6402, 2026-02-17T05:34:58.722 INFO:tasks.workunit.client.0.trial030.stdout: "pos": 2 2026-02-17T05:34:58.722 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:58.722 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:34:58.722 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:58.722 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:34:58.722 INFO:tasks.workunit.client.0.trial030.stdout: "rules": [ 2026-02-17T05:34:58.722 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.723 INFO:tasks.workunit.client.0.trial030.stdout: "rule_id": 0, 2026-02-17T05:34:58.723 INFO:tasks.workunit.client.0.trial030.stdout: "rule_name": "replicated_rule", 2026-02-17T05:34:58.723 INFO:tasks.workunit.client.0.trial030.stdout: "type": 1, 2026-02-17T05:34:58.723 INFO:tasks.workunit.client.0.trial030.stdout: "steps": [ 2026-02-17T05:34:58.723 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.723 INFO:tasks.workunit.client.0.trial030.stdout: "op": "take", 2026-02-17T05:34:58.723 INFO:tasks.workunit.client.0.trial030.stdout: "item": -1, 2026-02-17T05:34:58.723 INFO:tasks.workunit.client.0.trial030.stdout: "item_name": "default" 2026-02-17T05:34:58.723 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.723 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.723 INFO:tasks.workunit.client.0.trial030.stdout: "op": "choose_firstn", 2026-02-17T05:34:58.723 INFO:tasks.workunit.client.0.trial030.stdout: "num": 0, 2026-02-17T05:34:58.723 INFO:tasks.workunit.client.0.trial030.stdout: "type": "osd" 2026-02-17T05:34:58.723 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.723 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.723 INFO:tasks.workunit.client.0.trial030.stdout: "op": "emit" 2026-02-17T05:34:58.723 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:58.723 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:34:58.723 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.723 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.723 INFO:tasks.workunit.client.0.trial030.stdout: "rule_id": 1, 2026-02-17T05:34:58.723 INFO:tasks.workunit.client.0.trial030.stdout: "rule_name": "test", 2026-02-17T05:34:58.723 INFO:tasks.workunit.client.0.trial030.stdout: "type": 3, 2026-02-17T05:34:58.723 INFO:tasks.workunit.client.0.trial030.stdout: "steps": [ 2026-02-17T05:34:58.724 INFO:tasks.workunit.client.0.trial030.stderr:report 2416662471 2026-02-17T05:34:58.724 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.724 INFO:tasks.workunit.client.0.trial030.stdout: "op": "set_chooseleaf_tries", 2026-02-17T05:34:58.724 INFO:tasks.workunit.client.0.trial030.stdout: "num": 5 2026-02-17T05:34:58.724 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.724 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.724 INFO:tasks.workunit.client.0.trial030.stdout: "op": "set_choose_tries", 2026-02-17T05:34:58.724 INFO:tasks.workunit.client.0.trial030.stdout: "num": 100 2026-02-17T05:34:58.724 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.724 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.724 INFO:tasks.workunit.client.0.trial030.stdout: "op": "take", 2026-02-17T05:34:58.724 INFO:tasks.workunit.client.0.trial030.stdout: "item": -1, 2026-02-17T05:34:58.724 INFO:tasks.workunit.client.0.trial030.stdout: "item_name": "default" 2026-02-17T05:34:58.724 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.724 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.724 INFO:tasks.workunit.client.0.trial030.stdout: "op": "choose_indep", 2026-02-17T05:34:58.725 INFO:tasks.workunit.client.0.trial030.stdout: "num": 0, 2026-02-17T05:34:58.725 INFO:tasks.workunit.client.0.trial030.stdout: "type": "osd" 2026-02-17T05:34:58.725 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.725 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.725 INFO:tasks.workunit.client.0.trial030.stdout: "op": "emit" 2026-02-17T05:34:58.725 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:58.725 INFO:tasks.workunit.client.0.trial030.stdout: ] 2026-02-17T05:34:58.725 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:58.725 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:34:58.725 INFO:tasks.workunit.client.0.trial030.stdout: "tunables": { 2026-02-17T05:34:58.725 INFO:tasks.workunit.client.0.trial030.stdout: "choose_local_tries": 0, 2026-02-17T05:34:58.725 INFO:tasks.workunit.client.0.trial030.stdout: "choose_local_fallback_tries": 0, 2026-02-17T05:34:58.725 INFO:tasks.workunit.client.0.trial030.stdout: "choose_total_tries": 50, 2026-02-17T05:34:58.725 INFO:tasks.workunit.client.0.trial030.stdout: "chooseleaf_descend_once": 1, 2026-02-17T05:34:58.725 INFO:tasks.workunit.client.0.trial030.stdout: "chooseleaf_vary_r": 1, 2026-02-17T05:34:58.725 INFO:tasks.workunit.client.0.trial030.stdout: "chooseleaf_stable": 1, 2026-02-17T05:34:58.725 INFO:tasks.workunit.client.0.trial030.stdout: "msr_descents": 100, 2026-02-17T05:34:58.725 INFO:tasks.workunit.client.0.trial030.stdout: "msr_collision_tries": 100, 2026-02-17T05:34:58.725 INFO:tasks.workunit.client.0.trial030.stdout: "straw_calc_version": 1, 2026-02-17T05:34:58.725 INFO:tasks.workunit.client.0.trial030.stdout: "allowed_bucket_algs": 54, 2026-02-17T05:34:58.725 INFO:tasks.workunit.client.0.trial030.stdout: "profile": "jewel", 2026-02-17T05:34:58.725 INFO:tasks.workunit.client.0.trial030.stdout: "optimal_tunables": 1, 2026-02-17T05:34:58.725 INFO:tasks.workunit.client.0.trial030.stdout: "legacy_tunables": 0, 2026-02-17T05:34:58.725 INFO:tasks.workunit.client.0.trial030.stdout: "minimum_required_version": "jewel", 2026-02-17T05:34:58.725 INFO:tasks.workunit.client.0.trial030.stdout: "require_feature_tunables": 1, 2026-02-17T05:34:58.725 INFO:tasks.workunit.client.0.trial030.stdout: "require_feature_tunables2": 1, 2026-02-17T05:34:58.725 INFO:tasks.workunit.client.0.trial030.stdout: "has_v2_rules": 1, 2026-02-17T05:34:58.726 INFO:tasks.workunit.client.0.trial030.stdout: "require_feature_tunables3": 1, 2026-02-17T05:34:58.726 INFO:tasks.workunit.client.0.trial030.stdout: "has_v3_rules": 0, 2026-02-17T05:34:58.726 INFO:tasks.workunit.client.0.trial030.stdout: "has_v4_buckets": 1, 2026-02-17T05:34:58.726 INFO:tasks.workunit.client.0.trial030.stdout: "require_feature_tunables5": 1, 2026-02-17T05:34:58.726 INFO:tasks.workunit.client.0.trial030.stdout: "has_v5_rules": 0, 2026-02-17T05:34:58.726 INFO:tasks.workunit.client.0.trial030.stdout: "has_msr_rules": 0 2026-02-17T05:34:58.726 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.726 INFO:tasks.workunit.client.0.trial030.stdout: "choose_args": {} 2026-02-17T05:34:58.726 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.726 INFO:tasks.workunit.client.0.trial030.stdout: "fsmap": { 2026-02-17T05:34:58.726 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 1, 2026-02-17T05:34:58.726 INFO:tasks.workunit.client.0.trial030.stdout: "btime": "2026-02-17T05:33:01:611616+0000", 2026-02-17T05:34:58.726 INFO:tasks.workunit.client.0.trial030.stdout: "default_fscid": -1, 2026-02-17T05:34:58.726 INFO:tasks.workunit.client.0.trial030.stdout: "compat": { 2026-02-17T05:34:58.726 INFO:tasks.workunit.client.0.trial030.stdout: "compat": {}, 2026-02-17T05:34:58.726 INFO:tasks.workunit.client.0.trial030.stdout: "ro_compat": {}, 2026-02-17T05:34:58.726 INFO:tasks.workunit.client.0.trial030.stdout: "incompat": { 2026-02-17T05:34:58.726 INFO:tasks.workunit.client.0.trial030.stdout: "feature_1": "base v0.20", 2026-02-17T05:34:58.726 INFO:tasks.workunit.client.0.trial030.stdout: "feature_2": "client writeable ranges", 2026-02-17T05:34:58.726 INFO:tasks.workunit.client.0.trial030.stdout: "feature_3": "default file layouts on dirs", 2026-02-17T05:34:58.726 INFO:tasks.workunit.client.0.trial030.stdout: "feature_4": "dir inode in separate object", 2026-02-17T05:34:58.726 INFO:tasks.workunit.client.0.trial030.stdout: "feature_5": "mds uses versioned encoding", 2026-02-17T05:34:58.726 INFO:tasks.workunit.client.0.trial030.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-17T05:34:58.726 INFO:tasks.workunit.client.0.trial030.stdout: "feature_8": "no anchor table", 2026-02-17T05:34:58.726 INFO:tasks.workunit.client.0.trial030.stdout: "feature_9": "file layout v2", 2026-02-17T05:34:58.726 INFO:tasks.workunit.client.0.trial030.stdout: "feature_10": "snaprealm v2", 2026-02-17T05:34:58.726 INFO:tasks.workunit.client.0.trial030.stdout: "feature_11": "minor log segments", 2026-02-17T05:34:58.727 INFO:tasks.workunit.client.0.trial030.stdout: "feature_12": "quiesce subvolumes" 2026-02-17T05:34:58.727 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:58.727 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.727 INFO:tasks.workunit.client.0.trial030.stdout: "feature_flags": { 2026-02-17T05:34:58.727 INFO:tasks.workunit.client.0.trial030.stdout: "enable_multiple": true, 2026-02-17T05:34:58.727 INFO:tasks.workunit.client.0.trial030.stdout: "ever_enabled_multiple": true 2026-02-17T05:34:58.727 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.727 INFO:tasks.workunit.client.0.trial030.stdout: "standbys": [], 2026-02-17T05:34:58.727 INFO:tasks.workunit.client.0.trial030.stdout: "filesystems": [] 2026-02-17T05:34:58.727 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.727 INFO:tasks.workunit.client.0.trial030.stdout: "mdsmap_first_committed": 1, 2026-02-17T05:34:58.727 INFO:tasks.workunit.client.0.trial030.stdout: "mdsmap_last_committed": 1, 2026-02-17T05:34:58.727 INFO:tasks.workunit.client.0.trial030.stdout: "auth": { 2026-02-17T05:34:58.727 INFO:tasks.workunit.client.0.trial030.stdout: "first_committed": 1, 2026-02-17T05:34:58.727 INFO:tasks.workunit.client.0.trial030.stdout: "last_committed": 5, 2026-02-17T05:34:58.727 INFO:tasks.workunit.client.0.trial030.stdout: "num_secrets": 3 2026-02-17T05:34:58.727 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.727 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg": 1, 2026-02-17T05:34:58.727 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg_active": 1, 2026-02-17T05:34:58.727 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg_unknown": 0, 2026-02-17T05:34:58.727 INFO:tasks.workunit.client.0.trial030.stdout: "num_osd": 3, 2026-02-17T05:34:58.727 INFO:tasks.workunit.client.0.trial030.stdout: "pool_sum": { 2026-02-17T05:34:58.727 INFO:tasks.workunit.client.0.trial030.stdout: "stat_sum": { 2026-02-17T05:34:58.727 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes": 52200, 2026-02-17T05:34:58.727 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects": 101, 2026-02-17T05:34:58.727 INFO:tasks.workunit.client.0.trial030.stdout: "num_object_clones": 1, 2026-02-17T05:34:58.727 INFO:tasks.workunit.client.0.trial030.stdout: "num_object_copies": 303, 2026-02-17T05:34:58.727 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T05:34:58.728 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_missing": 0, 2026-02-17T05:34:58.728 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_degraded": 101, 2026-02-17T05:34:58.728 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_misplaced": 0, 2026-02-17T05:34:58.728 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_unfound": 0, 2026-02-17T05:34:58.728 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_dirty": 101, 2026-02-17T05:34:58.728 INFO:tasks.workunit.client.0.trial030.stdout: "num_whiteouts": 0, 2026-02-17T05:34:58.728 INFO:tasks.workunit.client.0.trial030.stdout: "num_read": 0, 2026-02-17T05:34:58.728 INFO:tasks.workunit.client.0.trial030.stdout: "num_read_kb": 0, 2026-02-17T05:34:58.728 INFO:tasks.workunit.client.0.trial030.stdout: "num_write": 101, 2026-02-17T05:34:58.728 INFO:tasks.workunit.client.0.trial030.stdout: "num_write_kb": 101, 2026-02-17T05:34:58.728 INFO:tasks.workunit.client.0.trial030.stdout: "num_scrub_errors": 0, 2026-02-17T05:34:58.728 INFO:tasks.workunit.client.0.trial030.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T05:34:58.728 INFO:tasks.workunit.client.0.trial030.stdout: "num_deep_scrub_errors": 0, 2026-02-17T05:34:58.728 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_recovered": 0, 2026-02-17T05:34:58.728 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes_recovered": 0, 2026-02-17T05:34:58.728 INFO:tasks.workunit.client.0.trial030.stdout: "num_keys_recovered": 0, 2026-02-17T05:34:58.728 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_omap": 0, 2026-02-17T05:34:58.728 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T05:34:58.728 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T05:34:58.728 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush": 0, 2026-02-17T05:34:58.728 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_kb": 0, 2026-02-17T05:34:58.728 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict": 0, 2026-02-17T05:34:58.728 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_kb": 0, 2026-02-17T05:34:58.728 INFO:tasks.workunit.client.0.trial030.stdout: "num_promote": 0, 2026-02-17T05:34:58.728 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_mode_high": 0, 2026-02-17T05:34:58.728 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_mode_low": 0, 2026-02-17T05:34:58.728 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_mode_some": 0, 2026-02-17T05:34:58.728 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_mode_full": 0, 2026-02-17T05:34:58.728 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_pinned": 0, 2026-02-17T05:34:58.728 INFO:tasks.workunit.client.0.trial030.stdout: "num_legacy_snapsets": 0, 2026-02-17T05:34:58.729 INFO:tasks.workunit.client.0.trial030.stdout: "num_large_omap_objects": 0, 2026-02-17T05:34:58.729 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_manifest": 0, 2026-02-17T05:34:58.729 INFO:tasks.workunit.client.0.trial030.stdout: "num_omap_bytes": 0, 2026-02-17T05:34:58.729 INFO:tasks.workunit.client.0.trial030.stdout: "num_omap_keys": 0, 2026-02-17T05:34:58.729 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_repaired": 0 2026-02-17T05:34:58.729 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.729 INFO:tasks.workunit.client.0.trial030.stdout: "store_stats": { 2026-02-17T05:34:58.729 INFO:tasks.workunit.client.0.trial030.stdout: "total": 0, 2026-02-17T05:34:58.729 INFO:tasks.workunit.client.0.trial030.stdout: "available": 0, 2026-02-17T05:34:58.729 INFO:tasks.workunit.client.0.trial030.stdout: "internally_reserved": 0, 2026-02-17T05:34:58.729 INFO:tasks.workunit.client.0.trial030.stdout: "allocated": 0, 2026-02-17T05:34:58.729 INFO:tasks.workunit.client.0.trial030.stdout: "data_stored": 0, 2026-02-17T05:34:58.729 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed": 0, 2026-02-17T05:34:58.729 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_allocated": 0, 2026-02-17T05:34:58.729 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_original": 0, 2026-02-17T05:34:58.729 INFO:tasks.workunit.client.0.trial030.stdout: "omap_allocated": 0, 2026-02-17T05:34:58.729 INFO:tasks.workunit.client.0.trial030.stdout: "internal_metadata": 0 2026-02-17T05:34:58.729 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.729 INFO:tasks.workunit.client.0.trial030.stdout: "log_size": 18, 2026-02-17T05:34:58.729 INFO:tasks.workunit.client.0.trial030.stdout: "ondisk_log_size": 18, 2026-02-17T05:34:58.729 INFO:tasks.workunit.client.0.trial030.stdout: "up": 3, 2026-02-17T05:34:58.729 INFO:tasks.workunit.client.0.trial030.stdout: "acting": 3, 2026-02-17T05:34:58.729 INFO:tasks.workunit.client.0.trial030.stdout: "num_store_stats": 0 2026-02-17T05:34:58.729 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.729 INFO:tasks.workunit.client.0.trial030.stdout: "osd_sum": { 2026-02-17T05:34:58.729 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 0, 2026-02-17T05:34:58.729 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 0, 2026-02-17T05:34:58.729 INFO:tasks.workunit.client.0.trial030.stdout: "num_pgs": 3, 2026-02-17T05:34:58.729 INFO:tasks.workunit.client.0.trial030.stdout: "num_osds": 3, 2026-02-17T05:34:58.729 INFO:tasks.workunit.client.0.trial030.stdout: "num_per_pool_osds": 3, 2026-02-17T05:34:58.730 INFO:tasks.workunit.client.0.trial030.stdout: "num_per_pool_omap_osds": 3, 2026-02-17T05:34:58.730 INFO:tasks.workunit.client.0.trial030.stdout: "kb": 314572800, 2026-02-17T05:34:58.730 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used": 85068, 2026-02-17T05:34:58.730 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_data": 2268, 2026-02-17T05:34:58.730 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_omap": 30, 2026-02-17T05:34:58.730 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_meta": 82721, 2026-02-17T05:34:58.730 INFO:tasks.workunit.client.0.trial030.stdout: "kb_avail": 314487732, 2026-02-17T05:34:58.730 INFO:tasks.workunit.client.0.trial030.stdout: "statfs": { 2026-02-17T05:34:58.730 INFO:tasks.workunit.client.0.trial030.stdout: "total": 322122547200, 2026-02-17T05:34:58.730 INFO:tasks.workunit.client.0.trial030.stdout: "available": 322035437568, 2026-02-17T05:34:58.730 INFO:tasks.workunit.client.0.trial030.stdout: "internally_reserved": 0, 2026-02-17T05:34:58.730 INFO:tasks.workunit.client.0.trial030.stdout: "allocated": 2322432, 2026-02-17T05:34:58.730 INFO:tasks.workunit.client.0.trial030.stdout: "data_stored": 1596647, 2026-02-17T05:34:58.730 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed": 0, 2026-02-17T05:34:58.730 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_allocated": 0, 2026-02-17T05:34:58.730 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_original": 0, 2026-02-17T05:34:58.730 INFO:tasks.workunit.client.0.trial030.stdout: "omap_allocated": 31600, 2026-02-17T05:34:58.730 INFO:tasks.workunit.client.0.trial030.stdout: "internal_metadata": 84706448 2026-02-17T05:34:58.730 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.730 INFO:tasks.workunit.client.0.trial030.stdout: "hb_peers": [], 2026-02-17T05:34:58.730 INFO:tasks.workunit.client.0.trial030.stdout: "snap_trim_queue_len": 0, 2026-02-17T05:34:58.730 INFO:tasks.workunit.client.0.trial030.stdout: "num_snap_trimming": 0, 2026-02-17T05:34:58.730 INFO:tasks.workunit.client.0.trial030.stdout: "num_shards_repaired": 0, 2026-02-17T05:34:58.730 INFO:tasks.workunit.client.0.trial030.stdout: "op_queue_age_hist": { 2026-02-17T05:34:58.730 INFO:tasks.workunit.client.0.trial030.stdout: "histogram": [], 2026-02-17T05:34:58.730 INFO:tasks.workunit.client.0.trial030.stdout: "upper_bound": 1 2026-02-17T05:34:58.730 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.730 INFO:tasks.workunit.client.0.trial030.stdout: "perf_stat": { 2026-02-17T05:34:58.730 INFO:tasks.workunit.client.0.trial030.stdout: "commit_latency_ms": 0, 2026-02-17T05:34:58.731 INFO:tasks.workunit.client.0.trial030.stdout: "apply_latency_ms": 0, 2026-02-17T05:34:58.731 INFO:tasks.workunit.client.0.trial030.stdout: "commit_latency_ns": 0, 2026-02-17T05:34:58.731 INFO:tasks.workunit.client.0.trial030.stdout: "apply_latency_ns": 0 2026-02-17T05:34:58.731 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.731 INFO:tasks.workunit.client.0.trial030.stdout: "alerts": [], 2026-02-17T05:34:58.731 INFO:tasks.workunit.client.0.trial030.stdout: "network_ping_times": [] 2026-02-17T05:34:58.731 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.731 INFO:tasks.workunit.client.0.trial030.stdout: "osd_sum_by_class": { 2026-02-17T05:34:58.731 INFO:tasks.workunit.client.0.trial030.stdout: "ssd": { 2026-02-17T05:34:58.731 INFO:tasks.workunit.client.0.trial030.stdout: "up_from": 0, 2026-02-17T05:34:58.731 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 0, 2026-02-17T05:34:58.731 INFO:tasks.workunit.client.0.trial030.stdout: "num_pgs": 3, 2026-02-17T05:34:58.731 INFO:tasks.workunit.client.0.trial030.stdout: "num_osds": 3, 2026-02-17T05:34:58.731 INFO:tasks.workunit.client.0.trial030.stdout: "num_per_pool_osds": 3, 2026-02-17T05:34:58.731 INFO:tasks.workunit.client.0.trial030.stdout: "num_per_pool_omap_osds": 3, 2026-02-17T05:34:58.731 INFO:tasks.workunit.client.0.trial030.stdout: "kb": 314572800, 2026-02-17T05:34:58.731 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used": 85068, 2026-02-17T05:34:58.731 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_data": 2268, 2026-02-17T05:34:58.731 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_omap": 30, 2026-02-17T05:34:58.731 INFO:tasks.workunit.client.0.trial030.stdout: "kb_used_meta": 82721, 2026-02-17T05:34:58.731 INFO:tasks.workunit.client.0.trial030.stdout: "kb_avail": 314487732, 2026-02-17T05:34:58.731 INFO:tasks.workunit.client.0.trial030.stdout: "statfs": { 2026-02-17T05:34:58.731 INFO:tasks.workunit.client.0.trial030.stdout: "total": 322122547200, 2026-02-17T05:34:58.731 INFO:tasks.workunit.client.0.trial030.stdout: "available": 322035437568, 2026-02-17T05:34:58.731 INFO:tasks.workunit.client.0.trial030.stdout: "internally_reserved": 0, 2026-02-17T05:34:58.731 INFO:tasks.workunit.client.0.trial030.stdout: "allocated": 2322432, 2026-02-17T05:34:58.731 INFO:tasks.workunit.client.0.trial030.stdout: "data_stored": 1596647, 2026-02-17T05:34:58.731 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed": 0, 2026-02-17T05:34:58.731 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_allocated": 0, 2026-02-17T05:34:58.731 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_original": 0, 2026-02-17T05:34:58.731 INFO:tasks.workunit.client.0.trial030.stdout: "omap_allocated": 31600, 2026-02-17T05:34:58.732 INFO:tasks.workunit.client.0.trial030.stdout: "internal_metadata": 84706448 2026-02-17T05:34:58.732 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.732 INFO:tasks.workunit.client.0.trial030.stdout: "hb_peers": [], 2026-02-17T05:34:58.732 INFO:tasks.workunit.client.0.trial030.stdout: "snap_trim_queue_len": 0, 2026-02-17T05:34:58.732 INFO:tasks.workunit.client.0.trial030.stdout: "num_snap_trimming": 0, 2026-02-17T05:34:58.732 INFO:tasks.workunit.client.0.trial030.stdout: "num_shards_repaired": 0, 2026-02-17T05:34:58.732 INFO:tasks.workunit.client.0.trial030.stdout: "op_queue_age_hist": { 2026-02-17T05:34:58.732 INFO:tasks.workunit.client.0.trial030.stdout: "histogram": [], 2026-02-17T05:34:58.732 INFO:tasks.workunit.client.0.trial030.stdout: "upper_bound": 1 2026-02-17T05:34:58.732 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.732 INFO:tasks.workunit.client.0.trial030.stdout: "perf_stat": { 2026-02-17T05:34:58.732 INFO:tasks.workunit.client.0.trial030.stdout: "commit_latency_ms": 0, 2026-02-17T05:34:58.732 INFO:tasks.workunit.client.0.trial030.stdout: "apply_latency_ms": 0, 2026-02-17T05:34:58.732 INFO:tasks.workunit.client.0.trial030.stdout: "commit_latency_ns": 0, 2026-02-17T05:34:58.732 INFO:tasks.workunit.client.0.trial030.stdout: "apply_latency_ns": 0 2026-02-17T05:34:58.732 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.732 INFO:tasks.workunit.client.0.trial030.stdout: "alerts": [], 2026-02-17T05:34:58.732 INFO:tasks.workunit.client.0.trial030.stdout: "network_ping_times": [] 2026-02-17T05:34:58.732 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:58.732 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.732 INFO:tasks.workunit.client.0.trial030.stdout: "pool_stats": [ 2026-02-17T05:34:58.732 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.732 INFO:tasks.workunit.client.0.trial030.stdout: "poolid": 1, 2026-02-17T05:34:58.732 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg": 1, 2026-02-17T05:34:58.732 INFO:tasks.workunit.client.0.trial030.stdout: "stat_sum": { 2026-02-17T05:34:58.732 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes": 52200, 2026-02-17T05:34:58.732 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects": 101, 2026-02-17T05:34:58.732 INFO:tasks.workunit.client.0.trial030.stdout: "num_object_clones": 1, 2026-02-17T05:34:58.732 INFO:tasks.workunit.client.0.trial030.stdout: "num_object_copies": 303, 2026-02-17T05:34:58.732 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T05:34:58.732 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_missing": 0, 2026-02-17T05:34:58.733 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_degraded": 101, 2026-02-17T05:34:58.733 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_misplaced": 0, 2026-02-17T05:34:58.733 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_unfound": 0, 2026-02-17T05:34:58.733 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_dirty": 101, 2026-02-17T05:34:58.733 INFO:tasks.workunit.client.0.trial030.stdout: "num_whiteouts": 0, 2026-02-17T05:34:58.733 INFO:tasks.workunit.client.0.trial030.stdout: "num_read": 0, 2026-02-17T05:34:58.733 INFO:tasks.workunit.client.0.trial030.stdout: "num_read_kb": 0, 2026-02-17T05:34:58.733 INFO:tasks.workunit.client.0.trial030.stdout: "num_write": 101, 2026-02-17T05:34:58.733 INFO:tasks.workunit.client.0.trial030.stdout: "num_write_kb": 101, 2026-02-17T05:34:58.733 INFO:tasks.workunit.client.0.trial030.stdout: "num_scrub_errors": 0, 2026-02-17T05:34:58.733 INFO:tasks.workunit.client.0.trial030.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T05:34:58.733 INFO:tasks.workunit.client.0.trial030.stdout: "num_deep_scrub_errors": 0, 2026-02-17T05:34:58.733 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_recovered": 0, 2026-02-17T05:34:58.733 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes_recovered": 0, 2026-02-17T05:34:58.733 INFO:tasks.workunit.client.0.trial030.stdout: "num_keys_recovered": 0, 2026-02-17T05:34:58.733 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_omap": 0, 2026-02-17T05:34:58.733 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T05:34:58.733 INFO:tasks.workunit.client.0.trial030.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T05:34:58.733 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush": 0, 2026-02-17T05:34:58.733 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_kb": 0, 2026-02-17T05:34:58.733 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict": 0, 2026-02-17T05:34:58.733 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_kb": 0, 2026-02-17T05:34:58.733 INFO:tasks.workunit.client.0.trial030.stdout: "num_promote": 0, 2026-02-17T05:34:58.733 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_mode_high": 0, 2026-02-17T05:34:58.733 INFO:tasks.workunit.client.0.trial030.stdout: "num_flush_mode_low": 0, 2026-02-17T05:34:58.733 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_mode_some": 0, 2026-02-17T05:34:58.733 INFO:tasks.workunit.client.0.trial030.stdout: "num_evict_mode_full": 0, 2026-02-17T05:34:58.733 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_pinned": 0, 2026-02-17T05:34:58.733 INFO:tasks.workunit.client.0.trial030.stdout: "num_legacy_snapsets": 0, 2026-02-17T05:34:58.733 INFO:tasks.workunit.client.0.trial030.stdout: "num_large_omap_objects": 0, 2026-02-17T05:34:58.734 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_manifest": 0, 2026-02-17T05:34:58.734 INFO:tasks.workunit.client.0.trial030.stdout: "num_omap_bytes": 0, 2026-02-17T05:34:58.734 INFO:tasks.workunit.client.0.trial030.stdout: "num_omap_keys": 0, 2026-02-17T05:34:58.734 INFO:tasks.workunit.client.0.trial030.stdout: "num_objects_repaired": 0 2026-02-17T05:34:58.734 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.734 INFO:tasks.workunit.client.0.trial030.stdout: "store_stats": { 2026-02-17T05:34:58.734 INFO:tasks.workunit.client.0.trial030.stdout: "total": 0, 2026-02-17T05:34:58.734 INFO:tasks.workunit.client.0.trial030.stdout: "available": 0, 2026-02-17T05:34:58.734 INFO:tasks.workunit.client.0.trial030.stdout: "internally_reserved": 0, 2026-02-17T05:34:58.734 INFO:tasks.workunit.client.0.trial030.stdout: "allocated": 1241088, 2026-02-17T05:34:58.734 INFO:tasks.workunit.client.0.trial030.stdout: "data_stored": 1241088, 2026-02-17T05:34:58.734 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed": 0, 2026-02-17T05:34:58.734 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_allocated": 0, 2026-02-17T05:34:58.734 INFO:tasks.workunit.client.0.trial030.stdout: "data_compressed_original": 0, 2026-02-17T05:34:58.734 INFO:tasks.workunit.client.0.trial030.stdout: "omap_allocated": 0, 2026-02-17T05:34:58.734 INFO:tasks.workunit.client.0.trial030.stdout: "internal_metadata": 0 2026-02-17T05:34:58.734 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.734 INFO:tasks.workunit.client.0.trial030.stdout: "log_size": 18, 2026-02-17T05:34:58.734 INFO:tasks.workunit.client.0.trial030.stdout: "ondisk_log_size": 18, 2026-02-17T05:34:58.734 INFO:tasks.workunit.client.0.trial030.stdout: "up": 3, 2026-02-17T05:34:58.734 INFO:tasks.workunit.client.0.trial030.stdout: "acting": 3, 2026-02-17T05:34:58.734 INFO:tasks.workunit.client.0.trial030.stdout: "num_store_stats": 3 2026-02-17T05:34:58.734 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:58.734 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:34:58.734 INFO:tasks.workunit.client.0.trial030.stdout: "osd_stats": [ 2026-02-17T05:34:58.734 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.734 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 0, 2026-02-17T05:34:58.734 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 193273528329 2026-02-17T05:34:58.734 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.734 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.734 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 1, 2026-02-17T05:34:58.734 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 38654705679 2026-02-17T05:34:58.735 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.735 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.735 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2, 2026-02-17T05:34:58.735 INFO:tasks.workunit.client.0.trial030.stdout: "seq": 210453397513 2026-02-17T05:34:58.735 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:58.735 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:34:58.735 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg_by_state": [ 2026-02-17T05:34:58.735 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.735 INFO:tasks.workunit.client.0.trial030.stdout: "state": "active+undersized+degraded", 2026-02-17T05:34:58.735 INFO:tasks.workunit.client.0.trial030.stdout: "num": 1 2026-02-17T05:34:58.735 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:58.735 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:34:58.735 INFO:tasks.workunit.client.0.trial030.stdout: "pool_pg_unavailable_map": [ 2026-02-17T05:34:58.735 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.735 INFO:tasks.workunit.client.0.trial030.stdout: "poolid": "1", 2026-02-17T05:34:58.735 INFO:tasks.workunit.client.0.trial030.stdout: "pgs": [] 2026-02-17T05:34:58.735 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:58.735 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:34:58.735 INFO:tasks.workunit.client.0.trial030.stdout: "num_pg_by_osd": [ 2026-02-17T05:34:58.735 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.735 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2147483647, 2026-02-17T05:34:58.735 INFO:tasks.workunit.client.0.trial030.stdout: "num_primary_pg": 0, 2026-02-17T05:34:58.735 INFO:tasks.workunit.client.0.trial030.stdout: "num_acting_pg": 1, 2026-02-17T05:34:58.735 INFO:tasks.workunit.client.0.trial030.stdout: "num_up_not_acting_pg": 0 2026-02-17T05:34:58.735 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.735 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.735 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 2, 2026-02-17T05:34:58.735 INFO:tasks.workunit.client.0.trial030.stdout: "num_primary_pg": 0, 2026-02-17T05:34:58.735 INFO:tasks.workunit.client.0.trial030.stdout: "num_acting_pg": 1, 2026-02-17T05:34:58.735 INFO:tasks.workunit.client.0.trial030.stdout: "num_up_not_acting_pg": 0 2026-02-17T05:34:58.735 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.735 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.735 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 0, 2026-02-17T05:34:58.735 INFO:tasks.workunit.client.0.trial030.stdout: "num_primary_pg": 1, 2026-02-17T05:34:58.736 INFO:tasks.workunit.client.0.trial030.stdout: "num_acting_pg": 1, 2026-02-17T05:34:58.736 INFO:tasks.workunit.client.0.trial030.stdout: "num_up_not_acting_pg": 0 2026-02-17T05:34:58.736 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.736 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.736 INFO:tasks.workunit.client.0.trial030.stdout: "osd": 1, 2026-02-17T05:34:58.736 INFO:tasks.workunit.client.0.trial030.stdout: "num_primary_pg": 0, 2026-02-17T05:34:58.736 INFO:tasks.workunit.client.0.trial030.stdout: "num_acting_pg": 0, 2026-02-17T05:34:58.736 INFO:tasks.workunit.client.0.trial030.stdout: "num_up_not_acting_pg": 0 2026-02-17T05:34:58.736 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:58.736 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:34:58.736 INFO:tasks.workunit.client.0.trial030.stdout: "purged_snaps": [ 2026-02-17T05:34:58.736 INFO:tasks.workunit.client.0.trial030.stdout: { 2026-02-17T05:34:58.736 INFO:tasks.workunit.client.0.trial030.stdout: "pool": 1, 2026-02-17T05:34:58.736 INFO:tasks.workunit.client.0.trial030.stdout: "purged_snaps": {} 2026-02-17T05:34:58.736 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:58.736 INFO:tasks.workunit.client.0.trial030.stdout: ], 2026-02-17T05:34:58.736 INFO:tasks.workunit.client.0.trial030.stdout: "servicemap": { 2026-02-17T05:34:58.736 INFO:tasks.workunit.client.0.trial030.stdout: "epoch": 3, 2026-02-17T05:34:58.736 INFO:tasks.workunit.client.0.trial030.stdout: "modified": "2026-02-17T05:34:10.082252+0000", 2026-02-17T05:34:58.736 INFO:tasks.workunit.client.0.trial030.stdout: "services": { 2026-02-17T05:34:58.736 INFO:tasks.workunit.client.0.trial030.stdout: "osd": { 2026-02-17T05:34:58.736 INFO:tasks.workunit.client.0.trial030.stdout: "daemons": { 2026-02-17T05:34:58.736 INFO:tasks.workunit.client.0.trial030.stdout: "summary": "", 2026-02-17T05:34:58.736 INFO:tasks.workunit.client.0.trial030.stdout: "0": { 2026-02-17T05:34:58.736 INFO:tasks.workunit.client.0.trial030.stdout: "start_epoch": 0, 2026-02-17T05:34:58.736 INFO:tasks.workunit.client.0.trial030.stdout: "start_stamp": "0.000000", 2026-02-17T05:34:58.736 INFO:tasks.workunit.client.0.trial030.stdout: "gid": 0, 2026-02-17T05:34:58.736 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-17T05:34:58.736 INFO:tasks.workunit.client.0.trial030.stdout: "metadata": {}, 2026-02-17T05:34:58.736 INFO:tasks.workunit.client.0.trial030.stdout: "task_status": {} 2026-02-17T05:34:58.736 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.736 INFO:tasks.workunit.client.0.trial030.stdout: "2": { 2026-02-17T05:34:58.737 INFO:tasks.workunit.client.0.trial030.stdout: "start_epoch": 0, 2026-02-17T05:34:58.737 INFO:tasks.workunit.client.0.trial030.stdout: "start_stamp": "0.000000", 2026-02-17T05:34:58.737 INFO:tasks.workunit.client.0.trial030.stdout: "gid": 0, 2026-02-17T05:34:58.737 INFO:tasks.workunit.client.0.trial030.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-17T05:34:58.737 INFO:tasks.workunit.client.0.trial030.stdout: "metadata": {}, 2026-02-17T05:34:58.737 INFO:tasks.workunit.client.0.trial030.stdout: "task_status": {} 2026-02-17T05:34:58.737 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:58.737 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:58.737 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:58.737 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:58.737 INFO:tasks.workunit.client.0.trial030.stdout: }, 2026-02-17T05:34:58.737 INFO:tasks.workunit.client.0.trial030.stdout: "mgrstat_first_committed": 1, 2026-02-17T05:34:58.737 INFO:tasks.workunit.client.0.trial030.stdout: "mgrstat_last_committed": 59, 2026-02-17T05:34:58.737 INFO:tasks.workunit.client.0.trial030.stdout: "logm_first_committed": 1, 2026-02-17T05:34:58.737 INFO:tasks.workunit.client.0.trial030.stdout: "logm_last_committed": 322, 2026-02-17T05:34:58.737 INFO:tasks.workunit.client.0.trial030.stdout: "paxos": { 2026-02-17T05:34:58.737 INFO:tasks.workunit.client.0.trial030.stdout: "first_committed": 1, 2026-02-17T05:34:58.737 INFO:tasks.workunit.client.0.trial030.stdout: "last_committed": 442, 2026-02-17T05:34:58.737 INFO:tasks.workunit.client.0.trial030.stdout: "last_pn": 0, 2026-02-17T05:34:58.737 INFO:tasks.workunit.client.0.trial030.stdout: "accepted_pn": 0 2026-02-17T05:34:58.737 INFO:tasks.workunit.client.0.trial030.stdout: } 2026-02-17T05:34:58.737 INFO:tasks.workunit.client.0.trial030.stdout:} 2026-02-17T05:34:58.737 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-17T05:34:58.737 INFO:tasks.workunit.client.0.trial030.stdout:delay recovery 2026-02-17T05:34:58.738 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:341: TEST_divergent_ec: echo 'delay recovery' 2026-02-17T05:34:58.738 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:342: TEST_divergent_ec: ceph pg dump pgs 2026-02-17T05:34:58.897 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T05:34:58.897 INFO:tasks.workunit.client.0.trial030.stdout:1.0 101 0 101 0 0 52200 0 0 18 84 18 active+undersized+degraded 2026-02-17T05:34:24.961241+0000 42'102 50:142 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-17T05:33:13.930101+0000 0'0 2026-02-17T05:33:13.930101+0000 0 0 periodic scrub scheduled @ 2026-02-18T12:47:48.409927+0000 0 0 2026-02-17T05:34:58.897 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-17T05:34:58.897 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T05:34:58.897 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:34:58.907 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:343: TEST_divergent_ec: for i in $non_divergent 2026-02-17T05:34:58.908 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: get_asok_path osd.0 2026-02-17T05:34:58.908 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-17T05:34:58.908 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-17T05:34:58.909 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T05:34:58.909 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:34:58.909 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:34:58.910 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19532/ceph-osd.0.asok 2026-02-17T05:34:58.910 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: CEPH_ARGS= 2026-02-17T05:34:58.910 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.19532/ceph-osd.0.asok set_recovery_delay 100000 2026-02-17T05:34:58.974 INFO:tasks.workunit.client.0.trial030.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-17T05:34:58.981 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:343: TEST_divergent_ec: for i in $non_divergent 2026-02-17T05:34:58.982 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: get_asok_path osd.2 2026-02-17T05:34:58.982 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-17T05:34:58.982 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-17T05:34:58.982 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T05:34:58.982 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:34:58.982 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:34:58.982 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19532/ceph-osd.2.asok 2026-02-17T05:34:58.983 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: CEPH_ARGS= 2026-02-17T05:34:58.983 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.19532/ceph-osd.2.asok set_recovery_delay 100000 2026-02-17T05:34:59.047 INFO:tasks.workunit.client.0.trial030.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-17T05:34:59.053 INFO:tasks.workunit.client.0.trial030.stdout:revive divergent 1 2026-02-17T05:34:59.053 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:349: TEST_divergent_ec: echo 'revive divergent 1' 2026-02-17T05:34:59.053 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:350: TEST_divergent_ec: ceph pg dump pgs 2026-02-17T05:34:59.275 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T05:34:59.275 INFO:tasks.workunit.client.0.trial030.stdout:1.0 101 0 101 0 0 52200 0 0 18 84 18 active+undersized+degraded 2026-02-17T05:34:24.961241+0000 42'102 50:142 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-17T05:33:13.930101+0000 0'0 2026-02-17T05:33:13.930101+0000 0 0 periodic scrub scheduled @ 2026-02-18T12:47:48.409927+0000 0 0 2026-02-17T05:34:59.275 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-17T05:34:59.275 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T05:34:59.275 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:34:59.285 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:351: TEST_divergent_ec: ceph osd set noup 2026-02-17T05:34:59.600 INFO:tasks.workunit.client.0.trial030.stderr:noup is set 2026-02-17T05:34:59.612 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:352: TEST_divergent_ec: activate_osd td/divergent-priors 1 2026-02-17T05:34:59.612 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-17T05:34:59.612 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T05:34:59.612 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T05:34:59.612 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T05:34:59.613 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-17T05:34:59.613 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T05:34:59.613 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:34:59.613 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:34:59.613 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:34:59.613 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-17T05:34:59.613 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-17T05:34:59.613 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T05:34:59.613 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T05:34:59.613 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T05:34:59.613 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T05:34:59.613 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:34:59.613 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:34:59.613 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:34:59.613 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:34:59.613 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:34:59.614 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:34:59.614 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:34:59.615 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:34:59.615 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T05:34:59.615 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T05:34:59.615 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:34:59.615 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:34:59.615 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:34:59.615 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:34:59.615 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T05:34:59.615 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T05:34:59.615 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-17T05:34:59.615 INFO:tasks.workunit.client.0.trial030.stdout:start osd.1 2026-02-17T05:34:59.616 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T05:34:59.616 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T05:34:59.616 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-17T05:34:59.616 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T05:34:59.616 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T05:34:59.617 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T05:34:59.617 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T05:34:59.641 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:34:59.637+0000 7f2468a70a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:34:59.643 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:34:59.637+0000 7f2468a70a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:34:59.644 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:34:59.637+0000 7f2468a70a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:34:59.826 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: return 0 2026-02-17T05:34:59.826 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:353: TEST_divergent_ec: sleep 5 2026-02-17T05:35:00.010 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:00.005+0000 7f2468a70a40 -1 Falling back to public interface 2026-02-17T05:35:00.647 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:00.641+0000 7f2468a70a40 -1 osd.1 29 log_to_monitors true 2026-02-17T05:35:04.827 INFO:tasks.workunit.client.0.trial030.stdout:delay recovery divergent 2026-02-17T05:35:04.827 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:355: TEST_divergent_ec: echo 'delay recovery divergent' 2026-02-17T05:35:04.827 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:356: TEST_divergent_ec: ceph pg dump pgs 2026-02-17T05:35:05.035 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T05:35:05.036 INFO:tasks.workunit.client.0.trial030.stdout:1.0 101 0 101 0 0 52200 0 0 18 84 18 active+undersized+degraded 2026-02-17T05:34:24.961241+0000 42'102 53:148 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-17T05:33:13.930101+0000 0'0 2026-02-17T05:33:13.930101+0000 0 0 periodic scrub scheduled @ 2026-02-18T12:47:48.409927+0000 0 0 2026-02-17T05:35:05.036 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-17T05:35:05.036 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T05:35:05.036 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:35:05.045 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:357: TEST_divergent_ec: get_asok_path osd.1 2026-02-17T05:35:05.045 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-17T05:35:05.045 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-17T05:35:05.046 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T05:35:05.046 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:35:05.046 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:35:05.046 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19532/ceph-osd.1.asok 2026-02-17T05:35:05.046 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:357: TEST_divergent_ec: CEPH_ARGS= 2026-02-17T05:35:05.047 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:357: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.19532/ceph-osd.1.asok set_recovery_delay 100000 2026-02-17T05:35:05.104 INFO:tasks.workunit.client.0.trial030.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-17T05:35:05.110 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:359: TEST_divergent_ec: ceph osd unset noup 2026-02-17T05:35:05.433 INFO:tasks.workunit.client.0.trial030.stderr:noup is unset 2026-02-17T05:35:05.444 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:361: TEST_divergent_ec: wait_for_osd up 0 2026-02-17T05:35:05.445 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:35:05.445 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T05:35:05.445 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:35:05.445 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:35:05.445 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:35:05.445 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:35:05.446 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:35:05.446 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:35:05.446 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T05:35:05.668 INFO:tasks.workunit.client.0.trial030.stdout:osd.0 up in weight 1 up_from 45 up_thru 49 down_at 44 last_clean_interval [36,42) [v2:127.0.0.1:6800/1584474654,v1:127.0.0.1:6801/1584474654] [v2:127.0.0.1:6802/1584474654,v1:127.0.0.1:6803/1584474654] exists,up ffd61780-fdee-492a-b89a-f0298d033d42 2026-02-17T05:35:05.669 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:35:05.669 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:35:05.669 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:35:05.669 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:362: TEST_divergent_ec: wait_for_osd up 1 2026-02-17T05:35:05.669 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:35:05.669 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T05:35:05.669 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:35:05.669 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:35:05.669 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:35:05.669 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:35:05.669 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:35:05.669 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:35:05.669 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T05:35:05.886 INFO:tasks.workunit.client.0.trial030.stdout:osd.1 up in weight 1 up_from 55 up_thru 55 down_at 31 last_clean_interval [9,29) [v2:127.0.0.1:6818/1674298112,v1:127.0.0.1:6819/1674298112] [v2:127.0.0.1:6820/1674298112,v1:127.0.0.1:6821/1674298112] exists,up 66e43dc5-03ed-42cb-985e-85686a5152c5 2026-02-17T05:35:05.887 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:35:05.888 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:35:05.888 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:35:05.888 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:363: TEST_divergent_ec: wait_for_osd up 2 2026-02-17T05:35:05.888 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:35:05.888 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T05:35:05.888 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:35:05.888 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:35:05.888 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:35:05.888 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:35:05.889 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:35:05.889 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:35:05.889 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T05:35:06.105 INFO:tasks.workunit.client.0.trial030.stdout:osd.2 up in weight 1 up_from 49 up_thru 0 down_at 48 last_clean_interval [39,42) [v2:127.0.0.1:6810/1142442231,v1:127.0.0.1:6811/1142442231] [v2:127.0.0.1:6812/1142442231,v1:127.0.0.1:6813/1142442231] exists,up 09dea4cc-8ddf-4609-83f3-70b490de0aa5 2026-02-17T05:35:06.105 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:35:06.105 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:35:06.105 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:35:06.105 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:365: TEST_divergent_ec: ceph pg dump pgs 2026-02-17T05:35:06.310 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T05:35:06.310 INFO:tasks.workunit.client.0.trial030.stdout:1.0 101 4 4 0 0 52200 0 0 12 90 12 active+recovering+degraded 2026-02-17T05:35:05.577675+0000 42'102 56:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:33:13.930101+0000 0'0 2026-02-17T05:33:13.930101+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:35:06.310 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-17T05:35:06.311 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T05:35:06.311 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:35:06.319 INFO:tasks.workunit.client.0.trial030.stdout:wait for peering 2026-02-17T05:35:06.319 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:366: TEST_divergent_ec: echo 'wait for peering' 2026-02-17T05:35:06.319 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:367: TEST_divergent_ec: ceph pg dump pgs 2026-02-17T05:35:06.525 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T05:35:06.525 INFO:tasks.workunit.client.0.trial030.stdout:1.0 101 4 4 0 0 52200 0 0 12 90 12 active+recovering+degraded 2026-02-17T05:35:05.577675+0000 42'102 56:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:33:13.930101+0000 0'0 2026-02-17T05:33:13.930101+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:35:06.526 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-17T05:35:06.526 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T05:35:06.526 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:35:06.535 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:368: TEST_divergent_ec: rados -p test put foo /tmp/tmp.v5UuUmEqXn 2026-02-17T05:35:06.558 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:369: TEST_divergent_ec: rm -f /tmp/tmp.v5UuUmEqXn 2026-02-17T05:35:06.559 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:371: TEST_divergent_ec: echo 'killing divergent 1' 2026-02-17T05:35:06.559 INFO:tasks.workunit.client.0.trial030.stdout:killing divergent 1 2026-02-17T05:35:06.560 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:372: TEST_divergent_ec: ceph pg dump pgs 2026-02-17T05:35:06.773 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T05:35:06.773 INFO:tasks.workunit.client.0.trial030.stdout:1.0 101 4 4 0 0 52200 0 0 12 90 12 active+recovering+degraded 2026-02-17T05:35:05.577675+0000 42'102 56:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:33:13.930101+0000 0'0 2026-02-17T05:33:13.930101+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:35:06.773 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-17T05:35:06.773 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T05:35:06.774 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:35:06.781 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:373: TEST_divergent_ec: kill_daemons td/divergent-priors KILL osd.1 2026-02-17T05:35:06.782 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:35:06.782 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:35:06.782 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:35:06.783 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:35:06.783 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:35:06.890 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:35:06.891 INFO:tasks.workunit.client.0.trial030.stdout:reviving divergent 1 2026-02-17T05:35:06.891 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:375: TEST_divergent_ec: echo 'reviving divergent 1' 2026-02-17T05:35:06.891 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:376: TEST_divergent_ec: ceph pg dump pgs 2026-02-17T05:35:07.091 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T05:35:07.091 INFO:tasks.workunit.client.0.trial030.stdout:1.0 101 4 4 0 0 52200 0 0 12 90 12 active+recovering+degraded 2026-02-17T05:35:05.577675+0000 42'102 56:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:33:13.930101+0000 0'0 2026-02-17T05:33:13.930101+0000 0 0 no scrub is scheduled 0 0 2026-02-17T05:35:07.092 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-17T05:35:07.092 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T05:35:07.092 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:35:07.102 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:377: TEST_divergent_ec: activate_osd td/divergent-priors 1 2026-02-17T05:35:07.103 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-17T05:35:07.103 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T05:35:07.103 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T05:35:07.103 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T05:35:07.103 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-17T05:35:07.103 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T05:35:07.103 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:35:07.103 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:35:07.103 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:35:07.104 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-17T05:35:07.104 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-17T05:35:07.104 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T05:35:07.104 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T05:35:07.104 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T05:35:07.104 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T05:35:07.104 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:35:07.104 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:35:07.104 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:35:07.104 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:35:07.104 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:35:07.104 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:35:07.105 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' 2026-02-17T05:35:07.105 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:35:07.105 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T05:35:07.105 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T05:35:07.105 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:35:07.105 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:35:07.105 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:35:07.105 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:35:07.105 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T05:35:07.105 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T05:35:07.105 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-17T05:35:07.106 INFO:tasks.workunit.client.0.trial030.stdout:start osd.1 2026-02-17T05:35:07.107 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T05:35:07.107 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=931b36d9-02d4-44f0-bc8b-c9190b7fdb00 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19532/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T05:35:07.107 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-17T05:35:07.107 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T05:35:07.107 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T05:35:07.107 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T05:35:07.107 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T05:35:07.132 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:07.125+0000 7f55e5738a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:35:07.134 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:07.129+0000 7f55e5738a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:35:07.135 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:07.129+0000 7f55e5738a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:35:07.326 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T05:35:07.326 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:35:07.327 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T05:35:07.327 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:35:07.327 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:35:07.327 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:35:07.327 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:35:07.328 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:35:07.328 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:35:07.328 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T05:35:07.540 INFO:tasks.workunit.client.0.trial030.stdout:osd.1 up in weight 1 up_from 55 up_thru 55 down_at 31 last_clean_interval [9,29) [v2:127.0.0.1:6818/1674298112,v1:127.0.0.1:6819/1674298112] [v2:127.0.0.1:6820/1674298112,v1:127.0.0.1:6821/1674298112] exists,up 66e43dc5-03ed-42cb-985e-85686a5152c5 2026-02-17T05:35:07.540 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:35:07.540 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:35:07.541 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:35:07.541 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:379: TEST_divergent_ec: sleep 20 2026-02-17T05:35:07.570 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:07.565+0000 7f55e5738a40 -1 Falling back to public interface 2026-02-17T05:35:08.165 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:08.156+0000 7f55e5738a40 -1 osd.1 56 log_to_monitors true 2026-02-17T05:35:27.541 INFO:tasks.workunit.client.0.trial030.stdout:allowing recovery 2026-02-17T05:35:27.541 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:381: TEST_divergent_ec: echo 'allowing recovery' 2026-02-17T05:35:27.541 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:382: TEST_divergent_ec: ceph pg dump pgs 2026-02-17T05:35:27.745 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T05:35:27.745 INFO:tasks.workunit.client.0.trial030.stdout:1.0 102 0 0 0 0 52712 0 0 13 90 13 active+clean 2026-02-17T05:35:08.554029+0000 56'103 60:160 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:33:13.930101+0000 0'0 2026-02-17T05:33:13.930101+0000 0 0 periodic scrub scheduled @ 2026-02-18T06:23:54.791279+0000 0 0 2026-02-17T05:35:27.745 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-17T05:35:27.745 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T05:35:27.745 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:35:27.753 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:384: TEST_divergent_ec: for i in $osds 2026-02-17T05:35:27.753 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:386: TEST_divergent_ec: ceph tell osd.0 debug kick_recovery_wq 0 2026-02-17T05:35:27.839 INFO:tasks.workunit.client.0.trial030.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-17T05:35:27.846 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:384: TEST_divergent_ec: for i in $osds 2026-02-17T05:35:27.846 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:386: TEST_divergent_ec: ceph tell osd.1 debug kick_recovery_wq 0 2026-02-17T05:35:27.927 INFO:tasks.workunit.client.0.trial030.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-17T05:35:27.934 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:384: TEST_divergent_ec: for i in $osds 2026-02-17T05:35:27.934 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:386: TEST_divergent_ec: ceph tell osd.2 debug kick_recovery_wq 0 2026-02-17T05:35:28.014 INFO:tasks.workunit.client.0.trial030.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-17T05:35:28.024 INFO:tasks.workunit.client.0.trial030.stdout:reading divergent objects 2026-02-17T05:35:28.024 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:389: TEST_divergent_ec: echo 'reading divergent objects' 2026-02-17T05:35:28.024 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:390: TEST_divergent_ec: ceph pg dump pgs 2026-02-17T05:35:28.233 INFO:tasks.workunit.client.0.trial030.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T05:35:28.233 INFO:tasks.workunit.client.0.trial030.stdout:1.0 102 0 0 0 0 52712 0 0 13 90 13 active+clean 2026-02-17T05:35:08.554029+0000 56'103 60:160 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T05:33:13.930101+0000 0'0 2026-02-17T05:33:13.930101+0000 0 0 periodic scrub scheduled @ 2026-02-18T06:23:54.791279+0000 0 0 2026-02-17T05:35:28.233 INFO:tasks.workunit.client.0.trial030.stdout: 2026-02-17T05:35:28.233 INFO:tasks.workunit.client.0.trial030.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T05:35:28.233 INFO:tasks.workunit.client.0.trial030.stderr:dumped pgs 2026-02-17T05:35:28.244 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: expr 2 + 2 2026-02-17T05:35:28.245 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: seq 1 4 2026-02-17T05:35:28.246 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T05:35:28.246 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:393: TEST_divergent_ec: rados -p test get existing_1 td/divergent-priors/existing 2026-02-17T05:35:28.279 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T05:35:28.279 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:393: TEST_divergent_ec: rados -p test get existing_2 td/divergent-priors/existing 2026-02-17T05:35:28.308 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T05:35:28.308 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:393: TEST_divergent_ec: rados -p test get existing_3 td/divergent-priors/existing 2026-02-17T05:35:28.337 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T05:35:28.337 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:393: TEST_divergent_ec: rados -p test get existing_4 td/divergent-priors/existing 2026-02-17T05:35:28.366 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:395: TEST_divergent_ec: rm -f td/divergent-priors/existing 2026-02-17T05:35:28.368 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:397: TEST_divergent_ec: find td/divergent-priors -name '*osd*log' 2026-02-17T05:35:28.369 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:397: TEST_divergent_ec: grep _merge_object_divergent_entries td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-17T05:35:28.373 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:35:05.573+0000 7f24469ee640 20 _merge_object_divergent_entries: merging hoid 1:7a80c0d5:::existing_99:1 entries: 29'103 (28'99) clone 1:7a80c0d5:::existing_99:1 by unknown.0.0:0 2026-02-17T05:33:27.405818+0000 0 snaps [1] ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-17T05:35:28.373 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:35:05.573+0000 7f24469ee640 20 _merge_object_divergent_entries: keeping 29'103 (28'99) clone 1:7a80c0d5:::existing_99:1 by unknown.0.0:0 2026-02-17T05:33:27.405818+0000 0 snaps [1] ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-17T05:35:28.373 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:35:05.573+0000 7f24469ee640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-17T05:35:28.373 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:35:05.573+0000 7f24469ee640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:1 prior_version: 28'99 first_divergent_update: 29'103 last_divergent_update: 29'103 2026-02-17T05:35:28.373 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:35:05.573+0000 7f24469ee640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:1 has no more recent entries in log 2026-02-17T05:35:28.373 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:35:05.573+0000 7f24469ee640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:1 prior_version or op type indicates creation, deleting 2026-02-17T05:35:28.373 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:35:05.573+0000 7f24469ee640 20 _merge_object_divergent_entries: merging hoid 1:7a80c0d5:::existing_99:head entries: 29'104 (28'99) modify 1:7a80c0d5:::existing_99:head by client.4561.0:1 2026-02-17T05:33:31.131574+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-17T05:35:28.373 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:35:05.573+0000 7f24469ee640 20 _merge_object_divergent_entries: keeping 29'104 (28'99) modify 1:7a80c0d5:::existing_99:head by client.4561.0:1 2026-02-17T05:33:31.131574+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-17T05:35:28.374 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:35:05.573+0000 7f24469ee640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-17T05:35:28.374 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:35:05.573+0000 7f24469ee640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head prior_version: 28'99 first_divergent_update: 29'104 last_divergent_update: 29'104 2026-02-17T05:35:28.374 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:35:05.573+0000 7f24469ee640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head has no more recent entries in log 2026-02-17T05:35:28.374 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:35:05.573+0000 7f24469ee640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head must be rolled back or recovered, attempting to rollback 2026-02-17T05:35:28.374 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:35:05.573+0000 7f24469ee640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head olog_can_rollback_to: 29'104 2026-02-17T05:35:28.374 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:35:05.573+0000 7f24469ee640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head cannot rollback 29'104 (28'99) modify 1:7a80c0d5:::existing_99:head by client.4561.0:1 2026-02-17T05:33:31.131574+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-17T05:35:28.374 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:35:05.573+0000 7f24469ee640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head cannot roll back, removing and adding to missing 2026-02-17T05:35:28.375 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:35:05.573+0000 7f24469ee640 20 _merge_object_divergent_entries: merging hoid 1:c156033e:::existing_100:head entries: 28'101 (28'100) modify 1:c156033e:::existing_100:head by client.4552.0:1 2026-02-17T05:33:30.062829+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false,28'102 (28'101) modify 1:c156033e:::existing_100:head by client.4558.0:1 2026-02-17T05:33:31.057928+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-17T05:35:28.375 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:35:05.573+0000 7f24469ee640 20 _merge_object_divergent_entries: keeping 28'101 (28'100) modify 1:c156033e:::existing_100:head by client.4552.0:1 2026-02-17T05:33:30.062829+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-17T05:35:28.375 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:35:05.573+0000 7f24469ee640 20 _merge_object_divergent_entries: keeping 28'102 (28'101) modify 1:c156033e:::existing_100:head by client.4558.0:1 2026-02-17T05:33:31.057928+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-17T05:35:28.375 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:35:05.573+0000 7f24469ee640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-17T05:35:28.375 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:35:05.573+0000 7f24469ee640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head prior_version: 28'100 first_divergent_update: 28'101 last_divergent_update: 28'102 2026-02-17T05:35:28.375 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:35:05.573+0000 7f24469ee640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head has no more recent entries in log 2026-02-17T05:35:28.376 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:35:05.573+0000 7f24469ee640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head must be rolled back or recovered, attempting to rollback 2026-02-17T05:35:28.376 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:35:05.573+0000 7f24469ee640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head olog_can_rollback_to: 29'104 2026-02-17T05:35:28.376 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:35:05.573+0000 7f24469ee640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head cannot rollback 28'102 (28'101) modify 1:c156033e:::existing_100:head by client.4558.0:1 2026-02-17T05:33:31.057928+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-17T05:35:28.376 INFO:tasks.workunit.client.0.trial030.stdout:td/divergent-priors/osd.1.log:2026-02-17T05:35:05.573+0000 7f24469ee640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head cannot roll back, removing and adding to missing 2026-02-17T05:35:28.376 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:406: TEST_divergent_ec: find td/divergent-priors -name '*osd*log' 2026-02-17T05:35:28.377 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:406: TEST_divergent_ec: grep -q '_merge_object_divergent_entries.*rolled back' td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-17T05:35:28.381 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:411: TEST_divergent_ec: echo success 2026-02-17T05:35:28.381 INFO:tasks.workunit.client.0.trial030.stdout:success 2026-02-17T05:35:28.381 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:413: TEST_divergent_ec: delete_pool test 2026-02-17T05:35:28.382 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test 2026-02-17T05:35:28.382 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2026-02-17T05:35:28.641 INFO:tasks.workunit.client.0.trial030.stderr:pool 'test' does not exist 2026-02-17T05:35:28.650 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:414: TEST_divergent_ec: kill_daemons td/divergent-priors 2026-02-17T05:35:28.651 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:35:28.651 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:35:28.651 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:35:28.651 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:35:28.651 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:35:33.968 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:35:33.968 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:47: run: teardown td/divergent-priors 2026-02-17T05:35:33.968 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-17T05:35:33.968 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T05:35:33.968 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-17T05:35:33.969 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:35:33.969 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:35:33.969 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:35:33.970 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:35:33.970 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:35:33.976 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:35:33.976 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T05:35:33.977 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T05:35:33.977 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T05:35:33.979 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T05:35:33.979 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T05:35:33.979 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T05:35:33.980 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:35:33.981 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T05:35:33.981 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T05:35:33.981 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:35:33.982 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T05:35:33.983 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T05:35:33.983 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-17T05:35:34.006 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T05:35:34.007 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:35:34.007 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:35:34.007 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.19532 2026-02-17T05:35:34.009 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T05:35:34.009 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T05:35:34.009 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: code=0 2026-02-17T05:35:34.009 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2404: main: teardown td/divergent-priors 0 2026-02-17T05:35:34.009 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-17T05:35:34.009 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-17T05:35:34.009 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-17T05:35:34.010 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:35:34.010 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:35:34.010 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:35:34.010 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:35:34.010 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:35:34.011 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:35:34.012 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T05:35:34.012 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T05:35:34.013 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T05:35:34.014 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T05:35:34.014 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T05:35:34.014 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T05:35:34.015 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:35:34.015 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T05:35:34.016 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T05:35:34.016 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:35:34.018 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T05:35:34.018 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-17T05:35:34.019 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-17T05:35:34.020 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T05:35:34.020 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:35:34.020 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19532 2026-02-17T05:35:34.020 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.19532 2026-02-17T05:35:34.021 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T05:35:34.022 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T05:35:34.022 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: return 0 2026-02-17T05:35:34.023 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-17T05:35:34.023 DEBUG:teuthology.orchestra.run.trial030:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-17T05:35:34.036 INFO:tasks.workunit:Running workunit osd/ec-error-rollforward.sh... 2026-02-17T05:35:34.036 DEBUG:teuthology.orchestra.run.trial030:workunit test osd/ec-error-rollforward.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=325850157d309f65985eea9ec9bb9f1d56726fee TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh 2026-02-17T05:35:34.087 INFO:tasks.workunit.client.0.trial030.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-17T05:35:34.090 INFO:tasks.workunit.client.0.trial030.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-17T05:35:34.090 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-17T05:35:34.090 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-17T05:35:34.090 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PYTHONWARNINGS=ignore 2026-02-17T05:35:34.090 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PYTHONWARNINGS=ignore 2026-02-17T05:35:34.090 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export CEPH_CONF=/dev/null 2026-02-17T05:35:34.090 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: CEPH_CONF=/dev/null 2026-02-17T05:35:34.090 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: unset CEPH_ARGS 2026-02-17T05:35:34.090 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2398: main: local code 2026-02-17T05:35:34.091 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: run td/ec-error-rollforward 2026-02-17T05:35:34.091 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:6: run: local dir=td/ec-error-rollforward 2026-02-17T05:35:34.091 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:7: run: shift 2026-02-17T05:35:34.091 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:10: run: export CEPH_MON=127.0.0.1:7132 2026-02-17T05:35:34.091 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:10: run: CEPH_MON=127.0.0.1:7132 2026-02-17T05:35:34.091 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:11: run: export CEPH_ARGS 2026-02-17T05:35:34.091 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:12: run: uuidgen 2026-02-17T05:35:34.092 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:12: run: CEPH_ARGS+='--fsid=7e3841b9-6544-4160-879a-52da16f3b460 --auth-supported=none ' 2026-02-17T05:35:34.092 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:13: run: CEPH_ARGS+='--mon-host=127.0.0.1:7132 ' 2026-02-17T05:35:34.093 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:14: run: export margin=10 2026-02-17T05:35:34.093 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:14: run: margin=10 2026-02-17T05:35:34.093 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:15: run: export objects=200 2026-02-17T05:35:34.093 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:15: run: objects=200 2026-02-17T05:35:34.093 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:16: run: export poolname=test 2026-02-17T05:35:34.093 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:16: run: poolname=test 2026-02-17T05:35:34.093 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:18: run: set 2026-02-17T05:35:34.093 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:18: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-17T05:35:34.095 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:18: run: local funcs=TEST_ec_error_rollforward 2026-02-17T05:35:34.095 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:19: run: for func in $funcs 2026-02-17T05:35:34.095 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:20: run: setup td/ec-error-rollforward 2026-02-17T05:35:34.095 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ec-error-rollforward 2026-02-17T05:35:34.095 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ec-error-rollforward 2026-02-17T05:35:34.095 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ec-error-rollforward 2026-02-17T05:35:34.095 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T05:35:34.095 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ec-error-rollforward KILL 2026-02-17T05:35:34.095 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:35:34.096 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:35:34.096 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:35:34.096 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:35:34.096 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:35:34.096 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:35:34.096 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T05:35:34.097 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T05:35:34.097 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T05:35:34.098 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T05:35:34.098 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T05:35:34.099 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T05:35:34.100 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:35:34.100 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T05:35:34.100 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T05:35:34.100 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:35:34.101 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T05:35:34.103 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T05:35:34.103 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ec-error-rollforward 2026-02-17T05:35:34.104 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T05:35:34.104 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:35:34.104 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.75760 2026-02-17T05:35:34.105 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.75760 2026-02-17T05:35:34.106 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T05:35:34.106 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T05:35:34.106 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ec-error-rollforward 2026-02-17T05:35:34.107 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T05:35:34.108 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:35:34.108 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.75760 2026-02-17T05:35:34.108 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.75760 2026-02-17T05:35:34.109 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T05:35:34.111 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-17T05:35:34.111 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-17T05:35:34.111 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T05:35:34.111 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ec-error-rollforward 1' TERM HUP INT 2026-02-17T05:35:34.111 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:21: run: TEST_ec_error_rollforward td/ec-error-rollforward 2026-02-17T05:35:34.111 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:27: TEST_ec_error_rollforward: local dir=td/ec-error-rollforward 2026-02-17T05:35:34.111 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:28: TEST_ec_error_rollforward: run_mon td/ec-error-rollforward a 2026-02-17T05:35:34.111 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ec-error-rollforward 2026-02-17T05:35:34.111 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T05:35:34.111 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T05:35:34.112 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T05:35:34.112 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ec-error-rollforward/a 2026-02-17T05:35:34.112 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ec-error-rollforward/a --run-dir=td/ec-error-rollforward 2026-02-17T05:35:34.132 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T05:35:34.132 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:35:34.132 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:35:34.132 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:35:34.132 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:35:34.132 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.75760 2026-02-17T05:35:34.132 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.75760/$cluster-$name.asok' 2026-02-17T05:35:34.132 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ec-error-rollforward/a '--log-file=td/ec-error-rollforward/$name.log' '--admin-socket=/tmp/ceph-asok.75760/$cluster-$name.asok' --mon-cluster-log-file=td/ec-error-rollforward/log --run-dir=td/ec-error-rollforward '--pid-file=td/ec-error-rollforward/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T05:35:34.160 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T05:35:34.161 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T05:35:34.162 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T05:35:34.162 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T05:35:34.162 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T05:35:34.162 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T05:35:34.162 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T05:35:34.162 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T05:35:34.162 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T05:35:34.162 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T05:35:34.162 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:35:34.162 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.75760 2026-02-17T05:35:34.162 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.75760/ceph-mon.a.asok 2026-02-17T05:35:34.163 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T05:35:34.163 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.75760/ceph-mon.a.asok config get fsid 2026-02-17T05:35:34.217 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T05:35:34.217 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T05:35:34.217 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T05:35:34.217 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T05:35:34.218 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T05:35:34.218 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T05:35:34.218 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T05:35:34.218 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T05:35:34.218 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T05:35:34.218 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:35:34.218 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.75760 2026-02-17T05:35:34.218 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.75760/ceph-mon.a.asok 2026-02-17T05:35:34.219 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T05:35:34.219 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.75760/ceph-mon.a.asok config get mon_host 2026-02-17T05:35:34.274 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:29: TEST_ec_error_rollforward: run_mgr td/ec-error-rollforward x 2026-02-17T05:35:34.275 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/ec-error-rollforward 2026-02-17T05:35:34.275 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T05:35:34.275 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T05:35:34.275 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T05:35:34.275 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/ec-error-rollforward/x 2026-02-17T05:35:34.275 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T05:35:34.386 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T05:35:34.386 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:35:34.386 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:35:34.386 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:35:34.386 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:35:34.386 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.75760 2026-02-17T05:35:34.386 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.75760/$cluster-$name.asok' 2026-02-17T05:35:34.387 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T05:35:34.387 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ec-error-rollforward/x '--log-file=td/ec-error-rollforward/$name.log' '--admin-socket=/tmp/ceph-asok.75760/$cluster-$name.asok' --run-dir=td/ec-error-rollforward '--pid-file=td/ec-error-rollforward/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T05:35:34.408 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:30: TEST_ec_error_rollforward: run_osd td/ec-error-rollforward 0 2026-02-17T05:35:34.408 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ec-error-rollforward 2026-02-17T05:35:34.408 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T05:35:34.408 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T05:35:34.408 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T05:35:34.408 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ec-error-rollforward/0 2026-02-17T05:35:34.408 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=7e3841b9-6544-4160-879a-52da16f3b460 --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-17T05:35:34.408 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:35:34.408 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:35:34.409 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:35:34.409 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/0' 2026-02-17T05:35:34.409 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/0/journal' 2026-02-17T05:35:34.409 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T05:35:34.409 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T05:35:34.409 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-17T05:35:34.409 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T05:35:34.409 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:35:34.409 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:35:34.409 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:35:34.409 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:35:34.409 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.75760 2026-02-17T05:35:34.410 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.75760/$cluster-$name.asok' 2026-02-17T05:35:34.410 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.75760/$cluster-$name.asok' 2026-02-17T05:35:34.410 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:35:34.410 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T05:35:34.410 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T05:35:34.410 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-17T05:35:34.410 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-17T05:35:34.410 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:35:34.410 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:35:34.410 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:35:34.410 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:35:34.410 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T05:35:34.410 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T05:35:34.411 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ec-error-rollforward/0 2026-02-17T05:35:34.411 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T05:35:34.411 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=b7782e49-ad0d-4b74-a8e1-544c24c73d28 2026-02-17T05:35:34.412 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 b7782e49-ad0d-4b74-a8e1-544c24c73d28' 2026-02-17T05:35:34.412 INFO:tasks.workunit.client.0.trial030.stdout:add osd0 b7782e49-ad0d-4b74-a8e1-544c24c73d28 2026-02-17T05:35:34.412 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T05:35:34.419 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAm/pNpdijEGBAAySzRpnv43PA7jG/oG30P7g== 2026-02-17T05:35:34.419 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAm/pNpdijEGBAAySzRpnv43PA7jG/oG30P7g=="}' 2026-02-17T05:35:34.419 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new b7782e49-ad0d-4b74-a8e1-544c24c73d28 -i td/ec-error-rollforward/0/new.json 2026-02-17T05:35:34.528 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:35:34.536 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ec-error-rollforward/0/new.json 2026-02-17T05:35:34.537 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=7e3841b9-6544-4160-879a-52da16f3b460 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/0 --osd-journal=td/ec-error-rollforward/0/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.75760/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAm/pNpdijEGBAAySzRpnv43PA7jG/oG30P7g== --osd-uuid b7782e49-ad0d-4b74-a8e1-544c24c73d28 2026-02-17T05:35:34.551 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:34.544+0000 7f39be131a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:35:34.553 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:34.544+0000 7f39be131a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:35:34.554 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:34.548+0000 7f39be131a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:35:34.554 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:34.548+0000 7f39be131a40 -1 bdev(0x55609af96400 td/ec-error-rollforward/0/block) open stat got: (1) Operation not permitted 2026-02-17T05:35:34.554 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:34.548+0000 7f39be131a40 -1 bluestore(td/ec-error-rollforward/0) _read_fsid unparsable uuid 2026-02-17T05:35:35.232 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ec-error-rollforward/0/keyring 2026-02-17T05:35:35.233 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T05:35:35.233 INFO:tasks.workunit.client.0.trial030.stdout:adding osd0 key to auth repository 2026-02-17T05:35:35.234 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T05:35:35.234 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ec-error-rollforward/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T05:35:35.345 INFO:tasks.workunit.client.0.trial030.stdout:start osd.0 2026-02-17T05:35:35.346 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T05:35:35.346 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=7e3841b9-6544-4160-879a-52da16f3b460 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/0 --osd-journal=td/ec-error-rollforward/0/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.75760/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T05:35:35.346 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T05:35:35.346 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T05:35:35.346 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T05:35:35.361 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:35.356+0000 7fbc99e94a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:35:35.363 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:35.356+0000 7fbc99e94a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:35:35.364 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:35.356+0000 7fbc99e94a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:35:35.457 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T05:35:35.458 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:35:35.458 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T05:35:35.458 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:35:35.458 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:35:35.458 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:35:35.458 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:35:35.459 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:35:35.459 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:35:35.459 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T05:35:35.564 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:35:35.787 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:35.780+0000 7fbc99e94a40 -1 Falling back to public interface 2026-02-17T05:35:36.397 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:36.388+0000 7fbc99e94a40 -1 osd.0 0 log_to_monitors true 2026-02-17T05:35:36.565 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:35:36.565 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:35:36.565 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-17T05:35:36.565 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T05:35:36.567 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T05:35:36.569 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:35:36.714 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:35:37.715 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:35:37.715 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:35:37.715 INFO:tasks.workunit.client.0.trial030.stdout:2 2026-02-17T05:35:37.715 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T05:35:37.715 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:35:37.715 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T05:35:37.925 INFO:tasks.workunit.client.0.trial030.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/608871419,v1:127.0.0.1:6801/608871419] [v2:127.0.0.1:6802/608871419,v1:127.0.0.1:6803/608871419] exists,up b7782e49-ad0d-4b74-a8e1-544c24c73d28 2026-02-17T05:35:37.928 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:35:37.929 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:35:37.929 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:35:37.929 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:31: TEST_ec_error_rollforward: run_osd td/ec-error-rollforward 1 2026-02-17T05:35:37.929 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ec-error-rollforward 2026-02-17T05:35:37.929 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T05:35:37.929 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-17T05:35:37.929 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T05:35:37.929 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ec-error-rollforward/1 2026-02-17T05:35:37.929 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=7e3841b9-6544-4160-879a-52da16f3b460 --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-17T05:35:37.930 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:35:37.930 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:35:37.930 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:35:37.930 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/1' 2026-02-17T05:35:37.930 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/1/journal' 2026-02-17T05:35:37.930 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T05:35:37.930 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T05:35:37.930 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-17T05:35:37.930 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T05:35:37.930 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:35:37.931 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:35:37.931 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:35:37.931 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:35:37.931 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.75760 2026-02-17T05:35:37.931 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.75760/$cluster-$name.asok' 2026-02-17T05:35:37.931 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.75760/$cluster-$name.asok' 2026-02-17T05:35:37.931 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:35:37.931 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T05:35:37.931 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T05:35:37.931 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-17T05:35:37.932 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-17T05:35:37.932 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:35:37.932 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:35:37.932 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:35:37.932 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:35:37.932 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T05:35:37.932 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T05:35:37.932 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ec-error-rollforward/1 2026-02-17T05:35:37.932 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T05:35:37.933 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=73ded32e-53ba-4f2a-9e78-c609bc9060fe 2026-02-17T05:35:37.933 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 73ded32e-53ba-4f2a-9e78-c609bc9060fe' 2026-02-17T05:35:37.933 INFO:tasks.workunit.client.0.trial030.stdout:add osd1 73ded32e-53ba-4f2a-9e78-c609bc9060fe 2026-02-17T05:35:37.934 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T05:35:37.943 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAp/pNpTav2NxAAW0CD10ScMqSrBk2KtTYG+A== 2026-02-17T05:35:37.943 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAp/pNpTav2NxAAW0CD10ScMqSrBk2KtTYG+A=="}' 2026-02-17T05:35:37.943 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 73ded32e-53ba-4f2a-9e78-c609bc9060fe -i td/ec-error-rollforward/1/new.json 2026-02-17T05:35:38.156 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-17T05:35:38.166 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ec-error-rollforward/1/new.json 2026-02-17T05:35:38.166 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=7e3841b9-6544-4160-879a-52da16f3b460 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/1 --osd-journal=td/ec-error-rollforward/1/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.75760/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAp/pNpTav2NxAAW0CD10ScMqSrBk2KtTYG+A== --osd-uuid 73ded32e-53ba-4f2a-9e78-c609bc9060fe 2026-02-17T05:35:38.181 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:38.176+0000 7f48797e1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:35:38.183 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:38.176+0000 7f48797e1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:35:38.184 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:38.176+0000 7f48797e1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:35:38.185 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:38.176+0000 7f48797e1a40 -1 bdev(0x55f7b087a400 td/ec-error-rollforward/1/block) open stat got: (1) Operation not permitted 2026-02-17T05:35:38.185 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:38.180+0000 7f48797e1a40 -1 bluestore(td/ec-error-rollforward/1) _read_fsid unparsable uuid 2026-02-17T05:35:38.832 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ec-error-rollforward/1/keyring 2026-02-17T05:35:38.832 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T05:35:38.832 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-17T05:35:38.833 INFO:tasks.workunit.client.0.trial030.stdout:adding osd1 key to auth repository 2026-02-17T05:35:38.833 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ec-error-rollforward/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T05:35:39.132 INFO:tasks.workunit.client.0.trial030.stdout:start osd.1 2026-02-17T05:35:39.133 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-17T05:35:39.133 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=7e3841b9-6544-4160-879a-52da16f3b460 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/1 --osd-journal=td/ec-error-rollforward/1/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.75760/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T05:35:39.133 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T05:35:39.133 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T05:35:39.133 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T05:35:39.154 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:39.148+0000 7f4f12dbea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:35:39.155 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:39.148+0000 7f4f12dbea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:35:39.156 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:39.148+0000 7f4f12dbea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:35:39.349 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-17T05:35:39.349 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:35:39.350 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T05:35:39.350 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:35:39.350 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:35:39.350 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:35:39.350 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:35:39.351 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:35:39.351 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:35:39.351 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T05:35:39.565 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:35:39.619 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:39.612+0000 7f4f12dbea40 -1 Falling back to public interface 2026-02-17T05:35:40.279 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:40.271+0000 7f4f12dbea40 -1 osd.1 0 log_to_monitors true 2026-02-17T05:35:40.566 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:35:40.566 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:35:40.566 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T05:35:40.566 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-17T05:35:40.566 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:35:40.566 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T05:35:40.778 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:35:41.779 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:35:41.779 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:35:41.780 INFO:tasks.workunit.client.0.trial030.stdout:2 2026-02-17T05:35:41.780 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T05:35:41.780 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:35:41.780 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T05:35:41.995 INFO:tasks.workunit.client.0.trial030.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3778377404,v1:127.0.0.1:6811/3778377404] [v2:127.0.0.1:6812/3778377404,v1:127.0.0.1:6813/3778377404] exists,up 73ded32e-53ba-4f2a-9e78-c609bc9060fe 2026-02-17T05:35:41.998 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:35:41.998 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:35:41.998 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:35:41.998 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:32: TEST_ec_error_rollforward: run_osd td/ec-error-rollforward 2 2026-02-17T05:35:41.998 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ec-error-rollforward 2026-02-17T05:35:41.998 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T05:35:41.998 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-17T05:35:41.999 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T05:35:41.999 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ec-error-rollforward/2 2026-02-17T05:35:41.999 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=7e3841b9-6544-4160-879a-52da16f3b460 --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-17T05:35:41.999 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:35:41.999 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:35:41.999 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:35:41.999 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/2' 2026-02-17T05:35:41.999 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/2/journal' 2026-02-17T05:35:41.999 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T05:35:41.999 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T05:35:41.999 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-17T05:35:41.999 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T05:35:42.000 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:35:42.000 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:35:42.000 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:35:42.000 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:35:42.000 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.75760 2026-02-17T05:35:42.000 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.75760/$cluster-$name.asok' 2026-02-17T05:35:42.000 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.75760/$cluster-$name.asok' 2026-02-17T05:35:42.000 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:35:42.000 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T05:35:42.000 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T05:35:42.000 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-17T05:35:42.000 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-17T05:35:42.001 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:35:42.001 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:35:42.001 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:35:42.001 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:35:42.001 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T05:35:42.001 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T05:35:42.001 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ec-error-rollforward/2 2026-02-17T05:35:42.002 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T05:35:42.002 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=65993093-f748-4d0b-9841-f6335aff94db 2026-02-17T05:35:42.002 INFO:tasks.workunit.client.0.trial030.stdout:add osd2 65993093-f748-4d0b-9841-f6335aff94db 2026-02-17T05:35:42.003 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 65993093-f748-4d0b-9841-f6335aff94db' 2026-02-17T05:35:42.003 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T05:35:42.012 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAu/pNpTMR7ABAAHpB7eXHYGREizAZ5spGZrg== 2026-02-17T05:35:42.012 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAu/pNpTMR7ABAAHpB7eXHYGREizAZ5spGZrg=="}' 2026-02-17T05:35:42.012 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 65993093-f748-4d0b-9841-f6335aff94db -i td/ec-error-rollforward/2/new.json 2026-02-17T05:35:42.243 INFO:tasks.workunit.client.0.trial030.stdout:2 2026-02-17T05:35:42.252 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ec-error-rollforward/2/new.json 2026-02-17T05:35:42.253 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=7e3841b9-6544-4160-879a-52da16f3b460 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/2 --osd-journal=td/ec-error-rollforward/2/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.75760/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAu/pNpTMR7ABAAHpB7eXHYGREizAZ5spGZrg== --osd-uuid 65993093-f748-4d0b-9841-f6335aff94db 2026-02-17T05:35:42.268 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:42.259+0000 7f8383983a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:35:42.269 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:42.263+0000 7f8383983a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:35:42.270 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:42.263+0000 7f8383983a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:35:42.271 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:42.263+0000 7f8383983a40 -1 bdev(0x55e52325a400 td/ec-error-rollforward/2/block) open stat got: (1) Operation not permitted 2026-02-17T05:35:42.271 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:42.263+0000 7f8383983a40 -1 bluestore(td/ec-error-rollforward/2) _read_fsid unparsable uuid 2026-02-17T05:35:42.957 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ec-error-rollforward/2/keyring 2026-02-17T05:35:42.957 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T05:35:42.957 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-17T05:35:42.958 INFO:tasks.workunit.client.0.trial030.stdout:adding osd2 key to auth repository 2026-02-17T05:35:42.958 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ec-error-rollforward/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T05:35:43.247 INFO:tasks.workunit.client.0.trial030.stdout:start osd.2 2026-02-17T05:35:43.248 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-17T05:35:43.248 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=7e3841b9-6544-4160-879a-52da16f3b460 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/2 --osd-journal=td/ec-error-rollforward/2/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.75760/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T05:35:43.248 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T05:35:43.248 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T05:35:43.248 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T05:35:43.263 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:43.255+0000 7f7e4c3b1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:35:43.265 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:43.255+0000 7f7e4c3b1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:35:43.266 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:43.259+0000 7f7e4c3b1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:35:43.456 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-17T05:35:43.456 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:35:43.456 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T05:35:43.456 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:35:43.456 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:35:43.456 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:35:43.456 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:35:43.457 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:35:43.457 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:35:43.457 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T05:35:43.639 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:43.631+0000 7f7e4c3b1a40 -1 Falling back to public interface 2026-02-17T05:35:43.672 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:35:44.226 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:44.219+0000 7f7e4c3b1a40 -1 osd.2 0 log_to_monitors true 2026-02-17T05:35:44.673 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:35:44.673 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:35:44.673 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-17T05:35:44.674 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T05:35:44.674 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:35:44.674 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T05:35:44.882 INFO:tasks.workunit.client.0.trial030.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1598969770,v1:127.0.0.1:6819/1598969770] [v2:127.0.0.1:6820/1598969770,v1:127.0.0.1:6821/1598969770] exists,up 65993093-f748-4d0b-9841-f6335aff94db 2026-02-17T05:35:44.885 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:35:44.885 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:35:44.885 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:35:44.885 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:33: TEST_ec_error_rollforward: run_osd td/ec-error-rollforward 3 2026-02-17T05:35:44.886 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ec-error-rollforward 2026-02-17T05:35:44.886 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T05:35:44.886 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-17T05:35:44.886 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T05:35:44.886 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ec-error-rollforward/3 2026-02-17T05:35:44.886 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=7e3841b9-6544-4160-879a-52da16f3b460 --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-17T05:35:44.886 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:35:44.886 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:35:44.886 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:35:44.886 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/3' 2026-02-17T05:35:44.886 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/3/journal' 2026-02-17T05:35:44.886 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T05:35:44.887 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T05:35:44.887 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-17T05:35:44.887 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T05:35:44.887 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:35:44.887 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:35:44.887 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:35:44.887 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:35:44.887 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.75760 2026-02-17T05:35:44.887 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.75760/$cluster-$name.asok' 2026-02-17T05:35:44.887 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.75760/$cluster-$name.asok' 2026-02-17T05:35:44.887 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:35:44.887 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T05:35:44.888 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T05:35:44.888 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-17T05:35:44.888 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-17T05:35:44.888 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:35:44.888 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:35:44.888 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:35:44.888 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:35:44.888 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T05:35:44.888 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T05:35:44.888 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ec-error-rollforward/3 2026-02-17T05:35:44.888 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T05:35:44.889 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=e02b6a12-4c67-48bd-85db-50e6e109dd5a 2026-02-17T05:35:44.889 INFO:tasks.workunit.client.0.trial030.stdout:add osd3 e02b6a12-4c67-48bd-85db-50e6e109dd5a 2026-02-17T05:35:44.890 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 e02b6a12-4c67-48bd-85db-50e6e109dd5a' 2026-02-17T05:35:44.890 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T05:35:44.899 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAw/pNpdhdXNRAAY7zPvpkxKn31Jrksstg55A== 2026-02-17T05:35:44.899 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAw/pNpdhdXNRAAY7zPvpkxKn31Jrksstg55A=="}' 2026-02-17T05:35:44.899 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new e02b6a12-4c67-48bd-85db-50e6e109dd5a -i td/ec-error-rollforward/3/new.json 2026-02-17T05:35:45.115 INFO:tasks.workunit.client.0.trial030.stdout:3 2026-02-17T05:35:45.125 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ec-error-rollforward/3/new.json 2026-02-17T05:35:45.125 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=7e3841b9-6544-4160-879a-52da16f3b460 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/3 --osd-journal=td/ec-error-rollforward/3/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.75760/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAw/pNpdhdXNRAAY7zPvpkxKn31Jrksstg55A== --osd-uuid e02b6a12-4c67-48bd-85db-50e6e109dd5a 2026-02-17T05:35:45.141 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:45.135+0000 7f5e65002a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:35:45.143 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:45.135+0000 7f5e65002a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:35:45.144 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:45.135+0000 7f5e65002a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:35:45.144 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:45.135+0000 7f5e65002a40 -1 bdev(0x559f903a8400 td/ec-error-rollforward/3/block) open stat got: (1) Operation not permitted 2026-02-17T05:35:45.144 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:45.135+0000 7f5e65002a40 -1 bluestore(td/ec-error-rollforward/3) _read_fsid unparsable uuid 2026-02-17T05:35:45.779 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ec-error-rollforward/3/keyring 2026-02-17T05:35:45.779 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T05:35:45.780 INFO:tasks.workunit.client.0.trial030.stdout:adding osd3 key to auth repository 2026-02-17T05:35:45.780 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-17T05:35:45.780 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ec-error-rollforward/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T05:35:46.070 INFO:tasks.workunit.client.0.trial030.stdout:start osd.3 2026-02-17T05:35:46.071 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-17T05:35:46.071 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=7e3841b9-6544-4160-879a-52da16f3b460 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/3 --osd-journal=td/ec-error-rollforward/3/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.75760/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T05:35:46.071 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T05:35:46.071 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T05:35:46.072 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T05:35:46.092 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:46.083+0000 7f1f756dfa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:35:46.094 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:46.087+0000 7f1f756dfa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:35:46.095 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:46.087+0000 7f1f756dfa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:35:46.280 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-17T05:35:46.280 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:35:46.280 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-17T05:35:46.280 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:35:46.280 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:35:46.281 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:35:46.281 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:35:46.281 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:35:46.282 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:35:46.282 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T05:35:46.488 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:35:46.555 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:46.547+0000 7f1f756dfa40 -1 Falling back to public interface 2026-02-17T05:35:47.147 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:47.139+0000 7f1f756dfa40 -1 osd.3 0 log_to_monitors true 2026-02-17T05:35:47.490 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:35:47.490 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:35:47.491 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-17T05:35:47.491 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T05:35:47.491 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:35:47.492 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T05:35:47.706 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:35:48.707 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:35:48.707 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:35:48.707 INFO:tasks.workunit.client.0.trial030.stdout:2 2026-02-17T05:35:48.707 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T05:35:48.707 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:35:48.707 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T05:35:48.921 INFO:tasks.workunit.client.0.trial030.stdout:osd.3 up in weight 1 up_from 19 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/582329830,v1:127.0.0.1:6827/582329830] [v2:127.0.0.1:6828/582329830,v1:127.0.0.1:6829/582329830] exists,up e02b6a12-4c67-48bd-85db-50e6e109dd5a 2026-02-17T05:35:48.921 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:35:48.921 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:35:48.921 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:35:48.921 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:35: TEST_ec_error_rollforward: ceph osd erasure-code-profile set ec-profile m=2 k=2 crush-failure-domain=osd 2026-02-17T05:35:49.179 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:36: TEST_ec_error_rollforward: ceph osd pool create ec 1 1 erasure ec-profile 2026-02-17T05:35:49.558 INFO:tasks.workunit.client.0.trial030.stderr:pool 'ec' already exists 2026-02-17T05:35:49.568 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:38: TEST_ec_error_rollforward: rados -p ec put foo /etc/passwd 2026-02-17T05:35:50.169 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:40: TEST_ec_error_rollforward: cat td/ec-error-rollforward/osd.2.pid 2026-02-17T05:35:50.170 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:40: TEST_ec_error_rollforward: kill -STOP 80109 2026-02-17T05:35:50.170 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:43: TEST_ec_error_rollforward: pids=82438 2026-02-17T05:35:50.170 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:44: TEST_ec_error_rollforward: sleep 1 2026-02-17T05:35:50.171 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:42: TEST_ec_error_rollforward: rados -p ec rm foo 2026-02-17T05:35:51.172 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:46: TEST_ec_error_rollforward: pids+=' 82459' 2026-02-17T05:35:51.172 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:45: TEST_ec_error_rollforward: rados -p ec rm a 2026-02-17T05:35:51.172 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:48: TEST_ec_error_rollforward: pids+=' 82460' 2026-02-17T05:35:51.172 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:47: TEST_ec_error_rollforward: rados -p ec rm b 2026-02-17T05:35:51.172 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:50: TEST_ec_error_rollforward: pids+=' 82461' 2026-02-17T05:35:51.172 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:51: TEST_ec_error_rollforward: sleep 1 2026-02-17T05:35:51.172 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:49: TEST_ec_error_rollforward: rados -p ec rm c 2026-02-17T05:35:52.174 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:54: TEST_ec_error_rollforward: kill_daemons td/ec-error-rollforward KILL osd 2026-02-17T05:35:52.175 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:35:52.175 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:35:52.175 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:35:52.175 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:35:52.175 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:35:52.286 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:35:52.286 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:55: TEST_ec_error_rollforward: kill 82438 82459 82460 82461 2026-02-17T05:35:52.286 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:56: TEST_ec_error_rollforward: wait 2026-02-17T05:35:52.290 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:58: TEST_ec_error_rollforward: activate_osd td/ec-error-rollforward 0 2026-02-17T05:35:52.290 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/ec-error-rollforward 2026-02-17T05:35:52.290 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T05:35:52.290 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T05:35:52.291 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T05:35:52.291 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/ec-error-rollforward/0 2026-02-17T05:35:52.291 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=7e3841b9-6544-4160-879a-52da16f3b460 --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-17T05:35:52.291 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:35:52.291 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:35:52.291 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:35:52.291 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/0' 2026-02-17T05:35:52.291 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/0/journal' 2026-02-17T05:35:52.291 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T05:35:52.291 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T05:35:52.291 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-17T05:35:52.292 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T05:35:52.292 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:35:52.292 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:35:52.292 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:35:52.292 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:35:52.292 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.75760 2026-02-17T05:35:52.292 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.75760/$cluster-$name.asok' 2026-02-17T05:35:52.292 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.75760/$cluster-$name.asok' 2026-02-17T05:35:52.292 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:35:52.292 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-17T05:35:52.292 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-17T05:35:52.292 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:35:52.292 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:35:52.293 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:35:52.293 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:35:52.293 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T05:35:52.293 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T05:35:52.293 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/ec-error-rollforward/0 2026-02-17T05:35:52.293 INFO:tasks.workunit.client.0.trial030.stdout:start osd.0 2026-02-17T05:35:52.294 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T05:35:52.294 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=7e3841b9-6544-4160-879a-52da16f3b460 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/0 --osd-journal=td/ec-error-rollforward/0/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.75760/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T05:35:52.295 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/ec-error-rollforward/0/whoami 2026-02-17T05:35:52.295 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T05:35:52.295 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T05:35:52.295 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T05:35:52.295 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T05:35:52.313 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:52.303+0000 7f03f297aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:35:52.314 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:52.307+0000 7f03f297aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:35:52.315 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:52.307+0000 7f03f297aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:35:52.510 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T05:35:52.510 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:35:52.510 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T05:35:52.510 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:35:52.510 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:35:52.510 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:35:52.510 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:35:52.510 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:35:52.510 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:35:52.510 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T05:35:52.729 INFO:tasks.workunit.client.0.trial030.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/608871419,v1:127.0.0.1:6801/608871419] [v2:127.0.0.1:6802/608871419,v1:127.0.0.1:6803/608871419] exists,up b7782e49-ad0d-4b74-a8e1-544c24c73d28 2026-02-17T05:35:52.732 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:35:52.732 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:35:52.732 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:35:52.732 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:59: TEST_ec_error_rollforward: activate_osd td/ec-error-rollforward 1 2026-02-17T05:35:52.733 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/ec-error-rollforward 2026-02-17T05:35:52.733 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T05:35:52.733 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T05:35:52.733 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T05:35:52.733 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/ec-error-rollforward/1 2026-02-17T05:35:52.733 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=7e3841b9-6544-4160-879a-52da16f3b460 --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-17T05:35:52.733 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:35:52.733 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:35:52.733 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:35:52.733 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/1' 2026-02-17T05:35:52.733 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/1/journal' 2026-02-17T05:35:52.733 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T05:35:52.734 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T05:35:52.734 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-17T05:35:52.734 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T05:35:52.734 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:35:52.734 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:35:52.734 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:35:52.734 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:35:52.734 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.75760 2026-02-17T05:35:52.734 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.75760/$cluster-$name.asok' 2026-02-17T05:35:52.734 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.75760/$cluster-$name.asok' 2026-02-17T05:35:52.734 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:35:52.734 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-17T05:35:52.735 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-17T05:35:52.735 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:35:52.735 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:35:52.735 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:35:52.735 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:35:52.735 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T05:35:52.735 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T05:35:52.735 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/ec-error-rollforward/1 2026-02-17T05:35:52.735 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T05:35:52.736 INFO:tasks.workunit.client.0.trial030.stdout:start osd.1 2026-02-17T05:35:52.737 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=7e3841b9-6544-4160-879a-52da16f3b460 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/1 --osd-journal=td/ec-error-rollforward/1/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.75760/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T05:35:52.737 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/ec-error-rollforward/1/whoami 2026-02-17T05:35:52.737 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T05:35:52.737 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T05:35:52.737 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T05:35:52.737 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T05:35:52.755 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:52.747+0000 7fcc856e7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:35:52.756 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:52.747+0000 7fcc856e7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:35:52.757 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:52.747+0000 7fcc856e7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:35:52.811 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:52.803+0000 7f03f297aa40 -1 Falling back to public interface 2026-02-17T05:35:52.955 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T05:35:52.956 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:35:52.956 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T05:35:52.956 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:35:52.956 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:35:52.956 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:35:52.956 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:35:52.957 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:35:52.957 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:35:52.957 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T05:35:53.163 INFO:tasks.workunit.client.0.trial030.stdout:osd.1 up in weight 1 up_from 9 up_thru 23 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3778377404,v1:127.0.0.1:6811/3778377404] [v2:127.0.0.1:6812/3778377404,v1:127.0.0.1:6813/3778377404] exists,up 73ded32e-53ba-4f2a-9e78-c609bc9060fe 2026-02-17T05:35:53.164 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:35:53.164 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:35:53.165 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:35:53.165 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:60: TEST_ec_error_rollforward: activate_osd td/ec-error-rollforward 2 2026-02-17T05:35:53.165 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/ec-error-rollforward 2026-02-17T05:35:53.165 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T05:35:53.165 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-17T05:35:53.165 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T05:35:53.165 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/ec-error-rollforward/2 2026-02-17T05:35:53.165 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=7e3841b9-6544-4160-879a-52da16f3b460 --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-17T05:35:53.165 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:35:53.165 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:35:53.165 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:35:53.165 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/2' 2026-02-17T05:35:53.165 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/2/journal' 2026-02-17T05:35:53.165 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T05:35:53.165 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T05:35:53.165 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-17T05:35:53.165 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T05:35:53.165 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:35:53.165 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:35:53.165 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:35:53.166 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:35:53.166 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.75760 2026-02-17T05:35:53.167 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.75760/$cluster-$name.asok' 2026-02-17T05:35:53.167 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.75760/$cluster-$name.asok' 2026-02-17T05:35:53.167 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:35:53.167 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-17T05:35:53.167 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-17T05:35:53.167 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:35:53.167 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:35:53.167 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:35:53.167 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:35:53.167 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T05:35:53.167 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T05:35:53.167 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/ec-error-rollforward/2 2026-02-17T05:35:53.167 INFO:tasks.workunit.client.0.trial030.stdout:start osd.2 2026-02-17T05:35:53.168 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-17T05:35:53.168 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=7e3841b9-6544-4160-879a-52da16f3b460 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/2 --osd-journal=td/ec-error-rollforward/2/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.75760/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T05:35:53.168 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/ec-error-rollforward/2/whoami 2026-02-17T05:35:53.168 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-17T05:35:53.168 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T05:35:53.168 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T05:35:53.168 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T05:35:53.190 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:53.183+0000 7f627947fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:35:53.192 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:53.183+0000 7f627947fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:35:53.193 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:53.183+0000 7f627947fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:35:53.271 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:53.263+0000 7fcc856e7a40 -1 Falling back to public interface 2026-02-17T05:35:53.386 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-17T05:35:53.386 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:35:53.386 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T05:35:53.386 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:35:53.386 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:35:53.386 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:35:53.386 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:35:53.386 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:35:53.386 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:35:53.386 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T05:35:53.597 INFO:tasks.workunit.client.0.trial030.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1598969770,v1:127.0.0.1:6819/1598969770] [v2:127.0.0.1:6820/1598969770,v1:127.0.0.1:6821/1598969770] exists,up 65993093-f748-4d0b-9841-f6335aff94db 2026-02-17T05:35:53.600 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:35:53.600 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:35:53.601 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:35:53.601 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:61: TEST_ec_error_rollforward: activate_osd td/ec-error-rollforward 3 2026-02-17T05:35:53.601 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/ec-error-rollforward 2026-02-17T05:35:53.601 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T05:35:53.601 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-17T05:35:53.601 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T05:35:53.601 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/ec-error-rollforward/3 2026-02-17T05:35:53.601 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=7e3841b9-6544-4160-879a-52da16f3b460 --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-17T05:35:53.601 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:35:53.601 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:35:53.601 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:35:53.601 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/3' 2026-02-17T05:35:53.602 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/3/journal' 2026-02-17T05:35:53.602 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T05:35:53.602 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T05:35:53.602 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-17T05:35:53.602 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T05:35:53.602 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:35:53.602 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:35:53.602 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:35:53.602 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:35:53.602 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.75760 2026-02-17T05:35:53.602 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.75760/$cluster-$name.asok' 2026-02-17T05:35:53.602 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.75760/$cluster-$name.asok' 2026-02-17T05:35:53.603 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:35:53.603 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-17T05:35:53.603 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-17T05:35:53.603 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:35:53.603 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:35:53.603 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:35:53.603 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:35:53.603 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T05:35:53.603 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T05:35:53.603 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/ec-error-rollforward/3 2026-02-17T05:35:53.604 INFO:tasks.workunit.client.0.trial030.stdout:start osd.3 2026-02-17T05:35:53.605 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-17T05:35:53.605 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=7e3841b9-6544-4160-879a-52da16f3b460 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/3 --osd-journal=td/ec-error-rollforward/3/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.75760/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T05:35:53.605 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/ec-error-rollforward/3/whoami 2026-02-17T05:35:53.605 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-17T05:35:53.605 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T05:35:53.605 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T05:35:53.605 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T05:35:53.618 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:53.611+0000 7ff965d24a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:35:53.620 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:53.611+0000 7ff965d24a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:35:53.621 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:53.611+0000 7ff965d24a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:35:53.715 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:53.707+0000 7f627947fa40 -1 Falling back to public interface 2026-02-17T05:35:53.813 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:53.803+0000 7f03f297aa40 -1 osd.0 25 log_to_monitors true 2026-02-17T05:35:53.828 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-17T05:35:53.828 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:35:53.828 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-17T05:35:53.828 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:35:53.828 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:35:53.828 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:35:53.828 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:35:53.829 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:35:53.829 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:35:53.829 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T05:35:54.036 INFO:tasks.workunit.client.0.trial030.stdout:osd.3 up in weight 1 up_from 19 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/582329830,v1:127.0.0.1:6827/582329830] [v2:127.0.0.1:6828/582329830,v1:127.0.0.1:6829/582329830] exists,up e02b6a12-4c67-48bd-85db-50e6e109dd5a 2026-02-17T05:35:54.037 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:35:54.037 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:35:54.037 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:35:54.037 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:63: TEST_ec_error_rollforward: wait_for_clean 2026-02-17T05:35:54.037 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T05:35:54.037 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T05:35:54.037 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T05:35:54.038 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T05:35:54.038 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T05:35:54.038 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T05:35:54.038 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T05:35:54.038 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T05:35:54.038 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T05:35:54.136 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T05:35:54.136 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T05:35:54.137 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T05:35:54.137 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T05:35:54.137 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T05:35:54.137 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:35:54.155 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:54.147+0000 7ff965d24a40 -1 Falling back to public interface 2026-02-17T05:35:54.261 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:54.255+0000 7fcc856e7a40 -1 osd.1 25 log_to_monitors true 2026-02-17T05:35:54.360 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:35:54.360 INFO:tasks.workunit.client.0.trial030.stderr:1 2026-02-17T05:35:54.360 INFO:tasks.workunit.client.0.trial030.stderr:2 2026-02-17T05:35:54.360 INFO:tasks.workunit.client.0.trial030.stderr:3' 2026-02-17T05:35:54.360 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:35:54.360 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:35:54.361 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T05:35:54.437 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=120259084291 2026-02-17T05:35:54.438 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 120259084291 2026-02-17T05:35:54.438 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-120259084291' 2026-02-17T05:35:54.438 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:35:54.438 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T05:35:54.499 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-17T05:35:54.499 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: true 2026-02-17T05:35:54.500 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-17T05:35:54.500 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: continue 2026-02-17T05:35:54.500 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:35:54.500 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T05:35:54.693 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:54.683+0000 7f627947fa40 -1 osd.2 24 log_to_monitors true 2026-02-17T05:35:54.997 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:35:54.987+0000 7ff965d24a40 -1 osd.3 25 log_to_monitors true 2026-02-17T05:35:59.584 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=154618822659 2026-02-17T05:35:59.584 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 154618822659 2026-02-17T05:35:59.584 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-120259084291 2-154618822659' 2026-02-17T05:35:59.584 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:35:59.584 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T05:35:59.661 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=163208757251 2026-02-17T05:35:59.661 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 163208757251 2026-02-17T05:35:59.661 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-120259084291 2-154618822659 3-163208757251' 2026-02-17T05:35:59.661 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:35:59.662 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-120259084291 2026-02-17T05:35:59.662 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:35:59.663 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:35:59.664 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-120259084291 2026-02-17T05:35:59.664 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:35:59.665 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=120259084291 2026-02-17T05:35:59.666 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.0 seq 120259084291 2026-02-17T05:35:59.666 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 120259084291' 2026-02-17T05:35:59.666 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:35:59.886 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 120259084291 -lt 120259084291 2026-02-17T05:35:59.886 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:35:59.887 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-154618822659 2026-02-17T05:35:59.887 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:35:59.888 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:35:59.889 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-154618822659 2026-02-17T05:35:59.889 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:35:59.890 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=154618822659 2026-02-17T05:35:59.890 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.2 seq 154618822659 2026-02-17T05:35:59.890 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 154618822659' 2026-02-17T05:35:59.891 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:36:00.106 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 154618822659 2026-02-17T05:36:00.106 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:36:01.107 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T05:36:01.107 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:36:01.326 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 154618822660 -lt 154618822659 2026-02-17T05:36:01.326 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:36:01.327 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-163208757251 2026-02-17T05:36:01.327 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:36:01.328 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T05:36:01.329 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-163208757251 2026-02-17T05:36:01.329 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:36:01.330 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=163208757251 2026-02-17T05:36:01.331 INFO:tasks.workunit.client.0.trial030.stdout:waiting osd.3 seq 163208757251 2026-02-17T05:36:01.331 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 163208757251' 2026-02-17T05:36:01.331 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T05:36:01.547 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 163208757252 -lt 163208757251 2026-02-17T05:36:01.549 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T05:36:01.549 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:36:01.549 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:36:01.823 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T05:36:01.824 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:36:01.824 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:36:01.824 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:36:01.824 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:36:01.824 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:36:01.824 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:36:01.824 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:36:02.031 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T05:36:02.032 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:36:02.032 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:36:02.033 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:36:02.309 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T05:36:02.309 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T05:36:02.309 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T05:36:02.309 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:22: run: teardown td/ec-error-rollforward 2026-02-17T05:36:02.310 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ec-error-rollforward 2026-02-17T05:36:02.310 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T05:36:02.310 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ec-error-rollforward KILL 2026-02-17T05:36:02.310 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:36:02.310 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:36:02.310 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:36:02.310 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:36:02.310 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:36:02.419 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:36:02.420 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T05:36:02.420 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T05:36:02.420 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T05:36:02.421 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T05:36:02.421 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T05:36:02.421 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T05:36:02.422 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:36:02.422 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T05:36:02.423 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T05:36:02.423 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:36:02.424 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T05:36:02.425 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T05:36:02.425 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ec-error-rollforward 2026-02-17T05:36:02.438 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T05:36:02.438 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:36:02.438 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.75760 2026-02-17T05:36:02.438 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.75760 2026-02-17T05:36:02.440 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T05:36:02.440 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T05:36:02.440 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: code=0 2026-02-17T05:36:02.440 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2404: main: teardown td/ec-error-rollforward 0 2026-02-17T05:36:02.440 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ec-error-rollforward 2026-02-17T05:36:02.440 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-17T05:36:02.440 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ec-error-rollforward KILL 2026-02-17T05:36:02.440 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:36:02.440 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:36:02.441 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:36:02.441 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:36:02.441 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:36:02.442 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:36:02.442 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T05:36:02.443 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T05:36:02.443 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T05:36:02.444 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T05:36:02.444 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T05:36:02.445 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T05:36:02.446 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:36:02.446 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T05:36:02.446 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T05:36:02.446 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:36:02.447 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T05:36:02.449 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-17T05:36:02.449 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ec-error-rollforward 2026-02-17T05:36:02.450 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T05:36:02.450 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:36:02.450 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.75760 2026-02-17T05:36:02.450 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.75760 2026-02-17T05:36:02.452 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T05:36:02.452 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T05:36:02.452 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: return 0 2026-02-17T05:36:02.452 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-17T05:36:02.453 DEBUG:teuthology.orchestra.run.trial030:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-17T05:36:02.505 INFO:tasks.workunit:Running workunit osd/osd-bench.sh... 2026-02-17T05:36:02.505 DEBUG:teuthology.orchestra.run.trial030:workunit test osd/osd-bench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=325850157d309f65985eea9ec9bb9f1d56726fee TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh 2026-02-17T05:36:02.559 INFO:tasks.workunit.client.0.trial030.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-17T05:36:02.562 INFO:tasks.workunit.client.0.trial030.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-17T05:36:02.562 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-17T05:36:02.562 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-17T05:36:02.562 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PYTHONWARNINGS=ignore 2026-02-17T05:36:02.562 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PYTHONWARNINGS=ignore 2026-02-17T05:36:02.562 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export CEPH_CONF=/dev/null 2026-02-17T05:36:02.562 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: CEPH_CONF=/dev/null 2026-02-17T05:36:02.562 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: unset CEPH_ARGS 2026-02-17T05:36:02.562 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2398: main: local code 2026-02-17T05:36:02.563 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: run td/osd-bench 2026-02-17T05:36:02.563 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:22: run: local dir=td/osd-bench 2026-02-17T05:36:02.563 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:23: run: shift 2026-02-17T05:36:02.563 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:25: run: export CEPH_MON=127.0.0.1:7106 2026-02-17T05:36:02.563 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:25: run: CEPH_MON=127.0.0.1:7106 2026-02-17T05:36:02.563 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:26: run: export CEPH_ARGS 2026-02-17T05:36:02.563 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:27: run: uuidgen 2026-02-17T05:36:02.564 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:27: run: CEPH_ARGS+='--fsid=3d796ceb-9146-4cc2-85b3-8119eaa43a9a --auth-supported=none ' 2026-02-17T05:36:02.564 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:28: run: CEPH_ARGS+='--mon-host=127.0.0.1:7106 ' 2026-02-17T05:36:02.564 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:29: run: CEPH_ARGS+='--debug-bluestore 20 ' 2026-02-17T05:36:02.564 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:31: run: set 2026-02-17T05:36:02.565 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:31: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-17T05:36:02.566 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:31: run: local funcs=TEST_bench 2026-02-17T05:36:02.567 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:32: run: for func in $funcs 2026-02-17T05:36:02.567 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:33: run: setup td/osd-bench 2026-02-17T05:36:02.567 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-bench 2026-02-17T05:36:02.567 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-bench 2026-02-17T05:36:02.567 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bench 2026-02-17T05:36:02.567 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T05:36:02.567 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bench KILL 2026-02-17T05:36:02.567 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:36:02.567 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:36:02.567 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:36:02.567 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:36:02.567 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:36:02.568 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:36:02.568 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T05:36:02.569 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T05:36:02.569 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T05:36:02.570 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T05:36:02.570 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T05:36:02.571 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T05:36:02.571 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:36:02.571 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T05:36:02.572 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T05:36:02.572 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:36:02.572 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T05:36:02.573 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T05:36:02.574 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bench 2026-02-17T05:36:02.574 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T05:36:02.574 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:36:02.575 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.85044 2026-02-17T05:36:02.575 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.85044 2026-02-17T05:36:02.576 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T05:36:02.576 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T05:36:02.576 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-bench 2026-02-17T05:36:02.578 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T05:36:02.578 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:36:02.578 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.85044 2026-02-17T05:36:02.578 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.85044 2026-02-17T05:36:02.579 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T05:36:02.580 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-17T05:36:02.580 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-17T05:36:02.580 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T05:36:02.580 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-bench 1' TERM HUP INT 2026-02-17T05:36:02.580 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:34: run: TEST_bench td/osd-bench 2026-02-17T05:36:02.580 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:40: TEST_bench: local dir=td/osd-bench 2026-02-17T05:36:02.580 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:42: TEST_bench: run_mon td/osd-bench a 2026-02-17T05:36:02.580 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-bench 2026-02-17T05:36:02.580 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T05:36:02.580 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T05:36:02.580 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T05:36:02.580 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-bench/a 2026-02-17T05:36:02.580 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-bench/a --run-dir=td/osd-bench 2026-02-17T05:36:02.605 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T05:36:02.605 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:36:02.605 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:36:02.605 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:36:02.605 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:36:02.605 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.85044 2026-02-17T05:36:02.606 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.85044/$cluster-$name.asok' 2026-02-17T05:36:02.606 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-bench/a '--log-file=td/osd-bench/$name.log' '--admin-socket=/tmp/ceph-asok.85044/$cluster-$name.asok' --mon-cluster-log-file=td/osd-bench/log --run-dir=td/osd-bench '--pid-file=td/osd-bench/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T05:36:02.636 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T05:36:02.637 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T05:36:02.637 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T05:36:02.637 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T05:36:02.637 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T05:36:02.638 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T05:36:02.638 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T05:36:02.639 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T05:36:02.639 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T05:36:02.639 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T05:36:02.639 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:36:02.639 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.85044 2026-02-17T05:36:02.639 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.85044/ceph-mon.a.asok 2026-02-17T05:36:02.639 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T05:36:02.639 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.85044/ceph-mon.a.asok config get fsid 2026-02-17T05:36:02.697 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T05:36:02.698 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T05:36:02.698 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T05:36:02.698 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T05:36:02.698 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T05:36:02.698 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T05:36:02.698 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T05:36:02.699 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T05:36:02.699 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T05:36:02.699 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:36:02.699 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.85044 2026-02-17T05:36:02.699 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.85044/ceph-mon.a.asok 2026-02-17T05:36:02.699 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T05:36:02.699 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.85044/ceph-mon.a.asok config get mon_host 2026-02-17T05:36:02.751 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:43: TEST_bench: run_mgr td/osd-bench x 2026-02-17T05:36:02.751 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-bench 2026-02-17T05:36:02.751 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T05:36:02.751 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T05:36:02.751 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T05:36:02.751 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-bench/x 2026-02-17T05:36:02.751 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T05:36:02.862 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T05:36:02.862 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:36:02.862 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:36:02.862 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:36:02.863 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:36:02.863 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.85044 2026-02-17T05:36:02.863 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.85044/$cluster-$name.asok' 2026-02-17T05:36:02.863 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T05:36:02.864 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-bench/x '--log-file=td/osd-bench/$name.log' '--admin-socket=/tmp/ceph-asok.85044/$cluster-$name.asok' --run-dir=td/osd-bench '--pid-file=td/osd-bench/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T05:36:02.882 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:44: TEST_bench: run_osd td/osd-bench 0 2026-02-17T05:36:02.882 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bench 2026-02-17T05:36:02.882 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T05:36:02.882 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T05:36:02.882 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T05:36:02.882 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bench/0 2026-02-17T05:36:02.882 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=3d796ceb-9146-4cc2-85b3-8119eaa43a9a --auth-supported=none --mon-host=127.0.0.1:7106 --debug-bluestore 20 ' 2026-02-17T05:36:02.882 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:36:02.882 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:36:02.882 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:36:02.882 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bench/0' 2026-02-17T05:36:02.882 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bench/0/journal' 2026-02-17T05:36:02.882 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T05:36:02.883 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T05:36:02.883 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bench' 2026-02-17T05:36:02.883 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T05:36:02.883 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:36:02.883 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:36:02.883 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:36:02.883 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:36:02.883 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.85044 2026-02-17T05:36:02.883 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.85044/$cluster-$name.asok' 2026-02-17T05:36:02.883 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.85044/$cluster-$name.asok' 2026-02-17T05:36:02.883 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:36:02.883 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T05:36:02.883 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T05:36:02.883 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bench/$name.log' 2026-02-17T05:36:02.883 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bench/$name.pid' 2026-02-17T05:36:02.884 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:36:02.884 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:36:02.884 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:36:02.884 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:36:02.884 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T05:36:02.884 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T05:36:02.884 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bench/0 2026-02-17T05:36:02.884 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T05:36:02.885 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=2cd76bbf-5195-4a2a-bb59-11be0b8ca0c4 2026-02-17T05:36:02.886 INFO:tasks.workunit.client.0.trial030.stdout:add osd0 2cd76bbf-5195-4a2a-bb59-11be0b8ca0c4 2026-02-17T05:36:02.886 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 2cd76bbf-5195-4a2a-bb59-11be0b8ca0c4' 2026-02-17T05:36:02.886 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T05:36:02.897 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBC/pNpX4tJNRAA2dHORHvWx8nTtk4LTHvJ2w== 2026-02-17T05:36:02.898 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBC/pNpX4tJNRAA2dHORHvWx8nTtk4LTHvJ2w=="}' 2026-02-17T05:36:02.898 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 2cd76bbf-5195-4a2a-bb59-11be0b8ca0c4 -i td/osd-bench/0/new.json 2026-02-17T05:36:03.009 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:36:03.017 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bench/0/new.json 2026-02-17T05:36:03.018 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=3d796ceb-9146-4cc2-85b3-8119eaa43a9a --auth-supported=none --mon-host=127.0.0.1:7106 --debug-bluestore 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bench/0 --osd-journal=td/osd-bench/0/journal --chdir= --run-dir=td/osd-bench '--admin-socket=/tmp/ceph-asok.85044/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bench/$name.log' '--pid-file=td/osd-bench/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBC/pNpX4tJNRAA2dHORHvWx8nTtk4LTHvJ2w== --osd-uuid 2cd76bbf-5195-4a2a-bb59-11be0b8ca0c4 2026-02-17T05:36:03.034 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:36:03.027+0000 7f817be5fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:36:03.035 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:36:03.027+0000 7f817be5fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:36:03.036 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:36:03.027+0000 7f817be5fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:36:03.036 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:36:03.027+0000 7f817be5fa40 -1 bdev(0x55ad0b462400 td/osd-bench/0/block) open stat got: (1) Operation not permitted 2026-02-17T05:36:03.037 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:36:03.027+0000 7f817be5fa40 -1 bluestore(td/osd-bench/0) _read_fsid unparsable uuid 2026-02-17T05:36:03.725 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bench/0/keyring 2026-02-17T05:36:03.725 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T05:36:03.727 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T05:36:03.727 INFO:tasks.workunit.client.0.trial030.stdout:adding osd0 key to auth repository 2026-02-17T05:36:03.727 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bench/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T05:36:03.839 INFO:tasks.workunit.client.0.trial030.stdout:start osd.0 2026-02-17T05:36:03.840 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T05:36:03.841 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=3d796ceb-9146-4cc2-85b3-8119eaa43a9a --auth-supported=none --mon-host=127.0.0.1:7106 --debug-bluestore 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bench/0 --osd-journal=td/osd-bench/0/journal --chdir= --run-dir=td/osd-bench '--admin-socket=/tmp/ceph-asok.85044/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bench/$name.log' '--pid-file=td/osd-bench/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T05:36:03.841 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T05:36:03.841 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T05:36:03.841 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T05:36:03.854 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:36:03.847+0000 7f6e6f6bba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:36:03.855 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:36:03.847+0000 7f6e6f6bba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:36:03.856 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:36:03.847+0000 7f6e6f6bba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:36:03.954 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T05:36:03.955 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:36:03.955 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T05:36:03.955 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:36:03.955 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:36:03.955 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:36:03.955 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:36:03.956 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:36:03.956 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:36:03.956 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T05:36:04.060 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:36:04.267 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:36:04.259+0000 7f6e6f6bba40 -1 Falling back to public interface 2026-02-17T05:36:04.963 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:36:04.955+0000 7f6e6f6bba40 -1 osd.0 0 log_to_monitors true 2026-02-17T05:36:05.062 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-17T05:36:05.062 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:36:05.062 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:36:05.062 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T05:36:05.063 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T05:36:05.065 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:36:05.207 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:36:06.208 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:36:06.209 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:36:06.209 INFO:tasks.workunit.client.0.trial030.stdout:2 2026-02-17T05:36:06.210 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T05:36:06.210 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:36:06.211 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T05:36:06.423 INFO:tasks.workunit.client.0.trial030.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2476207273,v1:127.0.0.1:6801/2476207273] [v2:127.0.0.1:6802/2476207273,v1:127.0.0.1:6803/2476207273] exists,up 2cd76bbf-5195-4a2a-bb59-11be0b8ca0c4 2026-02-17T05:36:06.424 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:36:06.424 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:36:06.424 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:36:06.424 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:47: TEST_bench: CEPH_ARGS= 2026-02-17T05:36:06.424 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:47: TEST_bench: ceph-conf --show-config-value osd_bench_small_size_max_iops 2026-02-17T05:36:06.433 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:47: TEST_bench: local osd_bench_small_size_max_iops=100 2026-02-17T05:36:06.434 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:49: TEST_bench: CEPH_ARGS= 2026-02-17T05:36:06.434 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:49: TEST_bench: ceph-conf --show-config-value osd_bench_large_size_max_throughput 2026-02-17T05:36:06.447 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:49: TEST_bench: local osd_bench_large_size_max_throughput=104857600 2026-02-17T05:36:06.448 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:51: TEST_bench: CEPH_ARGS= 2026-02-17T05:36:06.448 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:51: TEST_bench: ceph-conf --show-config-value osd_bench_max_block_size 2026-02-17T05:36:06.460 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:51: TEST_bench: local osd_bench_max_block_size=67108864 2026-02-17T05:36:06.461 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:53: TEST_bench: CEPH_ARGS= 2026-02-17T05:36:06.461 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:53: TEST_bench: ceph-conf --show-config-value osd_bench_duration 2026-02-17T05:36:06.471 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:53: TEST_bench: local osd_bench_duration=30 2026-02-17T05:36:06.471 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:58: TEST_bench: expect_failure td/osd-bench osd_bench_max_block_size ceph tell osd.0 bench 1024 67108865 2026-02-17T05:36:06.471 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2016: expect_failure: local dir=td/osd-bench 2026-02-17T05:36:06.471 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2017: expect_failure: shift 2026-02-17T05:36:06.471 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2018: expect_failure: local expected=osd_bench_max_block_size 2026-02-17T05:36:06.471 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2019: expect_failure: shift 2026-02-17T05:36:06.472 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2020: expect_failure: local success 2026-02-17T05:36:06.472 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2022: expect_failure: ceph tell osd.0 bench 1024 67108865 2026-02-17T05:36:06.567 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2025: expect_failure: success=false 2026-02-17T05:36:06.568 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: false 2026-02-17T05:36:06.568 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: grep --quiet osd_bench_max_block_size td/osd-bench/out 2026-02-17T05:36:06.569 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2032: expect_failure: return 0 2026-02-17T05:36:06.569 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:64: TEST_bench: local bsize=1024 2026-02-17T05:36:06.569 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:65: TEST_bench: local max_count=3072000 2026-02-17T05:36:06.569 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:66: TEST_bench: expect_failure td/osd-bench bench_small_size_max_iops ceph tell osd.0 bench 3072001 1024 2026-02-17T05:36:06.569 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2016: expect_failure: local dir=td/osd-bench 2026-02-17T05:36:06.569 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2017: expect_failure: shift 2026-02-17T05:36:06.569 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2018: expect_failure: local expected=bench_small_size_max_iops 2026-02-17T05:36:06.569 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2019: expect_failure: shift 2026-02-17T05:36:06.569 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2020: expect_failure: local success 2026-02-17T05:36:06.569 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2022: expect_failure: ceph tell osd.0 bench 3072001 1024 2026-02-17T05:36:06.640 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2025: expect_failure: success=false 2026-02-17T05:36:06.640 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: false 2026-02-17T05:36:06.640 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: grep --quiet bench_small_size_max_iops td/osd-bench/out 2026-02-17T05:36:06.642 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2032: expect_failure: return 0 2026-02-17T05:36:06.642 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:72: TEST_bench: local bsize=1048577 2026-02-17T05:36:06.642 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:73: TEST_bench: local max_count=3145728000 2026-02-17T05:36:06.642 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:74: TEST_bench: expect_failure td/osd-bench osd_bench_large_size_max_throughput ceph tell osd.0 bench 3145728001 1048577 2026-02-17T05:36:06.642 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2016: expect_failure: local dir=td/osd-bench 2026-02-17T05:36:06.642 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2017: expect_failure: shift 2026-02-17T05:36:06.642 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2018: expect_failure: local expected=osd_bench_large_size_max_throughput 2026-02-17T05:36:06.642 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2019: expect_failure: shift 2026-02-17T05:36:06.642 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2020: expect_failure: local success 2026-02-17T05:36:06.642 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2022: expect_failure: ceph tell osd.0 bench 3145728001 1048577 2026-02-17T05:36:06.715 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2025: expect_failure: success=false 2026-02-17T05:36:06.715 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: false 2026-02-17T05:36:06.715 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: grep --quiet osd_bench_large_size_max_throughput td/osd-bench/out 2026-02-17T05:36:06.716 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2032: expect_failure: return 0 2026-02-17T05:36:06.716 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:80: TEST_bench: ceph tell osd.0 bench 2026-02-17T05:36:08.385 INFO:tasks.workunit.client.0.trial030.stdout:{ 2026-02-17T05:36:08.385 INFO:tasks.workunit.client.0.trial030.stdout: "bytes_written": 1073741824, 2026-02-17T05:36:08.385 INFO:tasks.workunit.client.0.trial030.stdout: "blocksize": 4194304, 2026-02-17T05:36:08.385 INFO:tasks.workunit.client.0.trial030.stdout: "elapsed_sec": 0.74908272099999995, 2026-02-17T05:36:08.385 INFO:tasks.workunit.client.0.trial030.stdout: "bytes_per_sec": 1433408879.8184948, 2026-02-17T05:36:08.385 INFO:tasks.workunit.client.0.trial030.stdout: "iops": 341.7513083978879 2026-02-17T05:36:08.385 INFO:tasks.workunit.client.0.trial030.stdout:} 2026-02-17T05:36:08.398 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:84: TEST_bench: ceph tell osd.0 bench 10 14456 4444 3 2026-02-17T05:36:08.469 INFO:tasks.workunit.client.0.trial030.stdout:{ 2026-02-17T05:36:08.469 INFO:tasks.workunit.client.0.trial030.stdout: "bytes_written": 10, 2026-02-17T05:36:08.469 INFO:tasks.workunit.client.0.trial030.stdout: "blocksize": 14456, 2026-02-17T05:36:08.470 INFO:tasks.workunit.client.0.trial030.stdout: "elapsed_sec": 0.00035929400000000002, 2026-02-17T05:36:08.470 INFO:tasks.workunit.client.0.trial030.stdout: "bytes_per_sec": 27832.360128474174, 2026-02-17T05:36:08.470 INFO:tasks.workunit.client.0.trial030.stdout: "iops": 1.9253154488429838 2026-02-17T05:36:08.470 INFO:tasks.workunit.client.0.trial030.stdout:} 2026-02-17T05:36:08.476 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:90: TEST_bench: ceph tell osd.0 bench 1 14456 2026-02-17T05:36:08.557 INFO:tasks.workunit.client.0.trial030.stdout:{ 2026-02-17T05:36:08.557 INFO:tasks.workunit.client.0.trial030.stdout: "bytes_written": 1, 2026-02-17T05:36:08.557 INFO:tasks.workunit.client.0.trial030.stdout: "blocksize": 14456, 2026-02-17T05:36:08.557 INFO:tasks.workunit.client.0.trial030.stdout: "elapsed_sec": 0.000237469, 2026-02-17T05:36:08.557 INFO:tasks.workunit.client.0.trial030.stdout: "bytes_per_sec": 4211.0759720216111, 2026-02-17T05:36:08.557 INFO:tasks.workunit.client.0.trial030.stdout: "iops": 0.29130298644311087 2026-02-17T05:36:08.557 INFO:tasks.workunit.client.0.trial030.stdout:} 2026-02-17T05:36:08.564 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:35: run: teardown td/osd-bench 2026-02-17T05:36:08.564 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bench 2026-02-17T05:36:08.564 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T05:36:08.564 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bench KILL 2026-02-17T05:36:08.564 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:36:08.564 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:36:08.564 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:36:08.564 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:36:08.564 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:36:08.673 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:36:08.673 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T05:36:08.674 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T05:36:08.674 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T05:36:08.675 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T05:36:08.675 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T05:36:08.676 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T05:36:08.677 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:36:08.677 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T05:36:08.677 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T05:36:08.678 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:36:08.679 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T05:36:08.679 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T05:36:08.679 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bench 2026-02-17T05:36:08.714 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T05:36:08.714 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:36:08.714 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.85044 2026-02-17T05:36:08.714 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.85044 2026-02-17T05:36:08.715 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T05:36:08.715 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T05:36:08.715 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: code=0 2026-02-17T05:36:08.715 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2404: main: teardown td/osd-bench 0 2026-02-17T05:36:08.715 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bench 2026-02-17T05:36:08.715 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-17T05:36:08.715 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bench KILL 2026-02-17T05:36:08.716 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:36:08.716 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:36:08.716 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:36:08.716 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:36:08.716 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:36:08.718 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:36:08.718 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T05:36:08.719 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T05:36:08.719 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T05:36:08.720 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T05:36:08.720 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T05:36:08.721 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T05:36:08.722 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:36:08.722 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T05:36:08.722 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T05:36:08.722 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:36:08.723 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T05:36:08.725 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-17T05:36:08.725 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bench 2026-02-17T05:36:08.726 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T05:36:08.726 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:36:08.726 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.85044 2026-02-17T05:36:08.726 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.85044 2026-02-17T05:36:08.727 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T05:36:08.727 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T05:36:08.727 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: return 0 2026-02-17T05:36:08.728 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-17T05:36:08.728 DEBUG:teuthology.orchestra.run.trial030:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-17T05:36:08.777 INFO:tasks.workunit:Running workunit osd/osd-bluefs-volume-ops.sh... 2026-02-17T05:36:08.777 DEBUG:teuthology.orchestra.run.trial030:workunit test osd/osd-bluefs-volume-ops.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=325850157d309f65985eea9ec9bb9f1d56726fee TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh 2026-02-17T05:36:08.827 INFO:tasks.workunit.client.0.trial030.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-17T05:36:08.831 INFO:tasks.workunit.client.0.trial030.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-17T05:36:08.831 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-17T05:36:08.831 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-17T05:36:08.831 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PYTHONWARNINGS=ignore 2026-02-17T05:36:08.831 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PYTHONWARNINGS=ignore 2026-02-17T05:36:08.831 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export CEPH_CONF=/dev/null 2026-02-17T05:36:08.831 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: CEPH_CONF=/dev/null 2026-02-17T05:36:08.831 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: unset CEPH_ARGS 2026-02-17T05:36:08.831 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2398: main: local code 2026-02-17T05:36:08.831 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: run td/osd-bluefs-volume-ops 2026-02-17T05:36:08.832 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:8: run: local dir=td/osd-bluefs-volume-ops 2026-02-17T05:36:08.832 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:9: run: shift 2026-02-17T05:36:08.832 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:11: run: set 2026-02-17T05:36:08.832 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:11: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-17T05:36:08.834 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:11: run: local 'funcs=TEST_bluestore 2026-02-17T05:36:08.834 INFO:tasks.workunit.client.0.trial030.stderr:TEST_bluestore2 2026-02-17T05:36:08.834 INFO:tasks.workunit.client.0.trial030.stderr:TEST_bluestore_expand' 2026-02-17T05:36:08.834 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:12: run: for func in $funcs 2026-02-17T05:36:08.834 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:13: run: setup td/osd-bluefs-volume-ops 2026-02-17T05:36:08.834 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-bluefs-volume-ops 2026-02-17T05:36:08.834 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-bluefs-volume-ops 2026-02-17T05:36:08.834 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bluefs-volume-ops 2026-02-17T05:36:08.834 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T05:36:08.834 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bluefs-volume-ops KILL 2026-02-17T05:36:08.834 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:36:08.834 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:36:08.834 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:36:08.834 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:36:08.834 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:36:08.836 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:36:08.836 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T05:36:08.837 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T05:36:08.837 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T05:36:08.838 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T05:36:08.839 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T05:36:08.839 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T05:36:08.839 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:36:08.839 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T05:36:08.840 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T05:36:08.840 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:36:08.841 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T05:36:08.842 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T05:36:08.842 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bluefs-volume-ops 2026-02-17T05:36:08.843 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T05:36:08.843 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:36:08.843 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.86949 2026-02-17T05:36:08.844 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.86949 2026-02-17T05:36:08.844 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T05:36:08.844 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T05:36:08.844 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-bluefs-volume-ops 2026-02-17T05:36:08.846 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T05:36:08.846 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:36:08.846 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.86949 2026-02-17T05:36:08.846 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.86949 2026-02-17T05:36:08.847 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T05:36:08.848 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-17T05:36:08.848 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-17T05:36:08.848 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T05:36:08.848 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-bluefs-volume-ops 1' TERM HUP INT 2026-02-17T05:36:08.848 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:14: run: TEST_bluestore td/osd-bluefs-volume-ops 2026-02-17T05:36:08.848 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:20: TEST_bluestore: local dir=td/osd-bluefs-volume-ops 2026-02-17T05:36:08.848 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:22: TEST_bluestore: ulimit -n 2026-02-17T05:36:08.848 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:22: TEST_bluestore: local flimit=4096 2026-02-17T05:36:08.848 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:23: TEST_bluestore: '[' 4096 -lt 1536 ']' 2026-02-17T05:36:08.848 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:26: TEST_bluestore: export CEPH_MON=127.0.0.1:7146 2026-02-17T05:36:08.848 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:26: TEST_bluestore: CEPH_MON=127.0.0.1:7146 2026-02-17T05:36:08.848 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:27: TEST_bluestore: export CEPH_ARGS 2026-02-17T05:36:08.849 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:28: TEST_bluestore: uuidgen 2026-02-17T05:36:08.850 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:28: TEST_bluestore: CEPH_ARGS+='--fsid=d4c610c5-b68b-4a55-8ef5-4338f716f684 --auth-supported=none ' 2026-02-17T05:36:08.850 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:29: TEST_bluestore: CEPH_ARGS+='--mon-host=127.0.0.1:7146 ' 2026-02-17T05:36:08.850 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:30: TEST_bluestore: CEPH_ARGS+='--bluestore_block_size=2147483648 ' 2026-02-17T05:36:08.850 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:31: TEST_bluestore: CEPH_ARGS+='--bluestore_block_db_create=true ' 2026-02-17T05:36:08.850 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:32: TEST_bluestore: CEPH_ARGS+='--bluestore_block_db_size=1073741824 ' 2026-02-17T05:36:08.850 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:33: TEST_bluestore: CEPH_ARGS+='--bluestore_block_wal_size=536870912 ' 2026-02-17T05:36:08.850 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:34: TEST_bluestore: CEPH_ARGS+='--bluestore_block_wal_create=true ' 2026-02-17T05:36:08.850 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:35: TEST_bluestore: CEPH_ARGS+='--bluestore_fsck_on_mount=true ' 2026-02-17T05:36:08.850 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:37: TEST_bluestore: CEPH_ARGS+='--bluestore_allocation_from_file=0 ' 2026-02-17T05:36:08.850 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:39: TEST_bluestore: run_mon td/osd-bluefs-volume-ops a 2026-02-17T05:36:08.850 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-bluefs-volume-ops 2026-02-17T05:36:08.850 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T05:36:08.850 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T05:36:08.850 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T05:36:08.850 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-bluefs-volume-ops/a 2026-02-17T05:36:08.850 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-bluefs-volume-ops/a --run-dir=td/osd-bluefs-volume-ops 2026-02-17T05:36:08.874 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T05:36:08.874 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:36:08.874 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:36:08.875 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:36:08.875 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:36:08.875 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.86949 2026-02-17T05:36:08.875 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.86949/$cluster-$name.asok' 2026-02-17T05:36:08.875 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-bluefs-volume-ops/a '--log-file=td/osd-bluefs-volume-ops/$name.log' '--admin-socket=/tmp/ceph-asok.86949/$cluster-$name.asok' --mon-cluster-log-file=td/osd-bluefs-volume-ops/log --run-dir=td/osd-bluefs-volume-ops '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T05:36:08.906 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T05:36:08.907 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T05:36:08.907 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T05:36:08.907 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T05:36:08.907 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T05:36:08.907 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T05:36:08.908 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T05:36:08.908 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T05:36:08.908 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T05:36:08.908 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T05:36:08.908 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:36:08.908 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.86949 2026-02-17T05:36:08.908 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.86949/ceph-mon.a.asok 2026-02-17T05:36:08.909 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T05:36:08.909 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.86949/ceph-mon.a.asok config get fsid 2026-02-17T05:36:08.964 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T05:36:08.965 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T05:36:08.965 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T05:36:08.965 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T05:36:08.965 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T05:36:08.965 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T05:36:08.965 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T05:36:08.965 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T05:36:08.965 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T05:36:08.965 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:36:08.965 INFO:tasks.workunit.client.0.trial030.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.86949 2026-02-17T05:36:08.965 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.86949/ceph-mon.a.asok 2026-02-17T05:36:08.966 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T05:36:08.966 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.86949/ceph-mon.a.asok config get mon_host 2026-02-17T05:36:09.020 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:40: TEST_bluestore: run_mgr td/osd-bluefs-volume-ops x 2026-02-17T05:36:09.020 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-bluefs-volume-ops 2026-02-17T05:36:09.020 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T05:36:09.020 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T05:36:09.020 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T05:36:09.020 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-bluefs-volume-ops/x 2026-02-17T05:36:09.020 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T05:36:09.128 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T05:36:09.128 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:36:09.128 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:36:09.129 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:36:09.129 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:36:09.129 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.86949 2026-02-17T05:36:09.129 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.86949/$cluster-$name.asok' 2026-02-17T05:36:09.129 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T05:36:09.130 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-bluefs-volume-ops/x '--log-file=td/osd-bluefs-volume-ops/$name.log' '--admin-socket=/tmp/ceph-asok.86949/$cluster-$name.asok' --run-dir=td/osd-bluefs-volume-ops '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T05:36:09.148 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:41: TEST_bluestore: run_osd td/osd-bluefs-volume-ops 0 2026-02-17T05:36:09.148 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-17T05:36:09.148 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T05:36:09.148 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T05:36:09.148 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T05:36:09.148 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-17T05:36:09.148 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4c610c5-b68b-4a55-8ef5-4338f716f684 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-17T05:36:09.148 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:36:09.148 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:36:09.148 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:36:09.148 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-17T05:36:09.148 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-17T05:36:09.148 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T05:36:09.148 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T05:36:09.148 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-17T05:36:09.148 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T05:36:09.148 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:36:09.148 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:36:09.148 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:36:09.149 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:36:09.149 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.86949 2026-02-17T05:36:09.149 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.86949/$cluster-$name.asok' 2026-02-17T05:36:09.149 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.86949/$cluster-$name.asok' 2026-02-17T05:36:09.149 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:36:09.149 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T05:36:09.149 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T05:36:09.149 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-17T05:36:09.149 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-17T05:36:09.149 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:36:09.149 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:36:09.149 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:36:09.149 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:36:09.149 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T05:36:09.149 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T05:36:09.149 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-17T05:36:09.150 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T05:36:09.151 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=b7ec43e4-8dcd-4db1-b9f0-5f0a894a9832 2026-02-17T05:36:09.151 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 b7ec43e4-8dcd-4db1-b9f0-5f0a894a9832' 2026-02-17T05:36:09.151 INFO:tasks.workunit.client.0.trial030.stdout:add osd0 b7ec43e4-8dcd-4db1-b9f0-5f0a894a9832 2026-02-17T05:36:09.151 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T05:36:09.161 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBJ/pNpwkNmCRAAo2SUxEt1/TYq3dsQVUdD3g== 2026-02-17T05:36:09.161 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBJ/pNpwkNmCRAAo2SUxEt1/TYq3dsQVUdD3g=="}' 2026-02-17T05:36:09.161 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new b7ec43e4-8dcd-4db1-b9f0-5f0a894a9832 -i td/osd-bluefs-volume-ops/0/new.json 2026-02-17T05:36:09.276 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:36:09.284 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bluefs-volume-ops/0/new.json 2026-02-17T05:36:09.285 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=d4c610c5-b68b-4a55-8ef5-4338f716f684 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.86949/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBJ/pNpwkNmCRAAo2SUxEt1/TYq3dsQVUdD3g== --osd-uuid b7ec43e4-8dcd-4db1-b9f0-5f0a894a9832 2026-02-17T05:36:09.300 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:36:09.291+0000 7fa30ebeba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:36:09.301 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:36:09.295+0000 7fa30ebeba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:36:09.302 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:36:09.295+0000 7fa30ebeba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:36:09.303 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:36:09.295+0000 7fa30ebeba40 -1 bdev(0x555e9f3f6400 td/osd-bluefs-volume-ops/0/block) open stat got: (1) Operation not permitted 2026-02-17T05:36:09.303 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:36:09.295+0000 7fa30ebeba40 -1 bluestore(td/osd-bluefs-volume-ops/0) _read_fsid unparsable uuid 2026-02-17T05:36:11.401 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bluefs-volume-ops/0/keyring 2026-02-17T05:36:11.401 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T05:36:11.402 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T05:36:11.402 INFO:tasks.workunit.client.0.trial030.stdout:adding osd0 key to auth repository 2026-02-17T05:36:11.402 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bluefs-volume-ops/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T05:36:11.513 INFO:tasks.workunit.client.0.trial030.stdout:start osd.0 2026-02-17T05:36:11.514 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T05:36:11.514 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=d4c610c5-b68b-4a55-8ef5-4338f716f684 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.86949/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T05:36:11.514 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T05:36:11.514 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T05:36:11.514 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T05:36:11.536 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:36:11.527+0000 7f81b2f8ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:36:11.538 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:36:11.531+0000 7f81b2f8ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:36:11.539 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:36:11.531+0000 7f81b2f8ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:36:11.736 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T05:36:11.736 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:36:11.737 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T05:36:11.737 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:36:11.737 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:36:11.737 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:36:11.737 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:36:11.738 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:36:11.738 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:36:11.738 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T05:36:11.955 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:36:12.015 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:36:12.006+0000 7f81b2f8ca40 -1 Falling back to public interface 2026-02-17T05:36:12.956 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:36:12.956 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:36:12.956 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-17T05:36:12.957 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T05:36:12.957 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:36:12.957 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T05:36:13.140 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:36:13.130+0000 7f81b2f8ca40 -1 osd.0 0 log_to_monitors true 2026-02-17T05:36:13.163 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:36:14.165 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:36:14.165 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:36:14.166 INFO:tasks.workunit.client.0.trial030.stdout:2 2026-02-17T05:36:14.166 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T05:36:14.166 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:36:14.167 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T05:36:14.375 INFO:tasks.workunit.client.0.trial030.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/3779226260,v1:127.0.0.1:6803/3779226260] [v2:127.0.0.1:6804/3779226260,v1:127.0.0.1:6805/3779226260] exists,up b7ec43e4-8dcd-4db1-b9f0-5f0a894a9832 2026-02-17T05:36:14.375 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:36:14.376 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:36:14.376 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:36:14.376 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:42: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-17T05:36:14.379 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:42: TEST_bluestore: osd_pid0=88425 2026-02-17T05:36:14.380 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:43: TEST_bluestore: run_osd td/osd-bluefs-volume-ops 1 2026-02-17T05:36:14.380 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-17T05:36:14.380 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T05:36:14.380 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-17T05:36:14.380 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T05:36:14.380 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bluefs-volume-ops/1 2026-02-17T05:36:14.380 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4c610c5-b68b-4a55-8ef5-4338f716f684 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-17T05:36:14.380 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:36:14.380 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:36:14.380 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:36:14.381 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/1' 2026-02-17T05:36:14.381 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/1/journal' 2026-02-17T05:36:14.381 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T05:36:14.381 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T05:36:14.381 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-17T05:36:14.381 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T05:36:14.381 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:36:14.381 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:36:14.381 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:36:14.381 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:36:14.382 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.86949 2026-02-17T05:36:14.382 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.86949/$cluster-$name.asok' 2026-02-17T05:36:14.382 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.86949/$cluster-$name.asok' 2026-02-17T05:36:14.382 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:36:14.382 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T05:36:14.382 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T05:36:14.382 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-17T05:36:14.382 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-17T05:36:14.382 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:36:14.382 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:36:14.382 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:36:14.382 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:36:14.383 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T05:36:14.383 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T05:36:14.383 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bluefs-volume-ops/1 2026-02-17T05:36:14.383 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T05:36:14.383 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=db4eaa94-0f49-40ed-b586-d7fb25151ceb 2026-02-17T05:36:14.384 INFO:tasks.workunit.client.0.trial030.stdout:add osd1 db4eaa94-0f49-40ed-b586-d7fb25151ceb 2026-02-17T05:36:14.384 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 db4eaa94-0f49-40ed-b586-d7fb25151ceb' 2026-02-17T05:36:14.384 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T05:36:14.392 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBO/pNpyNwcFxAAcYKckUwnCvj9uGHjFJksOg== 2026-02-17T05:36:14.393 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBO/pNpyNwcFxAAcYKckUwnCvj9uGHjFJksOg=="}' 2026-02-17T05:36:14.393 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new db4eaa94-0f49-40ed-b586-d7fb25151ceb -i td/osd-bluefs-volume-ops/1/new.json 2026-02-17T05:36:14.619 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-17T05:36:14.628 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bluefs-volume-ops/1/new.json 2026-02-17T05:36:14.629 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=d4c610c5-b68b-4a55-8ef5-4338f716f684 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/1 --osd-journal=td/osd-bluefs-volume-ops/1/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.86949/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBO/pNpyNwcFxAAcYKckUwnCvj9uGHjFJksOg== --osd-uuid db4eaa94-0f49-40ed-b586-d7fb25151ceb 2026-02-17T05:36:14.646 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:36:14.638+0000 7f567ecffa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:36:14.647 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:36:14.638+0000 7f567ecffa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:36:14.648 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:36:14.638+0000 7f567ecffa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:36:14.649 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:36:14.638+0000 7f567ecffa40 -1 bdev(0x5630f871e400 td/osd-bluefs-volume-ops/1/block) open stat got: (1) Operation not permitted 2026-02-17T05:36:14.649 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:36:14.638+0000 7f567ecffa40 -1 bluestore(td/osd-bluefs-volume-ops/1) _read_fsid unparsable uuid 2026-02-17T05:36:16.070 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bluefs-volume-ops/1/keyring 2026-02-17T05:36:16.071 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T05:36:16.072 INFO:tasks.workunit.client.0.trial030.stdout:adding osd1 key to auth repository 2026-02-17T05:36:16.072 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-17T05:36:16.072 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bluefs-volume-ops/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T05:36:16.371 INFO:tasks.workunit.client.0.trial030.stdout:start osd.1 2026-02-17T05:36:16.372 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-17T05:36:16.372 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=d4c610c5-b68b-4a55-8ef5-4338f716f684 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/1 --osd-journal=td/osd-bluefs-volume-ops/1/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.86949/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T05:36:16.372 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T05:36:16.372 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T05:36:16.372 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T05:36:16.393 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:36:16.382+0000 7fb0e1f0ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:36:16.395 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:36:16.386+0000 7fb0e1f0ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:36:16.396 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:36:16.386+0000 7fb0e1f0ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:36:16.586 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-17T05:36:16.586 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:36:16.586 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T05:36:16.586 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:36:16.587 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:36:16.587 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:36:16.587 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:36:16.588 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:36:16.589 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:36:16.589 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T05:36:16.795 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:36:16.843 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:36:16.834+0000 7fb0e1f0ba40 -1 Falling back to public interface 2026-02-17T05:36:17.797 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:36:17.797 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:36:17.797 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T05:36:17.798 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-17T05:36:17.798 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:36:17.798 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T05:36:17.995 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:36:17.986+0000 7fb0e1f0ba40 -1 osd.1 0 log_to_monitors true 2026-02-17T05:36:18.012 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:36:19.013 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:36:19.013 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:36:19.013 INFO:tasks.workunit.client.0.trial030.stdout:2 2026-02-17T05:36:19.013 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T05:36:19.014 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:36:19.014 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T05:36:19.229 INFO:tasks.workunit.client.0.trial030.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1692474465,v1:127.0.0.1:6811/1692474465] [v2:127.0.0.1:6812/1692474465,v1:127.0.0.1:6813/1692474465] exists,up db4eaa94-0f49-40ed-b586-d7fb25151ceb 2026-02-17T05:36:19.230 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:36:19.230 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:36:19.231 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:36:19.231 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:44: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.1.pid 2026-02-17T05:36:19.235 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:44: TEST_bluestore: osd_pid1=90572 2026-02-17T05:36:19.235 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:45: TEST_bluestore: run_osd td/osd-bluefs-volume-ops 2 2026-02-17T05:36:19.235 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-17T05:36:19.235 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T05:36:19.235 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-17T05:36:19.235 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T05:36:19.235 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bluefs-volume-ops/2 2026-02-17T05:36:19.236 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4c610c5-b68b-4a55-8ef5-4338f716f684 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-17T05:36:19.236 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:36:19.236 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:36:19.236 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:36:19.236 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/2' 2026-02-17T05:36:19.236 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/2/journal' 2026-02-17T05:36:19.236 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T05:36:19.236 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T05:36:19.236 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-17T05:36:19.236 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T05:36:19.237 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:36:19.237 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:36:19.237 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:36:19.237 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:36:19.237 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.86949 2026-02-17T05:36:19.237 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.86949/$cluster-$name.asok' 2026-02-17T05:36:19.237 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.86949/$cluster-$name.asok' 2026-02-17T05:36:19.237 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:36:19.237 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T05:36:19.237 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T05:36:19.237 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-17T05:36:19.237 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-17T05:36:19.238 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:36:19.238 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:36:19.238 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:36:19.238 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:36:19.238 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T05:36:19.238 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T05:36:19.238 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bluefs-volume-ops/2 2026-02-17T05:36:19.238 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T05:36:19.239 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=b39c2b07-236f-4354-8e4c-d32939e98ab8 2026-02-17T05:36:19.239 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 b39c2b07-236f-4354-8e4c-d32939e98ab8' 2026-02-17T05:36:19.239 INFO:tasks.workunit.client.0.trial030.stdout:add osd2 b39c2b07-236f-4354-8e4c-d32939e98ab8 2026-02-17T05:36:19.240 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T05:36:19.248 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBT/pNpY6SKDhAAOeE4HTU3+6j9CtvMistjqQ== 2026-02-17T05:36:19.248 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBT/pNpY6SKDhAAOeE4HTU3+6j9CtvMistjqQ=="}' 2026-02-17T05:36:19.248 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new b39c2b07-236f-4354-8e4c-d32939e98ab8 -i td/osd-bluefs-volume-ops/2/new.json 2026-02-17T05:36:19.470 INFO:tasks.workunit.client.0.trial030.stdout:2 2026-02-17T05:36:19.479 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bluefs-volume-ops/2/new.json 2026-02-17T05:36:19.480 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=d4c610c5-b68b-4a55-8ef5-4338f716f684 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/2 --osd-journal=td/osd-bluefs-volume-ops/2/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.86949/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBT/pNpY6SKDhAAOeE4HTU3+6j9CtvMistjqQ== --osd-uuid b39c2b07-236f-4354-8e4c-d32939e98ab8 2026-02-17T05:36:19.495 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:36:19.486+0000 7f09add2da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:36:19.497 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:36:19.486+0000 7f09add2da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:36:19.498 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:36:19.490+0000 7f09add2da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:36:19.498 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:36:19.490+0000 7f09add2da40 -1 bdev(0x55986a502400 td/osd-bluefs-volume-ops/2/block) open stat got: (1) Operation not permitted 2026-02-17T05:36:19.498 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:36:19.490+0000 7f09add2da40 -1 bluestore(td/osd-bluefs-volume-ops/2) _read_fsid unparsable uuid 2026-02-17T05:36:20.885 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bluefs-volume-ops/2/keyring 2026-02-17T05:36:20.885 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T05:36:20.886 INFO:tasks.workunit.client.0.trial030.stdout:adding osd2 key to auth repository 2026-02-17T05:36:20.886 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-17T05:36:20.886 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bluefs-volume-ops/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T05:36:21.188 INFO:tasks.workunit.client.0.trial030.stdout:start osd.2 2026-02-17T05:36:21.188 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-17T05:36:21.188 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=d4c610c5-b68b-4a55-8ef5-4338f716f684 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/2 --osd-journal=td/osd-bluefs-volume-ops/2/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.86949/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T05:36:21.188 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T05:36:21.188 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T05:36:21.188 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T05:36:21.203 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:36:21.194+0000 7f1e99bd7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:36:21.204 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:36:21.194+0000 7f1e99bd7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:36:21.205 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:36:21.198+0000 7f1e99bd7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:36:21.398 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-17T05:36:21.398 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:36:21.399 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T05:36:21.399 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:36:21.399 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:36:21.399 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:36:21.399 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:36:21.399 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:36:21.399 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:36:21.399 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T05:36:21.614 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:36:21.755 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:36:21.746+0000 7f1e99bd7a40 -1 Falling back to public interface 2026-02-17T05:36:22.615 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:36:22.615 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:36:22.615 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-17T05:36:22.615 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T05:36:22.615 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:36:22.615 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T05:36:22.824 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:36:22.993 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:36:22.982+0000 7f1e99bd7a40 -1 osd.2 0 log_to_monitors true 2026-02-17T05:36:23.826 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:36:23.826 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:36:23.826 INFO:tasks.workunit.client.0.trial030.stdout:2 2026-02-17T05:36:23.827 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T05:36:23.827 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:36:23.827 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T05:36:24.034 INFO:tasks.workunit.client.0.trial030.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/282269851,v1:127.0.0.1:6819/282269851] [v2:127.0.0.1:6820/282269851,v1:127.0.0.1:6821/282269851] exists,up b39c2b07-236f-4354-8e4c-d32939e98ab8 2026-02-17T05:36:24.034 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:36:24.035 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:36:24.035 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:36:24.035 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:46: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.2.pid 2026-02-17T05:36:24.037 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:46: TEST_bluestore: osd_pid2=92764 2026-02-17T05:36:24.037 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:47: TEST_bluestore: run_osd td/osd-bluefs-volume-ops 3 2026-02-17T05:36:24.037 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-17T05:36:24.037 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T05:36:24.037 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-17T05:36:24.037 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T05:36:24.037 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bluefs-volume-ops/3 2026-02-17T05:36:24.037 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4c610c5-b68b-4a55-8ef5-4338f716f684 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-17T05:36:24.037 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:36:24.037 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:36:24.037 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:36:24.037 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/3' 2026-02-17T05:36:24.037 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/3/journal' 2026-02-17T05:36:24.038 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T05:36:24.038 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T05:36:24.038 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-17T05:36:24.038 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T05:36:24.038 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:36:24.038 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:36:24.039 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:36:24.039 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:36:24.039 INFO:tasks.workunit.client.0.trial030.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.86949 2026-02-17T05:36:24.039 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.86949/$cluster-$name.asok' 2026-02-17T05:36:24.039 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.86949/$cluster-$name.asok' 2026-02-17T05:36:24.039 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:36:24.039 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T05:36:24.040 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T05:36:24.040 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-17T05:36:24.040 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-17T05:36:24.040 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:36:24.040 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:36:24.040 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:36:24.040 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:36:24.040 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T05:36:24.040 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T05:36:24.040 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bluefs-volume-ops/3 2026-02-17T05:36:24.040 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T05:36:24.041 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=db7f6288-20ab-4807-b627-533372dc082d 2026-02-17T05:36:24.041 INFO:tasks.workunit.client.0.trial030.stdout:add osd3 db7f6288-20ab-4807-b627-533372dc082d 2026-02-17T05:36:24.041 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 db7f6288-20ab-4807-b627-533372dc082d' 2026-02-17T05:36:24.041 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T05:36:24.052 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBY/pNpjE3iAhAAwd0RruleocJ1VWOIeT/eGA== 2026-02-17T05:36:24.053 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBY/pNpjE3iAhAAwd0RruleocJ1VWOIeT/eGA=="}' 2026-02-17T05:36:24.053 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new db7f6288-20ab-4807-b627-533372dc082d -i td/osd-bluefs-volume-ops/3/new.json 2026-02-17T05:36:24.269 INFO:tasks.workunit.client.0.trial030.stdout:3 2026-02-17T05:36:24.279 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bluefs-volume-ops/3/new.json 2026-02-17T05:36:24.280 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=d4c610c5-b68b-4a55-8ef5-4338f716f684 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/3 --osd-journal=td/osd-bluefs-volume-ops/3/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.86949/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBY/pNpjE3iAhAAwd0RruleocJ1VWOIeT/eGA== --osd-uuid db7f6288-20ab-4807-b627-533372dc082d 2026-02-17T05:36:24.295 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:36:24.286+0000 7f1993d36a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:36:24.296 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:36:24.286+0000 7f1993d36a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:36:24.298 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:36:24.290+0000 7f1993d36a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:36:24.298 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:36:24.290+0000 7f1993d36a40 -1 bdev(0x5622eb396400 td/osd-bluefs-volume-ops/3/block) open stat got: (1) Operation not permitted 2026-02-17T05:36:24.298 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:36:24.290+0000 7f1993d36a40 -1 bluestore(td/osd-bluefs-volume-ops/3) _read_fsid unparsable uuid 2026-02-17T05:36:25.747 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bluefs-volume-ops/3/keyring 2026-02-17T05:36:25.747 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T05:36:25.748 INFO:tasks.workunit.client.0.trial030.stdout:adding osd3 key to auth repository 2026-02-17T05:36:25.749 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-17T05:36:25.749 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bluefs-volume-ops/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T05:36:26.040 INFO:tasks.workunit.client.0.trial030.stdout:start osd.3 2026-02-17T05:36:26.041 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-17T05:36:26.042 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=d4c610c5-b68b-4a55-8ef5-4338f716f684 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/3 --osd-journal=td/osd-bluefs-volume-ops/3/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.86949/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T05:36:26.042 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T05:36:26.042 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T05:36:26.042 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T05:36:26.063 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:36:26.054+0000 7f43055b6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:36:26.065 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:36:26.054+0000 7f43055b6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:36:26.066 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:36:26.058+0000 7f43055b6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:36:26.255 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-17T05:36:26.255 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:36:26.255 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-17T05:36:26.255 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:36:26.255 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:36:26.255 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:36:26.255 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:36:26.255 INFO:tasks.workunit.client.0.trial030.stdout:0 2026-02-17T05:36:26.255 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:36:26.255 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T05:36:26.470 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:36:26.519 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:36:26.510+0000 7f43055b6a40 -1 Falling back to public interface 2026-02-17T05:36:27.471 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:36:27.471 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:36:27.472 INFO:tasks.workunit.client.0.trial030.stdout:1 2026-02-17T05:36:27.472 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T05:36:27.473 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:36:27.473 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T05:36:27.674 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:36:27.666+0000 7f43055b6a40 -1 osd.3 0 log_to_monitors true 2026-02-17T05:36:27.683 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:36:28.684 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:36:28.685 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:36:28.685 INFO:tasks.workunit.client.0.trial030.stdout:2 2026-02-17T05:36:28.686 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T05:36:28.686 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:36:28.686 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T05:36:28.898 INFO:tasks.workunit.client.0.trial030.stdout:osd.3 up in weight 1 up_from 19 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/991626873,v1:127.0.0.1:6827/991626873] [v2:127.0.0.1:6828/991626873,v1:127.0.0.1:6829/991626873] exists,up db7f6288-20ab-4807-b627-533372dc082d 2026-02-17T05:36:28.898 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:36:28.898 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:36:28.898 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:36:28.898 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:48: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.3.pid 2026-02-17T05:36:28.900 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:48: TEST_bluestore: osd_pid3=94922 2026-02-17T05:36:28.900 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:50: TEST_bluestore: sleep 5 2026-02-17T05:36:33.902 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:52: TEST_bluestore: create_pool foo 16 2026-02-17T05:36:33.902 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create foo 16 2026-02-17T05:36:34.159 INFO:tasks.workunit.client.0.trial030.stderr:pool 'foo' already exists 2026-02-17T05:36:34.169 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T05:36:35.170 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:55: TEST_bluestore: timeout 60 rados bench -p foo 30 write -b 4096 --no-cleanup 2026-02-17T05:36:35.190 INFO:tasks.workunit.client.0.trial030.stdout:hints = 1 2026-02-17T05:36:35.190 INFO:tasks.workunit.client.0.trial030.stdout:Maintaining 16 concurrent writes of 4096 bytes to objects of size 4096 for up to 30 seconds or 0 objects 2026-02-17T05:36:35.190 INFO:tasks.workunit.client.0.trial030.stdout:Object prefix: benchmark_data_trial030_96046 2026-02-17T05:36:35.190 INFO:tasks.workunit.client.0.trial030.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-17T05:36:35.190 INFO:tasks.workunit.client.0.trial030.stdout: 0 0 0 0 0 0 - 0 2026-02-17T05:36:36.190 INFO:tasks.workunit.client.0.trial030.stdout: 1 16 10790 10774 42.0826 42.0859 0.00174788 0.00148258 2026-02-17T05:36:37.191 INFO:tasks.workunit.client.0.trial030.stdout: 2 16 21951 21935 42.8384 43.5977 0.000943904 0.00145693 2026-02-17T05:36:38.191 INFO:tasks.workunit.client.0.trial030.stdout: 3 16 33067 33051 43.0317 43.4219 0.00160862 0.00145065 2026-02-17T05:36:39.191 INFO:tasks.workunit.client.0.trial030.stdout: 4 16 44247 44231 43.1909 43.6719 0.00111999 0.00144534 2026-02-17T05:36:40.191 INFO:tasks.workunit.client.0.trial030.stdout: 5 16 55068 55052 43.006 42.2695 0.00222004 0.00145162 2026-02-17T05:36:41.191 INFO:tasks.workunit.client.0.trial030.stdout: 6 16 64171 64155 41.7643 35.5586 0.0571798 0.00148853 2026-02-17T05:36:42.191 INFO:tasks.workunit.client.0.trial030.stdout: 7 16 71645 71629 39.9683 29.1953 0.00105843 0.00156217 2026-02-17T05:36:43.191 INFO:tasks.workunit.client.0.trial030.stdout: 8 16 82618 82602 40.3297 42.8633 0.00138401 0.00154812 2026-02-17T05:36:44.191 INFO:tasks.workunit.client.0.trial030.stdout: 9 15 93672 93657 40.6464 43.1836 0.00155313 0.00153611 2026-02-17T05:36:45.192 INFO:tasks.workunit.client.0.trial030.stdout: 10 16 104777 104761 40.919 43.375 0.00105027 0.00152589 2026-02-17T05:36:46.191 INFO:tasks.workunit.client.0.trial030.stdout: 11 16 115636 115620 41.0549 42.418 0.00127221 0.00152083 2026-02-17T05:36:47.192 INFO:tasks.workunit.client.0.trial030.stdout: 12 16 120638 120622 39.2618 19.5391 0.0237012 0.00151945 2026-02-17T05:36:48.192 INFO:tasks.workunit.client.0.trial030.stdout: 13 16 120662 120646 36.2489 0.09375 0.857059 0.0016603 2026-02-17T05:36:49.192 INFO:tasks.workunit.client.0.trial030.stdout: 14 16 129280 129264 36.0641 33.6641 0.00171095 0.0017315 2026-02-17T05:36:50.192 INFO:tasks.workunit.client.0.trial030.stdout: 15 16 139685 139669 36.3692 40.6445 0.00179412 0.00171697 2026-02-17T05:36:51.192 INFO:tasks.workunit.client.0.trial030.stdout: 16 16 149313 149297 36.4466 37.6094 0.00195709 0.00171333 2026-02-17T05:36:52.192 INFO:tasks.workunit.client.0.trial030.stdout: 17 16 159098 159082 36.5509 38.2227 0.00257919 0.00170837 2026-02-17T05:36:53.192 INFO:tasks.workunit.client.0.trial030.stdout: 18 16 168521 168505 36.565 36.8086 0.00162855 0.00170776 2026-02-17T05:36:54.192 INFO:tasks.workunit.client.0.trial030.stdout: 19 16 171928 171912 35.341 13.3086 0.446118 0.0017527 2026-02-17T05:36:55.192 INFO:tasks.workunit.client.0.trial030.stdout:2026-02-17T05:36:55.188782+0000 min lat: 0.000450452 max lat: 0.87206 avg lat: 0.00184938 2026-02-17T05:36:55.193 INFO:tasks.workunit.client.0.trial030.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-17T05:36:55.193 INFO:tasks.workunit.client.0.trial030.stdout: 20 16 172039 172023 33.5956 0.433594 0.045803 0.00184938 2026-02-17T05:36:56.192 INFO:tasks.workunit.client.0.trial030.stdout: 21 16 172153 172137 32.017 0.445312 0.153088 0.00194429 2026-02-17T05:36:57.192 INFO:tasks.workunit.client.0.trial030.stdout: 22 16 179388 179372 31.8462 28.2617 0.000846614 0.00196103 2026-02-17T05:36:58.193 INFO:tasks.workunit.client.0.trial030.stdout: 23 16 188983 188967 32.0911 37.4805 0.00168041 0.00194607 2026-02-17T05:36:59.193 INFO:tasks.workunit.client.0.trial030.stdout: 24 16 198422 198406 32.2901 36.8711 0.00165699 0.00193406 2026-02-17T05:37:00.193 INFO:tasks.workunit.client.0.trial030.stdout: 25 15 207684 207669 32.4457 36.1836 0.00133855 0.00192479 2026-02-17T05:37:01.193 INFO:tasks.workunit.client.0.trial030.stdout: 26 16 217118 217102 32.6149 36.8477 0.0016062 0.00191479 2026-02-17T05:37:02.193 INFO:tasks.workunit.client.0.trial030.stdout: 27 16 226605 226589 32.7794 37.0586 0.00166767 0.0019052 2026-02-17T05:37:03.193 INFO:tasks.workunit.client.0.trial030.stdout: 28 16 236023 236007 32.9225 36.7891 0.00280531 0.00189689 2026-02-17T05:37:04.193 INFO:tasks.workunit.client.0.trial030.stdout: 29 16 245425 245409 33.0536 36.7266 0.00155673 0.00188938 2026-02-17T05:37:05.193 INFO:tasks.workunit.client.0.trial030.stdout:Total time run: 30.001 2026-02-17T05:37:05.194 INFO:tasks.workunit.client.0.trial030.stdout:Total writes made: 254768 2026-02-17T05:37:05.194 INFO:tasks.workunit.client.0.trial030.stdout:Write size: 4096 2026-02-17T05:37:05.194 INFO:tasks.workunit.client.0.trial030.stdout:Object size: 4096 2026-02-17T05:37:05.194 INFO:tasks.workunit.client.0.trial030.stdout:Bandwidth (MB/sec): 33.1718 2026-02-17T05:37:05.194 INFO:tasks.workunit.client.0.trial030.stdout:Stddev Bandwidth: 13.2864 2026-02-17T05:37:05.194 INFO:tasks.workunit.client.0.trial030.stdout:Max bandwidth (MB/sec): 43.6719 2026-02-17T05:37:05.194 INFO:tasks.workunit.client.0.trial030.stdout:Min bandwidth (MB/sec): 0.09375 2026-02-17T05:37:05.194 INFO:tasks.workunit.client.0.trial030.stdout:Average IOPS: 8491 2026-02-17T05:37:05.194 INFO:tasks.workunit.client.0.trial030.stdout:Stddev IOPS: 3401.31 2026-02-17T05:37:05.195 INFO:tasks.workunit.client.0.trial030.stdout:Max IOPS: 11180 2026-02-17T05:37:05.195 INFO:tasks.workunit.client.0.trial030.stdout:Min IOPS: 24 2026-02-17T05:37:05.195 INFO:tasks.workunit.client.0.trial030.stdout:Average Latency(s): 0.00188266 2026-02-17T05:37:05.195 INFO:tasks.workunit.client.0.trial030.stdout:Stddev Latency(s): 0.0105286 2026-02-17T05:37:05.195 INFO:tasks.workunit.client.0.trial030.stdout:Max latency(s): 0.87206 2026-02-17T05:37:05.195 INFO:tasks.workunit.client.0.trial030.stdout:Min latency(s): 0.000450452 2026-02-17T05:37:05.196 INFO:tasks.workunit.client.0.trial030.stdout:after bench 2026-02-17T05:37:05.197 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:57: TEST_bluestore: echo 'after bench' 2026-02-17T05:37:05.197 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:60: TEST_bluestore: kill 88425 2026-02-17T05:37:05.197 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:60: TEST_bluestore: sleep 1 2026-02-17T05:37:06.198 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:60: TEST_bluestore: kill 88425 2026-02-17T05:37:06.198 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 60: kill: (88425) - No such process 2026-02-17T05:37:06.198 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:61: TEST_bluestore: ceph osd down 0 2026-02-17T05:37:06.421 INFO:tasks.workunit.client.0.trial030.stderr:osd.0 is already down. 2026-02-17T05:37:06.431 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:62: TEST_bluestore: kill 90572 2026-02-17T05:37:06.431 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:62: TEST_bluestore: sleep 1 2026-02-17T05:37:07.433 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:62: TEST_bluestore: kill 90572 2026-02-17T05:37:07.433 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 62: kill: (90572) - No such process 2026-02-17T05:37:07.433 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:63: TEST_bluestore: ceph osd down 1 2026-02-17T05:37:07.652 INFO:tasks.workunit.client.0.trial030.stderr:osd.1 is already down. 2026-02-17T05:37:07.662 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:64: TEST_bluestore: kill 92764 2026-02-17T05:37:07.662 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:64: TEST_bluestore: sleep 1 2026-02-17T05:37:08.663 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:64: TEST_bluestore: kill 92764 2026-02-17T05:37:08.663 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 64: kill: (92764) - No such process 2026-02-17T05:37:08.663 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:65: TEST_bluestore: ceph osd down 2 2026-02-17T05:37:08.882 INFO:tasks.workunit.client.0.trial030.stderr:osd.2 is already down. 2026-02-17T05:37:08.893 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:66: TEST_bluestore: kill 94922 2026-02-17T05:37:08.893 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:66: TEST_bluestore: sleep 1 2026-02-17T05:37:09.895 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:66: TEST_bluestore: kill 94922 2026-02-17T05:37:09.895 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 66: kill: (94922) - No such process 2026-02-17T05:37:09.895 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:67: TEST_bluestore: ceph osd down 3 2026-02-17T05:37:10.159 INFO:tasks.workunit.client.0.trial030.stderr:osd.3 is already down. 2026-02-17T05:37:10.169 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:70: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-17T05:37:14.394 INFO:tasks.workunit.client.0.trial030.stdout:fsck success 2026-02-17T05:37:14.433 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:71: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-17T05:37:18.462 INFO:tasks.workunit.client.0.trial030.stdout:fsck success 2026-02-17T05:37:18.501 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:72: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2026-02-17T05:37:22.710 INFO:tasks.workunit.client.0.trial030.stdout:fsck success 2026-02-17T05:37:22.748 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:73: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-17T05:37:27.094 INFO:tasks.workunit.client.0.trial030.stdout:fsck success 2026-02-17T05:37:27.133 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:75: TEST_bluestore: truncate td/osd-bluefs-volume-ops/0/block -s 4294967296 2026-02-17T05:37:27.134 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:76: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 bluefs-bdev-expand 2026-02-17T05:37:27.151 INFO:tasks.workunit.client.0.trial030.stdout:inferring bluefs devices from bluestore path 2026-02-17T05:37:30.727 INFO:tasks.workunit.client.0.trial030.stdout:0 : device size 0x20000000(512 MiB) : using 0x16d00000(365 MiB) 2026-02-17T05:37:30.727 INFO:tasks.workunit.client.0.trial030.stdout:1 : device size 0x40000000(1 GiB) : using 0xe00000(14 MiB) 2026-02-17T05:37:30.727 INFO:tasks.workunit.client.0.trial030.stdout:2 : device size 0x100000000(4 GiB) : using 0xaebfe000(2.7 GiB) : bluefs used 0x0(0 B) : non-bluefs used 0xaebfe000(2.7 GiB) 2026-02-17T05:37:30.727 INFO:tasks.workunit.client.0.trial030.stdout:Expanding DB/WAL... 2026-02-17T05:37:30.728 INFO:tasks.workunit.client.0.trial030.stdout:0 : nothing to do, skipped 2026-02-17T05:37:30.729 INFO:tasks.workunit.client.0.trial030.stdout:1 : nothing to do, skipped 2026-02-17T05:37:30.729 INFO:tasks.workunit.client.0.trial030.stdout:2 : Expanding to 0x100000000(4 GiB) 2026-02-17T05:37:31.009 INFO:tasks.workunit.client.0.trial030.stdout:2 : size updated to 0x100000000(4 GiB) 2026-02-17T05:37:34.734 INFO:tasks.workunit.client.0.trial030.stderr:./src/os/bluestore/BlueStore.h: In function 'virtual void RocksDBBlueFSVolumeSelector::sub_usage(void*, uint64_t, bool)' thread 7f47e8267d40 time 2026-02-17T05:37:34.730191+0000 2026-02-17T05:37:34.734 INFO:tasks.workunit.client.0.trial030.stderr:./src/os/bluestore/BlueStore.h: 4591: FAILED ceph_assert(cur >= size_less) 2026-02-17T05:37:34.735 INFO:tasks.workunit.client.0.trial030.stderr: ceph version 20.3.0-5271-g32585015 (325850157d309f65985eea9ec9bb9f1d56726fee) tentacle (dev - None) 2026-02-17T05:37:34.735 INFO:tasks.workunit.client.0.trial030.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x137) [0x7f47e9d91ea9] 2026-02-17T05:37:34.735 INFO:tasks.workunit.client.0.trial030.stderr: 2: ceph-bluestore-tool(+0x18a6d6) [0x5599496926d6] 2026-02-17T05:37:34.735 INFO:tasks.workunit.client.0.trial030.stderr: 3: (BlueFS::_drop_link_DF(boost::intrusive_ptr)+0x102) [0x559949799632] 2026-02-17T05:37:34.735 INFO:tasks.workunit.client.0.trial030.stderr: 4: (BlueFS::unlink(std::basic_string_view >, std::basic_string_view >)+0x313) [0x5599497b9813] 2026-02-17T05:37:34.735 INFO:tasks.workunit.client.0.trial030.stderr: 5: (BlueRocksEnv::DeleteFile(std::__cxx11::basic_string, std::allocator > const&)+0x47) [0x5599498ec697] 2026-02-17T05:37:34.735 INFO:tasks.workunit.client.0.trial030.stderr: 6: (rocksdb::DeleteDBFile(rocksdb::ImmutableDBOptions const*, std::__cxx11::basic_string, std::allocator > const&, std::__cxx11::basic_string, std::allocator > const&, bool, bool)+0xb3) [0x559949a9f873] 2026-02-17T05:37:34.735 INFO:tasks.workunit.client.0.trial030.stderr: 7: (rocksdb::DBImpl::DeleteObsoleteFileImpl(int, std::__cxx11::basic_string, std::allocator > const&, std::__cxx11::basic_string, std::allocator > const&, rocksdb::FileType, unsigned long)+0xc3) [0x559949997633] 2026-02-17T05:37:34.735 INFO:tasks.workunit.client.0.trial030.stderr: 8: (rocksdb::DBImpl::PurgeObsoleteFiles(rocksdb::JobContext&, bool)+0x1a4e) [0x55994999ca6e] 2026-02-17T05:37:34.735 INFO:tasks.workunit.client.0.trial030.stderr: 9: (rocksdb::DBImpl::DeleteObsoleteFiles()+0xa9) [0x55994999d359] 2026-02-17T05:37:34.736 INFO:tasks.workunit.client.0.trial030.stderr: 10: (rocksdb::DBImpl::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string, std::allocator > const&, std::vector > const&, std::vector >*, rocksdb::DB**, bool, bool)+0x812) [0x5599499ab412] 2026-02-17T05:37:34.736 INFO:tasks.workunit.client.0.trial030.stderr: 11: (rocksdb::DB::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string, std::allocator > const&, std::vector > const&, std::vector >*, rocksdb::DB**)+0x28) [0x5599499ac978] 2026-02-17T05:37:34.736 INFO:tasks.workunit.client.0.trial030.stderr: 12: (RocksDBStore::do_open(std::ostream&, bool, bool, std::__cxx11::basic_string, std::allocator > const&)+0xdf4) [0x55994975f724] 2026-02-17T05:37:34.736 INFO:tasks.workunit.client.0.trial030.stderr: 13: (BlueStore::_open_db(bool, bool, bool)+0x4e2) [0x55994980d162] 2026-02-17T05:37:34.736 INFO:tasks.workunit.client.0.trial030.stderr: 14: (BlueStore::_open_db_and_around(bool, bool)+0x454) [0x55994980e024] 2026-02-17T05:37:34.736 INFO:tasks.workunit.client.0.trial030.stderr: 15: (BlueStore::expand_devices(std::ostream&)+0x97d) [0x55994981789d] 2026-02-17T05:37:34.736 INFO:tasks.workunit.client.0.trial030.stderr: 16: main() 2026-02-17T05:37:34.736 INFO:tasks.workunit.client.0.trial030.stderr: 17: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f47e9458d90] 2026-02-17T05:37:34.736 INFO:tasks.workunit.client.0.trial030.stderr: 18: __libc_start_main() 2026-02-17T05:37:34.736 INFO:tasks.workunit.client.0.trial030.stderr: 19: _start() 2026-02-17T05:37:34.736 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:37:34.728+0000 7f47e8267d40 -1 ./src/os/bluestore/BlueStore.h: In function 'virtual void RocksDBBlueFSVolumeSelector::sub_usage(void*, uint64_t, bool)' thread 7f47e8267d40 time 2026-02-17T05:37:34.730191+0000 2026-02-17T05:37:34.736 INFO:tasks.workunit.client.0.trial030.stderr:./src/os/bluestore/BlueStore.h: 4591: FAILED ceph_assert(cur >= size_less) 2026-02-17T05:37:34.736 INFO:tasks.workunit.client.0.trial030.stderr: 2026-02-17T05:37:34.736 INFO:tasks.workunit.client.0.trial030.stderr: ceph version 20.3.0-5271-g32585015 (325850157d309f65985eea9ec9bb9f1d56726fee) tentacle (dev - None) 2026-02-17T05:37:34.736 INFO:tasks.workunit.client.0.trial030.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x137) [0x7f47e9d91ea9] 2026-02-17T05:37:34.736 INFO:tasks.workunit.client.0.trial030.stderr: 2: ceph-bluestore-tool(+0x18a6d6) [0x5599496926d6] 2026-02-17T05:37:34.737 INFO:tasks.workunit.client.0.trial030.stderr: 3: (BlueFS::_drop_link_DF(boost::intrusive_ptr)+0x102) [0x559949799632] 2026-02-17T05:37:34.737 INFO:tasks.workunit.client.0.trial030.stderr: 4: (BlueFS::unlink(std::basic_string_view >, std::basic_string_view >)+0x313) [0x5599497b9813] 2026-02-17T05:37:34.737 INFO:tasks.workunit.client.0.trial030.stderr: 5: (BlueRocksEnv::DeleteFile(std::__cxx11::basic_string, std::allocator > const&)+0x47) [0x5599498ec697] 2026-02-17T05:37:34.737 INFO:tasks.workunit.client.0.trial030.stderr: 6: (rocksdb::DeleteDBFile(rocksdb::ImmutableDBOptions const*, std::__cxx11::basic_string, std::allocator > const&, std::__cxx11::basic_string, std::allocator > const&, bool, bool)+0xb3) [0x559949a9f873] 2026-02-17T05:37:34.737 INFO:tasks.workunit.client.0.trial030.stderr: 7: (rocksdb::DBImpl::DeleteObsoleteFileImpl(int, std::__cxx11::basic_string, std::allocator > const&, std::__cxx11::basic_string, std::allocator > const&, rocksdb::FileType, unsigned long)+0xc3) [0x559949997633] 2026-02-17T05:37:34.737 INFO:tasks.workunit.client.0.trial030.stderr: 8: (rocksdb::DBImpl::PurgeObsoleteFiles(rocksdb::JobContext&, bool)+0x1a4e) [0x55994999ca6e] 2026-02-17T05:37:34.737 INFO:tasks.workunit.client.0.trial030.stderr: 9: (rocksdb::DBImpl::DeleteObsoleteFiles()+0xa9) [0x55994999d359] 2026-02-17T05:37:34.737 INFO:tasks.workunit.client.0.trial030.stderr: 10: (rocksdb::DBImpl::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string, std::allocator > const&, std::vector > const&, std::vector >*, rocksdb::DB**, bool, bool)+0x812) [0x5599499ab412] 2026-02-17T05:37:34.737 INFO:tasks.workunit.client.0.trial030.stderr: 11: (rocksdb::DB::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string, std::allocator > const&, std::vector > const&, std::vector >*, rocksdb::DB**)+0x28) [0x5599499ac978] 2026-02-17T05:37:34.737 INFO:tasks.workunit.client.0.trial030.stderr: 12: (RocksDBStore::do_open(std::ostream&, bool, bool, std::__cxx11::basic_string, std::allocator > const&)+0xdf4) [0x55994975f724] 2026-02-17T05:37:34.737 INFO:tasks.workunit.client.0.trial030.stderr: 13: (BlueStore::_open_db(bool, bool, bool)+0x4e2) [0x55994980d162] 2026-02-17T05:37:34.737 INFO:tasks.workunit.client.0.trial030.stderr: 14: (BlueStore::_open_db_and_around(bool, bool)+0x454) [0x55994980e024] 2026-02-17T05:37:34.737 INFO:tasks.workunit.client.0.trial030.stderr: 15: (BlueStore::expand_devices(std::ostream&)+0x97d) [0x55994981789d] 2026-02-17T05:37:34.737 INFO:tasks.workunit.client.0.trial030.stderr: 16: main() 2026-02-17T05:37:34.738 INFO:tasks.workunit.client.0.trial030.stderr: 17: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f47e9458d90] 2026-02-17T05:37:34.738 INFO:tasks.workunit.client.0.trial030.stderr: 18: __libc_start_main() 2026-02-17T05:37:34.738 INFO:tasks.workunit.client.0.trial030.stderr: 19: _start() 2026-02-17T05:37:34.738 INFO:tasks.workunit.client.0.trial030.stderr: 2026-02-17T05:37:34.738 INFO:tasks.workunit.client.0.trial030.stderr:*** Caught signal (Aborted) ** 2026-02-17T05:37:34.738 INFO:tasks.workunit.client.0.trial030.stderr: in thread 7f47e8267d40 thread_name:ceph-bluestore- 2026-02-17T05:37:34.739 INFO:tasks.workunit.client.0.trial030.stderr: ceph version 20.3.0-5271-g32585015 (325850157d309f65985eea9ec9bb9f1d56726fee) tentacle (dev - None) 2026-02-17T05:37:34.739 INFO:tasks.workunit.client.0.trial030.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f47e9471520] 2026-02-17T05:37:34.739 INFO:tasks.workunit.client.0.trial030.stderr: 2: pthread_kill() 2026-02-17T05:37:34.739 INFO:tasks.workunit.client.0.trial030.stderr: 3: raise() 2026-02-17T05:37:34.739 INFO:tasks.workunit.client.0.trial030.stderr: 4: abort() 2026-02-17T05:37:34.739 INFO:tasks.workunit.client.0.trial030.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x196) [0x7f47e9d91f08] 2026-02-17T05:37:34.740 INFO:tasks.workunit.client.0.trial030.stderr: 6: ceph-bluestore-tool(+0x18a6d6) [0x5599496926d6] 2026-02-17T05:37:34.740 INFO:tasks.workunit.client.0.trial030.stderr: 7: (BlueFS::_drop_link_DF(boost::intrusive_ptr)+0x102) [0x559949799632] 2026-02-17T05:37:34.740 INFO:tasks.workunit.client.0.trial030.stderr: 8: (BlueFS::unlink(std::basic_string_view >, std::basic_string_view >)+0x313) [0x5599497b9813] 2026-02-17T05:37:34.740 INFO:tasks.workunit.client.0.trial030.stderr: 9: (BlueRocksEnv::DeleteFile(std::__cxx11::basic_string, std::allocator > const&)+0x47) [0x5599498ec697] 2026-02-17T05:37:34.740 INFO:tasks.workunit.client.0.trial030.stderr: 10: (rocksdb::DeleteDBFile(rocksdb::ImmutableDBOptions const*, std::__cxx11::basic_string, std::allocator > const&, std::__cxx11::basic_string, std::allocator > const&, bool, bool)+0xb3) [0x559949a9f873] 2026-02-17T05:37:34.740 INFO:tasks.workunit.client.0.trial030.stderr: 11: (rocksdb::DBImpl::DeleteObsoleteFileImpl(int, std::__cxx11::basic_string, std::allocator > const&, std::__cxx11::basic_string, std::allocator > const&, rocksdb::FileType, unsigned long)+0xc3) [0x559949997633] 2026-02-17T05:37:34.740 INFO:tasks.workunit.client.0.trial030.stderr: 12: (rocksdb::DBImpl::PurgeObsoleteFiles(rocksdb::JobContext&, bool)+0x1a4e) [0x55994999ca6e] 2026-02-17T05:37:34.740 INFO:tasks.workunit.client.0.trial030.stderr: 13: (rocksdb::DBImpl::DeleteObsoleteFiles()+0xa9) [0x55994999d359] 2026-02-17T05:37:34.740 INFO:tasks.workunit.client.0.trial030.stderr: 14: (rocksdb::DBImpl::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string, std::allocator > const&, std::vector > const&, std::vector >*, rocksdb::DB**, bool, bool)+0x812) [0x5599499ab412] 2026-02-17T05:37:34.740 INFO:tasks.workunit.client.0.trial030.stderr: 15: (rocksdb::DB::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string, std::allocator > const&, std::vector > const&, std::vector >*, rocksdb::DB**)+0x28) [0x5599499ac978] 2026-02-17T05:37:34.740 INFO:tasks.workunit.client.0.trial030.stderr: 16: (RocksDBStore::do_open(std::ostream&, bool, bool, std::__cxx11::basic_string, std::allocator > const&)+0xdf4) [0x55994975f724] 2026-02-17T05:37:34.741 INFO:tasks.workunit.client.0.trial030.stderr: 17: (BlueStore::_open_db(bool, bool, bool)+0x4e2) [0x55994980d162] 2026-02-17T05:37:34.741 INFO:tasks.workunit.client.0.trial030.stderr: 18: (BlueStore::_open_db_and_around(bool, bool)+0x454) [0x55994980e024] 2026-02-17T05:37:34.741 INFO:tasks.workunit.client.0.trial030.stderr: 19: (BlueStore::expand_devices(std::ostream&)+0x97d) [0x55994981789d] 2026-02-17T05:37:34.741 INFO:tasks.workunit.client.0.trial030.stderr: 20: main() 2026-02-17T05:37:34.741 INFO:tasks.workunit.client.0.trial030.stderr: 21: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f47e9458d90] 2026-02-17T05:37:34.741 INFO:tasks.workunit.client.0.trial030.stderr: 22: __libc_start_main() 2026-02-17T05:37:34.741 INFO:tasks.workunit.client.0.trial030.stderr: 23: _start() 2026-02-17T05:37:34.741 INFO:tasks.workunit.client.0.trial030.stderr:2026-02-17T05:37:34.728+0000 7f47e8267d40 -1 *** Caught signal (Aborted) ** 2026-02-17T05:37:34.741 INFO:tasks.workunit.client.0.trial030.stderr: in thread 7f47e8267d40 thread_name:ceph-bluestore- 2026-02-17T05:37:34.741 INFO:tasks.workunit.client.0.trial030.stderr: 2026-02-17T05:37:34.741 INFO:tasks.workunit.client.0.trial030.stderr: ceph version 20.3.0-5271-g32585015 (325850157d309f65985eea9ec9bb9f1d56726fee) tentacle (dev - None) 2026-02-17T05:37:34.741 INFO:tasks.workunit.client.0.trial030.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f47e9471520] 2026-02-17T05:37:34.741 INFO:tasks.workunit.client.0.trial030.stderr: 2: pthread_kill() 2026-02-17T05:37:34.742 INFO:tasks.workunit.client.0.trial030.stderr: 3: raise() 2026-02-17T05:37:34.742 INFO:tasks.workunit.client.0.trial030.stderr: 4: abort() 2026-02-17T05:37:34.742 INFO:tasks.workunit.client.0.trial030.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x196) [0x7f47e9d91f08] 2026-02-17T05:37:34.742 INFO:tasks.workunit.client.0.trial030.stderr: 6: ceph-bluestore-tool(+0x18a6d6) [0x5599496926d6] 2026-02-17T05:37:34.742 INFO:tasks.workunit.client.0.trial030.stderr: 7: (BlueFS::_drop_link_DF(boost::intrusive_ptr)+0x102) [0x559949799632] 2026-02-17T05:37:34.742 INFO:tasks.workunit.client.0.trial030.stderr: 8: (BlueFS::unlink(std::basic_string_view >, std::basic_string_view >)+0x313) [0x5599497b9813] 2026-02-17T05:37:34.742 INFO:tasks.workunit.client.0.trial030.stderr: 9: (BlueRocksEnv::DeleteFile(std::__cxx11::basic_string, std::allocator > const&)+0x47) [0x5599498ec697] 2026-02-17T05:37:34.742 INFO:tasks.workunit.client.0.trial030.stderr: 10: (rocksdb::DeleteDBFile(rocksdb::ImmutableDBOptions const*, std::__cxx11::basic_string, std::allocator > const&, std::__cxx11::basic_string, std::allocator > const&, bool, bool)+0xb3) [0x559949a9f873] 2026-02-17T05:37:34.742 INFO:tasks.workunit.client.0.trial030.stderr: 11: (rocksdb::DBImpl::DeleteObsoleteFileImpl(int, std::__cxx11::basic_string, std::allocator > const&, std::__cxx11::basic_string, std::allocator > const&, rocksdb::FileType, unsigned long)+0xc3) [0x559949997633] 2026-02-17T05:37:34.742 INFO:tasks.workunit.client.0.trial030.stderr: 12: (rocksdb::DBImpl::PurgeObsoleteFiles(rocksdb::JobContext&, bool)+0x1a4e) [0x55994999ca6e] 2026-02-17T05:37:34.742 INFO:tasks.workunit.client.0.trial030.stderr: 13: (rocksdb::DBImpl::DeleteObsoleteFiles()+0xa9) [0x55994999d359] 2026-02-17T05:37:34.742 INFO:tasks.workunit.client.0.trial030.stderr: 14: (rocksdb::DBImpl::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string, std::allocator > const&, std::vector > const&, std::vector >*, rocksdb::DB**, bool, bool)+0x812) [0x5599499ab412] 2026-02-17T05:37:34.743 INFO:tasks.workunit.client.0.trial030.stderr: 15: (rocksdb::DB::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string, std::allocator > const&, std::vector > const&, std::vector >*, rocksdb::DB**)+0x28) [0x5599499ac978] 2026-02-17T05:37:34.743 INFO:tasks.workunit.client.0.trial030.stderr: 16: (RocksDBStore::do_open(std::ostream&, bool, bool, std::__cxx11::basic_string, std::allocator > const&)+0xdf4) [0x55994975f724] 2026-02-17T05:37:34.743 INFO:tasks.workunit.client.0.trial030.stderr: 17: (BlueStore::_open_db(bool, bool, bool)+0x4e2) [0x55994980d162] 2026-02-17T05:37:34.743 INFO:tasks.workunit.client.0.trial030.stderr: 18: (BlueStore::_open_db_and_around(bool, bool)+0x454) [0x55994980e024] 2026-02-17T05:37:34.743 INFO:tasks.workunit.client.0.trial030.stderr: 19: (BlueStore::expand_devices(std::ostream&)+0x97d) [0x55994981789d] 2026-02-17T05:37:34.743 INFO:tasks.workunit.client.0.trial030.stderr: 20: main() 2026-02-17T05:37:34.743 INFO:tasks.workunit.client.0.trial030.stderr: 21: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f47e9458d90] 2026-02-17T05:37:34.743 INFO:tasks.workunit.client.0.trial030.stderr: 22: __libc_start_main() 2026-02-17T05:37:34.743 INFO:tasks.workunit.client.0.trial030.stderr: 23: _start() 2026-02-17T05:37:34.743 INFO:tasks.workunit.client.0.trial030.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2026-02-17T05:37:34.743 INFO:tasks.workunit.client.0.trial030.stderr: 2026-02-17T05:37:34.743 INFO:tasks.workunit.client.0.trial030.stderr: -499> 2026-02-17T05:37:34.728+0000 7f47e8267d40 -1 ./src/os/bluestore/BlueStore.h: In function 'virtual void RocksDBBlueFSVolumeSelector::sub_usage(void*, uint64_t, bool)' thread 7f47e8267d40 time 2026-02-17T05:37:34.730191+0000 2026-02-17T05:37:34.744 INFO:tasks.workunit.client.0.trial030.stderr:./src/os/bluestore/BlueStore.h: 4591: FAILED ceph_assert(cur >= size_less) 2026-02-17T05:37:34.744 INFO:tasks.workunit.client.0.trial030.stderr: 2026-02-17T05:37:34.744 INFO:tasks.workunit.client.0.trial030.stderr: ceph version 20.3.0-5271-g32585015 (325850157d309f65985eea9ec9bb9f1d56726fee) tentacle (dev - None) 2026-02-17T05:37:34.744 INFO:tasks.workunit.client.0.trial030.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x137) [0x7f47e9d91ea9] 2026-02-17T05:37:34.744 INFO:tasks.workunit.client.0.trial030.stderr: 2: ceph-bluestore-tool(+0x18a6d6) [0x5599496926d6] 2026-02-17T05:37:34.744 INFO:tasks.workunit.client.0.trial030.stderr: 3: (BlueFS::_drop_link_DF(boost::intrusive_ptr)+0x102) [0x559949799632] 2026-02-17T05:37:34.744 INFO:tasks.workunit.client.0.trial030.stderr: 4: (BlueFS::unlink(std::basic_string_view >, std::basic_string_view >)+0x313) [0x5599497b9813] 2026-02-17T05:37:34.744 INFO:tasks.workunit.client.0.trial030.stderr: 5: (BlueRocksEnv::DeleteFile(std::__cxx11::basic_string, std::allocator > const&)+0x47) [0x5599498ec697] 2026-02-17T05:37:34.744 INFO:tasks.workunit.client.0.trial030.stderr: 6: (rocksdb::DeleteDBFile(rocksdb::ImmutableDBOptions const*, std::__cxx11::basic_string, std::allocator > const&, std::__cxx11::basic_string, std::allocator > const&, bool, bool)+0xb3) [0x559949a9f873] 2026-02-17T05:37:34.744 INFO:tasks.workunit.client.0.trial030.stderr: 7: (rocksdb::DBImpl::DeleteObsoleteFileImpl(int, std::__cxx11::basic_string, std::allocator > const&, std::__cxx11::basic_string, std::allocator > const&, rocksdb::FileType, unsigned long)+0xc3) [0x559949997633] 2026-02-17T05:37:34.744 INFO:tasks.workunit.client.0.trial030.stderr: 8: (rocksdb::DBImpl::PurgeObsoleteFiles(rocksdb::JobContext&, bool)+0x1a4e) [0x55994999ca6e] 2026-02-17T05:37:34.744 INFO:tasks.workunit.client.0.trial030.stderr: 9: (rocksdb::DBImpl::DeleteObsoleteFiles()+0xa9) [0x55994999d359] 2026-02-17T05:37:34.745 INFO:tasks.workunit.client.0.trial030.stderr: 10: (rocksdb::DBImpl::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string, std::allocator > const&, std::vector > const&, std::vector >*, rocksdb::DB**, bool, bool)+0x812) [0x5599499ab412] 2026-02-17T05:37:34.745 INFO:tasks.workunit.client.0.trial030.stderr: 11: (rocksdb::DB::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string, std::allocator > const&, std::vector > const&, std::vector >*, rocksdb::DB**)+0x28) [0x5599499ac978] 2026-02-17T05:37:34.745 INFO:tasks.workunit.client.0.trial030.stderr: 12: (RocksDBStore::do_open(std::ostream&, bool, bool, std::__cxx11::basic_string, std::allocator > const&)+0xdf4) [0x55994975f724] 2026-02-17T05:37:34.745 INFO:tasks.workunit.client.0.trial030.stderr: 13: (BlueStore::_open_db(bool, bool, bool)+0x4e2) [0x55994980d162] 2026-02-17T05:37:34.745 INFO:tasks.workunit.client.0.trial030.stderr: 14: (BlueStore::_open_db_and_around(bool, bool)+0x454) [0x55994980e024] 2026-02-17T05:37:34.745 INFO:tasks.workunit.client.0.trial030.stderr: 15: (BlueStore::expand_devices(std::ostream&)+0x97d) [0x55994981789d] 2026-02-17T05:37:34.745 INFO:tasks.workunit.client.0.trial030.stderr: 16: main() 2026-02-17T05:37:34.745 INFO:tasks.workunit.client.0.trial030.stderr: 17: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f47e9458d90] 2026-02-17T05:37:34.745 INFO:tasks.workunit.client.0.trial030.stderr: 18: __libc_start_main() 2026-02-17T05:37:34.745 INFO:tasks.workunit.client.0.trial030.stderr: 19: _start() 2026-02-17T05:37:34.745 INFO:tasks.workunit.client.0.trial030.stderr: 2026-02-17T05:37:34.745 INFO:tasks.workunit.client.0.trial030.stderr: -498> 2026-02-17T05:37:34.728+0000 7f47e8267d40 -1 *** Caught signal (Aborted) ** 2026-02-17T05:37:34.746 INFO:tasks.workunit.client.0.trial030.stderr: in thread 7f47e8267d40 thread_name:ceph-bluestore- 2026-02-17T05:37:34.746 INFO:tasks.workunit.client.0.trial030.stderr: 2026-02-17T05:37:34.746 INFO:tasks.workunit.client.0.trial030.stderr: ceph version 20.3.0-5271-g32585015 (325850157d309f65985eea9ec9bb9f1d56726fee) tentacle (dev - None) 2026-02-17T05:37:34.746 INFO:tasks.workunit.client.0.trial030.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f47e9471520] 2026-02-17T05:37:34.746 INFO:tasks.workunit.client.0.trial030.stderr: 2: pthread_kill() 2026-02-17T05:37:34.746 INFO:tasks.workunit.client.0.trial030.stderr: 3: raise() 2026-02-17T05:37:34.746 INFO:tasks.workunit.client.0.trial030.stderr: 4: abort() 2026-02-17T05:37:34.746 INFO:tasks.workunit.client.0.trial030.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x196) [0x7f47e9d91f08] 2026-02-17T05:37:34.746 INFO:tasks.workunit.client.0.trial030.stderr: 6: ceph-bluestore-tool(+0x18a6d6) [0x5599496926d6] 2026-02-17T05:37:34.746 INFO:tasks.workunit.client.0.trial030.stderr: 7: (BlueFS::_drop_link_DF(boost::intrusive_ptr)+0x102) [0x559949799632] 2026-02-17T05:37:34.746 INFO:tasks.workunit.client.0.trial030.stderr: 8: (BlueFS::unlink(std::basic_string_view >, std::basic_string_view >)+0x313) [0x5599497b9813] 2026-02-17T05:37:34.747 INFO:tasks.workunit.client.0.trial030.stderr: 9: (BlueRocksEnv::DeleteFile(std::__cxx11::basic_string, std::allocator > const&)+0x47) [0x5599498ec697] 2026-02-17T05:37:34.747 INFO:tasks.workunit.client.0.trial030.stderr: 10: (rocksdb::DeleteDBFile(rocksdb::ImmutableDBOptions const*, std::__cxx11::basic_string, std::allocator > const&, std::__cxx11::basic_string, std::allocator > const&, bool, bool)+0xb3) [0x559949a9f873] 2026-02-17T05:37:34.747 INFO:tasks.workunit.client.0.trial030.stderr: 11: (rocksdb::DBImpl::DeleteObsoleteFileImpl(int, std::__cxx11::basic_string, std::allocator > const&, std::__cxx11::basic_string, std::allocator > const&, rocksdb::FileType, unsigned long)+0xc3) [0x559949997633] 2026-02-17T05:37:34.747 INFO:tasks.workunit.client.0.trial030.stderr: 12: (rocksdb::DBImpl::PurgeObsoleteFiles(rocksdb::JobContext&, bool)+0x1a4e) [0x55994999ca6e] 2026-02-17T05:37:34.747 INFO:tasks.workunit.client.0.trial030.stderr: 13: (rocksdb::DBImpl::DeleteObsoleteFiles()+0xa9) [0x55994999d359] 2026-02-17T05:37:34.747 INFO:tasks.workunit.client.0.trial030.stderr: 14: (rocksdb::DBImpl::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string, std::allocator > const&, std::vector > const&, std::vector >*, rocksdb::DB**, bool, bool)+0x812) [0x5599499ab412] 2026-02-17T05:37:34.747 INFO:tasks.workunit.client.0.trial030.stderr: 15: (rocksdb::DB::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string, std::allocator > const&, std::vector > const&, std::vector >*, rocksdb::DB**)+0x28) [0x5599499ac978] 2026-02-17T05:37:34.747 INFO:tasks.workunit.client.0.trial030.stderr: 16: (RocksDBStore::do_open(std::ostream&, bool, bool, std::__cxx11::basic_string, std::allocator > const&)+0xdf4) [0x55994975f724] 2026-02-17T05:37:34.747 INFO:tasks.workunit.client.0.trial030.stderr: 17: (BlueStore::_open_db(bool, bool, bool)+0x4e2) [0x55994980d162] 2026-02-17T05:37:34.747 INFO:tasks.workunit.client.0.trial030.stderr: 18: (BlueStore::_open_db_and_around(bool, bool)+0x454) [0x55994980e024] 2026-02-17T05:37:34.747 INFO:tasks.workunit.client.0.trial030.stderr: 19: (BlueStore::expand_devices(std::ostream&)+0x97d) [0x55994981789d] 2026-02-17T05:37:34.748 INFO:tasks.workunit.client.0.trial030.stderr: 20: main() 2026-02-17T05:37:34.748 INFO:tasks.workunit.client.0.trial030.stderr: 21: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f47e9458d90] 2026-02-17T05:37:34.748 INFO:tasks.workunit.client.0.trial030.stderr: 22: __libc_start_main() 2026-02-17T05:37:34.748 INFO:tasks.workunit.client.0.trial030.stderr: 23: _start() 2026-02-17T05:37:34.748 INFO:tasks.workunit.client.0.trial030.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2026-02-17T05:37:34.748 INFO:tasks.workunit.client.0.trial030.stderr: 2026-02-17T05:37:34.748 INFO:tasks.workunit.client.0.trial030.stderr: -499> 2026-02-17T05:37:34.728+0000 7f47e8267d40 -1 ./src/os/bluestore/BlueStore.h: In function 'virtual void RocksDBBlueFSVolumeSelector::sub_usage(void*, uint64_t, bool)' thread 7f47e8267d40 time 2026-02-17T05:37:34.730191+0000 2026-02-17T05:37:34.748 INFO:tasks.workunit.client.0.trial030.stderr:./src/os/bluestore/BlueStore.h: 4591: FAILED ceph_assert(cur >= size_less) 2026-02-17T05:37:34.748 INFO:tasks.workunit.client.0.trial030.stderr: 2026-02-17T05:37:34.748 INFO:tasks.workunit.client.0.trial030.stderr: ceph version 20.3.0-5271-g32585015 (325850157d309f65985eea9ec9bb9f1d56726fee) tentacle (dev - None) 2026-02-17T05:37:34.748 INFO:tasks.workunit.client.0.trial030.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x137) [0x7f47e9d91ea9] 2026-02-17T05:37:34.748 INFO:tasks.workunit.client.0.trial030.stderr: 2: ceph-bluestore-tool(+0x18a6d6) [0x5599496926d6] 2026-02-17T05:37:34.749 INFO:tasks.workunit.client.0.trial030.stderr: 3: (BlueFS::_drop_link_DF(boost::intrusive_ptr)+0x102) [0x559949799632] 2026-02-17T05:37:34.749 INFO:tasks.workunit.client.0.trial030.stderr: 4: (BlueFS::unlink(std::basic_string_view >, std::basic_string_view >)+0x313) [0x5599497b9813] 2026-02-17T05:37:34.749 INFO:tasks.workunit.client.0.trial030.stderr: 5: (BlueRocksEnv::DeleteFile(std::__cxx11::basic_string, std::allocator > const&)+0x47) [0x5599498ec697] 2026-02-17T05:37:34.749 INFO:tasks.workunit.client.0.trial030.stderr: 6: (rocksdb::DeleteDBFile(rocksdb::ImmutableDBOptions const*, std::__cxx11::basic_string, std::allocator > const&, std::__cxx11::basic_string, std::allocator > const&, bool, bool)+0xb3) [0x559949a9f873] 2026-02-17T05:37:34.749 INFO:tasks.workunit.client.0.trial030.stderr: 7: (rocksdb::DBImpl::DeleteObsoleteFileImpl(int, std::__cxx11::basic_string, std::allocator > const&, std::__cxx11::basic_string, std::allocator > const&, rocksdb::FileType, unsigned long)+0xc3) [0x559949997633] 2026-02-17T05:37:34.749 INFO:tasks.workunit.client.0.trial030.stderr: 8: (rocksdb::DBImpl::PurgeObsoleteFiles(rocksdb::JobContext&, bool)+0x1a4e) [0x55994999ca6e] 2026-02-17T05:37:34.749 INFO:tasks.workunit.client.0.trial030.stderr: 9: (rocksdb::DBImpl::DeleteObsoleteFiles()+0xa9) [0x55994999d359] 2026-02-17T05:37:34.749 INFO:tasks.workunit.client.0.trial030.stderr: 10: (rocksdb::DBImpl::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string, std::allocator > const&, std::vector > const&, std::vector >*, rocksdb::DB**, bool, bool)+0x812) [0x5599499ab412] 2026-02-17T05:37:34.749 INFO:tasks.workunit.client.0.trial030.stderr: 11: (rocksdb::DB::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string, std::allocator > const&, std::vector > const&, std::vector >*, rocksdb::DB**)+0x28) [0x5599499ac978] 2026-02-17T05:37:34.749 INFO:tasks.workunit.client.0.trial030.stderr: 12: (RocksDBStore::do_open(std::ostream&, bool, bool, std::__cxx11::basic_string, std::allocator > const&)+0xdf4) [0x55994975f724] 2026-02-17T05:37:34.749 INFO:tasks.workunit.client.0.trial030.stderr: 13: (BlueStore::_open_db(bool, bool, bool)+0x4e2) [0x55994980d162] 2026-02-17T05:37:34.749 INFO:tasks.workunit.client.0.trial030.stderr: 14: (BlueStore::_open_db_and_around(bool, bool)+0x454) [0x55994980e024] 2026-02-17T05:37:34.750 INFO:tasks.workunit.client.0.trial030.stderr: 15: (BlueStore::expand_devices(std::ostream&)+0x97d) [0x55994981789d] 2026-02-17T05:37:34.750 INFO:tasks.workunit.client.0.trial030.stderr: 16: main() 2026-02-17T05:37:34.750 INFO:tasks.workunit.client.0.trial030.stderr: 17: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f47e9458d90] 2026-02-17T05:37:34.750 INFO:tasks.workunit.client.0.trial030.stderr: 18: __libc_start_main() 2026-02-17T05:37:34.750 INFO:tasks.workunit.client.0.trial030.stderr: 19: _start() 2026-02-17T05:37:34.750 INFO:tasks.workunit.client.0.trial030.stderr: 2026-02-17T05:37:34.750 INFO:tasks.workunit.client.0.trial030.stderr: -498> 2026-02-17T05:37:34.728+0000 7f47e8267d40 -1 *** Caught signal (Aborted) ** 2026-02-17T05:37:34.750 INFO:tasks.workunit.client.0.trial030.stderr: in thread 7f47e8267d40 thread_name:ceph-bluestore- 2026-02-17T05:37:34.750 INFO:tasks.workunit.client.0.trial030.stderr: 2026-02-17T05:37:34.750 INFO:tasks.workunit.client.0.trial030.stderr: ceph version 20.3.0-5271-g32585015 (325850157d309f65985eea9ec9bb9f1d56726fee) tentacle (dev - None) 2026-02-17T05:37:34.750 INFO:tasks.workunit.client.0.trial030.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f47e9471520] 2026-02-17T05:37:34.750 INFO:tasks.workunit.client.0.trial030.stderr: 2: pthread_kill() 2026-02-17T05:37:34.750 INFO:tasks.workunit.client.0.trial030.stderr: 3: raise() 2026-02-17T05:37:34.751 INFO:tasks.workunit.client.0.trial030.stderr: 4: abort() 2026-02-17T05:37:34.751 INFO:tasks.workunit.client.0.trial030.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x196) [0x7f47e9d91f08] 2026-02-17T05:37:34.751 INFO:tasks.workunit.client.0.trial030.stderr: 6: ceph-bluestore-tool(+0x18a6d6) [0x5599496926d6] 2026-02-17T05:37:34.751 INFO:tasks.workunit.client.0.trial030.stderr: 7: (BlueFS::_drop_link_DF(boost::intrusive_ptr)+0x102) [0x559949799632] 2026-02-17T05:37:34.751 INFO:tasks.workunit.client.0.trial030.stderr: 8: (BlueFS::unlink(std::basic_string_view >, std::basic_string_view >)+0x313) [0x5599497b9813] 2026-02-17T05:37:34.751 INFO:tasks.workunit.client.0.trial030.stderr: 9: (BlueRocksEnv::DeleteFile(std::__cxx11::basic_string, std::allocator > const&)+0x47) [0x5599498ec697] 2026-02-17T05:37:34.751 INFO:tasks.workunit.client.0.trial030.stderr: 10: (rocksdb::DeleteDBFile(rocksdb::ImmutableDBOptions const*, std::__cxx11::basic_string, std::allocator > const&, std::__cxx11::basic_string, std::allocator > const&, bool, bool)+0xb3) [0x559949a9f873] 2026-02-17T05:37:34.751 INFO:tasks.workunit.client.0.trial030.stderr: 11: (rocksdb::DBImpl::DeleteObsoleteFileImpl(int, std::__cxx11::basic_string, std::allocator > const&, std::__cxx11::basic_string, std::allocator > const&, rocksdb::FileType, unsigned long)+0xc3) [0x559949997633] 2026-02-17T05:37:34.751 INFO:tasks.workunit.client.0.trial030.stderr: 12: (rocksdb::DBImpl::PurgeObsoleteFiles(rocksdb::JobContext&, bool)+0x1a4e) [0x55994999ca6e] 2026-02-17T05:37:34.751 INFO:tasks.workunit.client.0.trial030.stderr: 13: (rocksdb::DBImpl::DeleteObsoleteFiles()+0xa9) [0x55994999d359] 2026-02-17T05:37:34.751 INFO:tasks.workunit.client.0.trial030.stderr: 14: (rocksdb::DBImpl::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string, std::allocator > const&, std::vector > const&, std::vector >*, rocksdb::DB**, bool, bool)+0x812) [0x5599499ab412] 2026-02-17T05:37:34.751 INFO:tasks.workunit.client.0.trial030.stderr: 15: (rocksdb::DB::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string, std::allocator > const&, std::vector > const&, std::vector >*, rocksdb::DB**)+0x28) [0x5599499ac978] 2026-02-17T05:37:34.752 INFO:tasks.workunit.client.0.trial030.stderr: 16: (RocksDBStore::do_open(std::ostream&, bool, bool, std::__cxx11::basic_string, std::allocator > const&)+0xdf4) [0x55994975f724] 2026-02-17T05:37:34.752 INFO:tasks.workunit.client.0.trial030.stderr: 17: (BlueStore::_open_db(bool, bool, bool)+0x4e2) [0x55994980d162] 2026-02-17T05:37:34.752 INFO:tasks.workunit.client.0.trial030.stderr: 18: (BlueStore::_open_db_and_around(bool, bool)+0x454) [0x55994980e024] 2026-02-17T05:37:34.752 INFO:tasks.workunit.client.0.trial030.stderr: 19: (BlueStore::expand_devices(std::ostream&)+0x97d) [0x55994981789d] 2026-02-17T05:37:34.752 INFO:tasks.workunit.client.0.trial030.stderr: 20: main() 2026-02-17T05:37:34.752 INFO:tasks.workunit.client.0.trial030.stderr: 21: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f47e9458d90] 2026-02-17T05:37:34.752 INFO:tasks.workunit.client.0.trial030.stderr: 22: __libc_start_main() 2026-02-17T05:37:34.752 INFO:tasks.workunit.client.0.trial030.stderr: 23: _start() 2026-02-17T05:37:34.752 INFO:tasks.workunit.client.0.trial030.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2026-02-17T05:37:34.752 INFO:tasks.workunit.client.0.trial030.stderr: 2026-02-17T05:37:35.078 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 19: 97675 Aborted (core dumped) ceph-bluestore-tool --path $dir/0 bluefs-bdev-expand 2026-02-17T05:37:35.078 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:76: TEST_bluestore: return 1 2026-02-17T05:37:35.078 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:14: run: return 1 2026-02-17T05:37:35.079 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2402: main: code=1 2026-02-17T05:37:35.079 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2404: main: teardown td/osd-bluefs-volume-ops 1 2026-02-17T05:37:35.079 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bluefs-volume-ops 2026-02-17T05:37:35.079 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=1 2026-02-17T05:37:35.079 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bluefs-volume-ops KILL 2026-02-17T05:37:35.079 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:37:35.079 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:37:35.079 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:37:35.079 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:37:35.079 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:37:35.187 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:37:35.188 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T05:37:35.188 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T05:37:35.189 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T05:37:35.190 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T05:37:35.190 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T05:37:35.191 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T05:37:35.191 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:37:35.191 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T05:37:35.192 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T05:37:35.192 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:37:35.193 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T05:37:35.194 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: cores=yes 2026-02-17T05:37:35.194 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:173: teardown: '[' -n '' ']' 2026-02-17T05:37:35.194 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' yes = yes -o 1 = 1 ']' 2026-02-17T05:37:35.194 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:181: teardown: '[' -n '' ']' 2026-02-17T05:37:35.195 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:185: teardown: mkdir -p /home/ubuntu/cephtest/archive/log 2026-02-17T05:37:35.195 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:186: teardown: mv td/osd-bluefs-volume-ops/mgr.x.log td/osd-bluefs-volume-ops/mon.a.log td/osd-bluefs-volume-ops/osd.0.log td/osd-bluefs-volume-ops/osd.1.log td/osd-bluefs-volume-ops/osd.2.log td/osd-bluefs-volume-ops/osd.3.log /home/ubuntu/cephtest/archive/log 2026-02-17T05:37:35.196 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bluefs-volume-ops 2026-02-17T05:37:35.349 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T05:37:35.349 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:37:35.349 INFO:tasks.workunit.client.0.trial030.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.86949 2026-02-17T05:37:35.349 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.86949 2026-02-17T05:37:35.350 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' yes = yes ']' 2026-02-17T05:37:35.350 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:192: teardown: echo 'ERROR: Failure due to cores found' 2026-02-17T05:37:35.351 INFO:tasks.workunit.client.0.trial030.stdout:ERROR: Failure due to cores found 2026-02-17T05:37:35.351 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T05:37:35.352 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:193: teardown: '[' -n '' ']' 2026-02-17T05:37:35.352 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:196: teardown: return 1 2026-02-17T05:37:35.352 INFO:tasks.workunit.client.0.trial030.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2404: main: return 1 2026-02-17T05:37:35.352 INFO:tasks.workunit:Stopping ['osd'] on client.0... 2026-02-17T05:37:35.353 DEBUG:teuthology.orchestra.run.trial030:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-17T05:37:35.712 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph-c_325850157d309f65985eea9ec9bb9f1d56726fee/qa/tasks/workunit.py", line 144, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/github.com_ceph_ceph-c_325850157d309f65985eea9ec9bb9f1d56726fee/qa/tasks/workunit.py", line 292, in _spawn_on_all_clients with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph-c_325850157d309f65985eea9ec9bb9f1d56726fee/qa/tasks/workunit.py", line 433, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/remote.py", line 596, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test osd/osd-bluefs-volume-ops.sh) on trial030 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=325850157d309f65985eea9ec9bb9f1d56726fee TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh' 2026-02-17T05:37:35.717 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-17T05:37:35.733 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-17T05:37:35.734 DEBUG:teuthology.orchestra.run.trial030:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-17T05:37:35.841 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-17T05:37:35.852 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-17T05:37:35.852 DEBUG:teuthology.orchestra.run.trial030:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T05:37:35.918 INFO:teuthology.orchestra.run.trial030.stdout: remote refid st t when poll reach delay offset jitter 2026-02-17T05:37:35.918 INFO:teuthology.orchestra.run.trial030.stdout:============================================================================== 2026-02-17T05:37:35.918 INFO:teuthology.orchestra.run.trial030.stdout:-172-234-25-10.i 80.192.165.246 2 u 12 64 377 27.275 +8.889 2.141 2026-02-17T05:37:35.919 INFO:teuthology.orchestra.run.trial030.stdout:*66.59.198.178 17.253.6.37 2 u 10 64 377 21.798 +0.325 10.338 2026-02-17T05:37:35.919 INFO:teuthology.orchestra.run.trial030.stdout:+time.cloudflare 10.132.8.14 3 u 2 64 377 3.082 +3.033 2.318 2026-02-17T05:37:35.919 INFO:teuthology.orchestra.run.trial030.stdout:+172-233-189-68. 80.192.165.246 2 u 63 64 377 36.894 +2.133 3.133 2026-02-17T05:37:35.919 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-17T05:37:35.931 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-17T05:37:35.931 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-17T05:37:35.944 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-17T05:37:35.959 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-17T05:37:35.973 INFO:teuthology.task.internal:Duration was 946.024781 seconds 2026-02-17T05:37:35.973 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-17T05:37:35.988 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-17T05:37:35.988 DEBUG:teuthology.orchestra.run.trial030:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-17T05:37:36.014 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-17T05:37:36.014 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial030.front.sepia.ceph.com 2026-02-17T05:37:36.015 DEBUG:teuthology.orchestra.run.trial030:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-17T05:37:36.061 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-17T05:37:36.061 DEBUG:teuthology.orchestra.run.trial030:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T05:37:36.259 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-17T05:37:36.259 DEBUG:teuthology.orchestra.run.trial030:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T05:37:36.269 INFO:teuthology.orchestra.run.trial030.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T05:37:36.269 INFO:teuthology.orchestra.run.trial030.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T05:37:36.269 INFO:teuthology.orchestra.run.trial030.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-17T05:37:36.269 INFO:teuthology.orchestra.run.trial030.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T05:37:36.270 INFO:teuthology.orchestra.run.trial030.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-17T05:37:36.315 INFO:teuthology.orchestra.run.trial030.stderr: 81.7% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-17T05:37:36.317 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-17T05:37:36.334 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-17T05:37:36.335 DEBUG:teuthology.orchestra.run.trial030:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-17T05:37:36.366 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-17T05:37:36.382 DEBUG:teuthology.orchestra.run.trial030:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-17T05:37:36.417 INFO:teuthology.orchestra.run.trial030.stdout:kernel.core_pattern = core 2026-02-17T05:37:36.428 DEBUG:teuthology.orchestra.run.trial030:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-17T05:37:36.473 WARNING:teuthology.task.internal:Found coredumps on ubuntu@trial030.front.sepia.ceph.com, flagging run as failed 2026-02-17T05:37:36.474 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-17T05:37:36.490 INFO:teuthology.task.internal:Transferring archived files... 2026-02-17T05:37:36.492 DEBUG:teuthology.misc:Transferring archived files from trial030:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_03:53:03-rados-wip-bharath18-testing-2026-02-13-0856-distro-default-trial/50998/remote/trial030 2026-02-17T05:37:36.493 DEBUG:teuthology.orchestra.run.trial030:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-17T05:42:00.465 INFO:teuthology.task.internal:Transferring binaries for coredumps... 2026-02-17T05:42:00.478 INFO:teuthology.task.internal: core looks like: /home/teuthworker/mnt/teuthology/skanta-2026-02-17_03:53:03-rados-wip-bharath18-testing-2026-02-13-0856-distro-default-trial/50998/remote/trial030/coredump/1771306654.97675.core.gz: gzip compressed data, was "1771306654.97675.core", last modified: Tue Feb 17 05:37:36 2026, max compression, original size modulo 2^32 390303744 2026-02-17T05:42:00.478 INFO:teuthology.task.internal:core is compressed, try accessing gzip file ... 2026-02-17T05:42:01.192 INFO:teuthology.task.internal: core looks like: /tmp/tmpf38nk298: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 bluefs-bdev-expand', real uid: 1000, effective uid: 1000, real gid: 1002, effective gid: 1002, execfn: '/usr/bin/ceph-bluestore-tool', platform: 'x86_64' 2026-02-17T05:42:01.197 INFO:teuthology.task.internal: dump_program: ceph-bluestore-tool 2026-02-17T05:42:01.197 DEBUG:teuthology.orchestra.run.trial030:> which ceph-bluestore-tool 2026-02-17T05:42:01.202 INFO:teuthology.orchestra.run.trial030.stdout:/usr/bin/ceph-bluestore-tool 2026-02-17T05:42:01.248 DEBUG:teuthology.orchestra.remote:trial030:/usr/bin/ceph-bluestore-tool is 242MB 2026-02-17T05:42:02.744 DEBUG:teuthology.orchestra.run.trial030:> mktemp 2026-02-17T05:42:02.749 INFO:teuthology.orchestra.run.trial030.stdout:/tmp/tmp.TPcuuk1zCh 2026-02-17T05:42:02.749 DEBUG:teuthology.orchestra.run.trial030:> sudo cp /usr/bin/ceph-bluestore-tool /tmp/tmp.TPcuuk1zCh 2026-02-17T05:42:03.121 DEBUG:teuthology.orchestra.run.trial030:> sudo chmod 0666 /tmp/tmp.TPcuuk1zCh 2026-02-17T05:42:03.176 DEBUG:teuthology.orchestra.remote:trial030:/tmp/tmp.TPcuuk1zCh is 242MB 2026-02-17T05:42:04.616 DEBUG:teuthology.orchestra.run.trial030:> rm -fr /tmp/tmp.TPcuuk1zCh 2026-02-17T05:42:04.656 INFO:teuthology.task.internal:Removing archive directory... 2026-02-17T05:42:04.656 DEBUG:teuthology.orchestra.run.trial030:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-17T05:42:06.101 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-17T05:42:06.115 INFO:teuthology.task.internal:Not uploading archives. 2026-02-17T05:42:06.115 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-17T05:42:06.128 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-17T05:42:06.128 DEBUG:teuthology.orchestra.run.trial030:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-17T05:42:06.133 INFO:teuthology.orchestra.run.trial030.stdout: 1180220 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Feb 17 05:42 /home/ubuntu/cephtest 2026-02-17T05:42:06.133 INFO:teuthology.orchestra.run.trial030.stdout: 1190961 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Feb 17 05:25 /home/ubuntu/cephtest/mnt.0 2026-02-17T05:42:06.133 INFO:teuthology.orchestra.run.trial030.stdout: 1190962 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Feb 17 05:36 /home/ubuntu/cephtest/mnt.0/client.0 2026-02-17T05:42:06.133 INFO:teuthology.orchestra.run.trial030.stdout: 1206874 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Feb 17 05:36 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-17T05:42:06.133 INFO:teuthology.orchestra.run.trial030.stdout: 1206875 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Feb 17 05:37 /home/ubuntu/cephtest/mnt.0/client.0/tmp/td 2026-02-17T05:42:06.134 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T05:42:06.134 INFO:teuthology.orchestra.run.trial030.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2026-02-17T05:42:06.134 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 485, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial030 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2026-02-17T05:42:06.136 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-17T05:42:06.151 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-17T05:42:06.165 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on trial030 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2026-02-17T05:42:06.170 INFO:teuthology.run:Summary data: description: rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd} duration: 946.0247805118561 failure_reason: 'Command failed (workunit test osd/osd-bluefs-volume-ops.sh) on trial030 with status 1: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=325850157d309f65985eea9ec9bb9f1d56726fee TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh''' flavor: default owner: scheduled_skanta@soko04.front.sepia.ceph.com sentry_event: null status: fail success: false 2026-02-17T05:42:06.170 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T05:42:06.283 INFO:teuthology.run:FAIL